-- Logs begin at Tue 2022-08-02 20:40:29 UTC, end at Tue 2022-08-02 21:57:27 UTC. -- Aug 02 21:26:32.641728 dv-cinder-851449-4-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 02 21:26:32.649821 dv-cinder-851449-4-smb devstack@keystone.service[80411]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 02 21:26:32.652362 dv-cinder-851449-4-smb devstack@keystone.service[80411]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 2 21:26:32 2022] *** Aug 02 21:26:32.652500 dv-cinder-851449-4-smb devstack@keystone.service[80411]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 02 21:26:32.652607 dv-cinder-851449-4-smb devstack@keystone.service[80411]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 02 21:26:32.652711 dv-cinder-851449-4-smb devstack@keystone.service[80411]: nodename: dv-cinder-851449-4-smb Aug 02 21:26:32.652823 dv-cinder-851449-4-smb devstack@keystone.service[80411]: machine: x86_64 Aug 02 21:26:32.652823 dv-cinder-851449-4-smb devstack@keystone.service[80411]: clock source: unix Aug 02 21:26:32.652823 dv-cinder-851449-4-smb devstack@keystone.service[80411]: pcre jit disabled Aug 02 21:26:32.652823 dv-cinder-851449-4-smb devstack@keystone.service[80411]: detected number of CPU cores: 4 Aug 02 21:26:32.652823 dv-cinder-851449-4-smb devstack@keystone.service[80411]: current working directory: / Aug 02 21:26:32.652823 dv-cinder-851449-4-smb devstack@keystone.service[80411]: detected binary path: /usr/bin/uwsgi-core Aug 02 21:26:32.652823 dv-cinder-851449-4-smb devstack@keystone.service[80411]: your processes number limit is 47680 Aug 02 21:26:32.652823 dv-cinder-851449-4-smb devstack@keystone.service[80411]: your memory page size is 4096 bytes Aug 02 21:26:32.653783 dv-cinder-851449-4-smb devstack@keystone.service[80411]: detected max file descriptor number: 2048 Aug 02 21:26:32.653783 dv-cinder-851449-4-smb devstack@keystone.service[80411]: lock engine: pthread robust mutexes Aug 02 21:26:32.653783 dv-cinder-851449-4-smb devstack@keystone.service[80411]: thunder lock: enabled Aug 02 21:26:32.653783 dv-cinder-851449-4-smb devstack@keystone.service[80411]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 02 21:26:32.653783 dv-cinder-851449-4-smb devstack@keystone.service[80411]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 02 21:26:32.692408 dv-cinder-851449-4-smb devstack@keystone.service[80411]: Python main interpreter initialized at 0x55f54369a9c0 Aug 02 21:26:32.692408 dv-cinder-851449-4-smb devstack@keystone.service[80411]: python threads support enabled Aug 02 21:26:32.692408 dv-cinder-851449-4-smb devstack@keystone.service[80411]: your server socket listen backlog is limited to 100 connections Aug 02 21:26:32.692408 dv-cinder-851449-4-smb devstack@keystone.service[80411]: your mercy for graceful operations on workers is 90 seconds Aug 02 21:26:32.692736 dv-cinder-851449-4-smb devstack@keystone.service[80411]: mapped 403077 bytes (393 KB) for 2 cores Aug 02 21:26:32.692824 dv-cinder-851449-4-smb devstack@keystone.service[80411]: *** Operational MODE: preforking *** Aug 02 21:26:32.693093 dv-cinder-851449-4-smb devstack@keystone.service[80411]: *** uWSGI is running in multiple interpreter mode *** Aug 02 21:26:32.693093 dv-cinder-851449-4-smb devstack@keystone.service[80411]: spawned uWSGI master process (pid: 80411) Aug 02 21:26:32.693282 dv-cinder-851449-4-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 02 21:26:32.693953 dv-cinder-851449-4-smb devstack@keystone.service[80411]: spawned uWSGI worker 1 (pid: 80419, cores: 1) Aug 02 21:26:32.695426 dv-cinder-851449-4-smb devstack@keystone.service[80411]: spawned uWSGI worker 2 (pid: 80420, cores: 1) Aug 02 21:26:32.695426 dv-cinder-851449-4-smb devstack@keystone.service[80411]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 02 21:26:38.216872 dv-cinder-851449-4-smb devstack@keystone.service[80420]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 02 21:26:38.216872 dv-cinder-851449-4-smb devstack@keystone.service[80420]: from cryptography.utils import int_from_bytes Aug 02 21:26:38.217672 dv-cinder-851449-4-smb devstack@keystone.service[80420]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 02 21:26:38.217672 dv-cinder-851449-4-smb devstack@keystone.service[80420]: from cryptography.utils import int_from_bytes Aug 02 21:26:38.219608 dv-cinder-851449-4-smb devstack@keystone.service[80419]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 02 21:26:38.219608 dv-cinder-851449-4-smb devstack@keystone.service[80419]: from cryptography.utils import int_from_bytes Aug 02 21:26:38.220160 dv-cinder-851449-4-smb devstack@keystone.service[80419]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 02 21:26:38.220160 dv-cinder-851449-4-smb devstack@keystone.service[80419]: from cryptography.utils import int_from_bytes Aug 02 21:26:38.267674 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 02 21:26:38.267859 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 02 21:26:38.268053 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] command line args: [] {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 02 21:26:38.268363 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 02 21:26:38.268542 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ================================================================================ {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 02 21:26:38.268795 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] admin_token = **** {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:26:38.269314 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] config_dir = [] {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:26:38.269511 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:26:38.269692 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] config_source = [] {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:26:38.269874 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] debug = True {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:26:38.270071 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:26:38.270316 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 02 21:26:38.270458 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 02 21:26:38.270541 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:26:38.270608 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:26:38.270665 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] command line args: [] {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 02 21:26:38.270847 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:26:38.270939 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 02 21:26:38.271054 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ================================================================================ {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 02 21:26:38.271165 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:26:38.271308 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] list_limit = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:26:38.271416 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] admin_token = **** {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:26:38.271518 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] log_config_append = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:26:38.271621 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] config_dir = [] {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:26:38.271722 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:26:38.271828 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:26:38.271924 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] log_dir = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:26:38.272023 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] config_source = [] {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:26:38.272117 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] log_file = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:26:38.272227 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] debug = True {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:26:38.272367 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:26:38.272447 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:26:38.272549 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:26:38.272625 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:26:38.272752 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:26:38.272833 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:26:38.272984 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:26:38.273102 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:26:38.273177 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:26:38.273300 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:26:38.273384 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:26:38.273457 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] list_limit = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:26:38.273577 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:26:38.273653 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] log_config_append = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:26:38.273768 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:26:38.273852 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:26:38.273931 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] log_dir = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:26:38.274052 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:26:38.274132 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] log_file = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:26:38.274253 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:26:38.274327 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:26:38.274449 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:26:38.274531 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:26:38.274609 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:26:38.274732 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:26:38.274807 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:26:38.274952 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:26:38.275088 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:26:38.275172 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:26:38.275293 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:26:38.275372 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:26:38.275536 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:26:38.275784 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:26:38.275917 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.70/identity {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:26:38.276002 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] publish_errors = False {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:26:38.276075 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:26:38.276180 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:26:38.276288 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:26:38.276438 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:26:38.276512 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:26:38.276616 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:26:38.276695 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:26:38.276862 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:26:38.276948 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:26:38.277094 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:26:38.277172 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:26:38.277326 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] standard_threads = False {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:26:38.277441 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:26:38.277554 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:26:38.277796 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:26:38.277943 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.70/identity {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:26:38.278039 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:26:38.278159 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] use_journal = False {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:26:38.278236 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] publish_errors = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:26:38.278337 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] use_json = False {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:26:38.278441 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:26:38.278519 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] use_stderr = False {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:26:38.278673 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] use_syslog = False {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:26:38.278757 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:26:38.278835 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:26:38.278904 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:26:38.279085 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:26:38.279162 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.279321 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:26:38.279400 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.279557 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] standard_threads = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:26:38.279637 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.279788 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:26:38.279871 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.280033 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:26:38.280117 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.280193 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:26:38.280311 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.280403 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] use_journal = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:26:38.280562 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.280658 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] use_json = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:26:38.280731 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] use_stderr = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:26:38.280799 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.280897 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] use_syslog = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:26:38.281032 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.281129 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 02 21:26:38.281279 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.281387 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.281540 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.281621 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.281762 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.281877 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.282008 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.282119 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.282242 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.282441 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.282531 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.282615 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.282722 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.282866 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.282957 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.283105 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.283209 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.283357 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.283462 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.283609 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.283707 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.283860 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.283928 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.284100 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.284269 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.284376 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.284444 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.284615 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.284685 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.284892 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.284980 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.285106 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.285193 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.285341 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.285426 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.285572 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.285661 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.285807 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.285886 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.286055 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.286134 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.286302 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.286380 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.286531 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.286608 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.286761 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.286838 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.289263 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.289365 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.289441 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.289511 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.289581 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.289650 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.289740 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.289821 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.289892 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.289961 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.290031 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.290102 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.290183 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.290255 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.290325 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.290394 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.290463 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.290538 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.290617 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.290688 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.290758 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.290827 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.290896 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.290971 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.291115 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.291190 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.291260 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.291333 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.291404 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.291479 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.291562 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.291634 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.291710 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.291781 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.291852 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.291921 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.291999 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.292070 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.292140 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.292216 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.292303 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.292373 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.292458 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.292538 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.292652 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.292729 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.292800 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.292869 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.292947 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.293019 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.293089 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.293153 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.293212 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.293299 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.293367 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.293432 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.293492 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.293550 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.293608 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.293673 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.294377 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.294448 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.294616 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.294692 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.294848 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.294929 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.295084 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.295214 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.295320 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.295406 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.295551 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.295630 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.295804 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.295886 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.296043 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.296122 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.296306 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.296393 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.296544 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.296634 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.296781 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.296868 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.297016 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.297095 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.297257 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.297345 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.297493 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.297576 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.297727 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.297807 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.297969 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.298056 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.298205 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.298280 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.298440 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.298513 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.298674 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.298756 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.298910 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.298989 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.299144 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.299221 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.299383 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.299468 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.299626 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.299704 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.299864 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.300447 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.300447 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.300598 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.300677 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.300755 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.300826 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.300896 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.300973 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.301045 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.301115 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.301185 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.301260 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.301331 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.301477 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.301553 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.301657 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.301736 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.301891 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.301970 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.302121 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.302209 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.302361 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.302441 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.302594 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.302673 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.302861 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.302972 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.303082 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.303210 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.303321 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.303461 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.303549 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.303635 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.303771 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.303852 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.304008 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.304088 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] auth.external = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.304283 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.304378 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.304493 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.304571 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.304737 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.304816 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.304975 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.305063 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] auth.password = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.305204 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] auth.token = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.305343 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.305426 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.305498 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.305662 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.305770 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.305909 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.305997 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.306138 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.306218 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.306389 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] auth.external = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.306467 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.306623 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.306710 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.306850 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.306928 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.307083 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] credential.caching = True {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.307162 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.307329 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.307416 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] auth.password = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.307575 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.307654 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] auth.token = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.307818 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.307895 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.308058 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.308148 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.308332 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.308415 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.308571 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.308653 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.308821 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.308909 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.309070 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.309150 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.309319 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.309463 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.310106 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] credential.caching = True {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.310197 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.310359 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.310476 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.310610 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.310725 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.310861 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.310991 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.311100 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.311235 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.311347 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.311491 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.311570 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.311727 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] federation.caching = True {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.311850 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.311964 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.312107 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.312213 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.312378 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.312475 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.312638 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.312724 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.312926 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.313005 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.313159 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.313246 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.313414 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.313495 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.313650 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.313729 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.313904 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.313991 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.314139 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] federation.caching = True {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.314218 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.314379 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.314458 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.314619 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] identity.caching = True {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.314699 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.314867 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.314951 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.315102 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.315181 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.315344 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.315423 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.315580 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.315659 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.315829 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.315908 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.316056 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.316132 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.316312 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.316396 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.316564 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.316644 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.316815 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.316900 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.317048 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.317128 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] identity.caching = True {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.317281 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.317368 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.317512 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.317592 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.317756 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.317880 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.317992 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.318071 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.318235 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.318314 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.318466 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.318544 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.318708 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.318787 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.318962 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.319048 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.319202 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.319280 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.319434 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.319513 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.319665 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.319745 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.319896 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.319974 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.320123 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.320201 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.320381 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.320464 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.320621 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.320701 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.320860 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.320939 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.321108 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.321188 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.321339 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.321417 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.321585 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.321664 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.321831 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.321911 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.322061 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.322139 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.322301 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.322380 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.322535 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.322615 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.322762 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.322839 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.323000 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.323079 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.323229 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.323310 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.323467 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.323545 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.323696 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.323774 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.323933 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.324012 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.324169 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.324266 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.324429 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.324510 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.324676 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.324767 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.324920 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.325020 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.325174 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.325261 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.325404 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.325483 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.325634 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.325711 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.325873 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.325960 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.326105 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.326183 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.326343 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.326421 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.326577 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.326663 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.326808 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.user = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.326887 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.327047 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.327126 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.327296 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.327382 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.327524 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.327603 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.327753 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.327837 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.328000 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.328087 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.328273 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.328356 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.328495 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.328574 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.328724 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.328816 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.328958 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.329037 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.329190 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.user = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.329268 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.329423 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.329509 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.329652 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.329732 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.329896 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.329975 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.330140 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.330228 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.330384 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.330463 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.330629 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.330747 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.330866 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.330995 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.331100 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.331300 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.331380 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.331551 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.331631 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.331790 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.331871 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.332029 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.332108 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.332297 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.332380 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.332536 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.332617 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.332780 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.332859 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.333026 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.333104 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.333261 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.333340 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.333494 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.333572 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.333730 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.333808 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.333967 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.334047 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.334201 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.334279 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.334436 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.334514 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.334670 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.334750 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.334914 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.334991 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.335152 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.335230 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.335383 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.335464 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.335619 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.335707 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.335855 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.335933 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] resource.caching = True {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.336101 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.336180 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.336360 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.336440 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.336602 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.336714 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.336839 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.336929 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.337085 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.337212 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.337320 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.337463 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.337557 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.337701 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.337781 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.337942 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.338021 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.338187 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] resource.caching = True {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.338275 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] role.caching = True {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.338444 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.338524 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] role.driver = sql {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.338680 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.338759 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.338921 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.339075 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.339150 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.339222 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.339410 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.339488 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.339649 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.339730 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.339901 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.339981 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.340141 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.340219 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.340418 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.340500 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.341168 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] role.caching = True {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.341251 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.341401 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.341479 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] role.driver = sql {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.341642 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.341722 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.341886 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.341964 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.342133 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.342211 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.342375 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.342454 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.342620 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.342794 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.342874 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.343030 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.343116 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.343280 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.343360 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.343529 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.343608 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.343776 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.343864 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.344024 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.344104 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.344279 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.344364 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.344530 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.344621 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.344778 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.344865 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.345014 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.345194 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.345273 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.345433 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.345513 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.345681 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.345763 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.345929 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.346016 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.346178 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.346256 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.346426 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.346504 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.346660 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.346746 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.346895 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.346974 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.347125 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.347204 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.347359 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] token.caching = True {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.347446 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.347595 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.347674 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.347825 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.347904 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.348059 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.348146 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.348331 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.348411 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.348581 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.348659 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.348818 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.348909 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.349058 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.349137 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.349296 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.349375 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.349528 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.349614 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.349763 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.349841 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] token.caching = True {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.349999 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.350076 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.350230 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.350316 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.350471 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.350548 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.350714 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.350791 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.350941 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.351028 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.351182 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.351261 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.351423 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.351500 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.351668 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.351754 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] database.connection = **** {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.351918 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.352007 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.352157 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.352284 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.352420 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.352498 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.352655 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.352735 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.352885 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.352963 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.353121 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.353199 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.353354 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.353435 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.353587 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.353667 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.353830 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.353909 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.354064 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.354144 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] database.connection = **** {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.354307 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.354396 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.354542 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.354621 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.354786 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.354865 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.355044 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.355123 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.355281 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.355360 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.355521 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.355601 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.355761 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.355842 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.355993 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.356071 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.356162 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80420) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 02 21:26:38.356794 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.357039 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.357286 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.357525 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.357775 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.358023 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.358259 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.358494 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.358735 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.358973 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 02 21:26:38.359143 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80419) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 02 21:26:38.386754 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 21:26:38.387001 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 21:26:38.387210 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 21:26:38.388320 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 21:26:38.388559 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 21:26:38.388790 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 21:26:38.396099 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 21:26:38.397098 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 21:26:38.425509 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 21:26:38.425736 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 21:26:38.426267 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 21:26:38.426506 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 21:26:38.478856 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 21:26:38.479070 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 21:26:38.529585 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 21:26:38.529824 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 21:26:38.530227 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 21:26:38.530467 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 21:26:38.594694 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 21:26:38.594926 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 21:26:38.595012 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 21:26:38.595155 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 21:26:38.595256 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 21:26:38.595379 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 21:26:38.595462 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 21:26:38.595599 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 21:26:38.595682 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 21:26:38.595814 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 21:26:38.595904 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 21:26:38.596033 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 21:26:38.619500 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 21:26:38.619750 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 21:26:38.619846 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 21:26:38.619975 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 21:26:38.620060 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 21:26:38.620206 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 21:26:38.620360 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 21:26:38.620465 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 21:26:38.620563 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 21:26:38.620687 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 21:26:38.620771 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 21:26:38.620905 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 21:26:38.620986 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 21:26:38.621114 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 21:26:38.632002 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 21:26:38.632188 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 21:26:38.644618 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 21:26:38.644853 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 21:26:38.644937 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 21:26:38.645083 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 21:26:38.645167 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 21:26:38.645308 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 21:26:38.645391 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 21:26:38.645527 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 21:26:38.645624 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 21:26:38.645746 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 21:26:38.645829 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 21:26:38.645963 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80419) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 21:26:38.646046 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 21:26:38.646184 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80420) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 02 21:26:38.663283 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.663497 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 02 21:26:38.663582 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.663761 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 02 21:26:38.663843 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.664044 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 02 21:26:38.664127 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.664310 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 02 21:26:38.664435 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.664579 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.664705 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.664835 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.664943 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.665087 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.665285 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.665427 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.675857 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.676135 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.676428 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.676511 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.676707 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.676804 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.677009 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.677297 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.683592 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80420) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 21:26:38.684214 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80419) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 21:26:38.688259 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80420) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 21:26:38.688544 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.688823 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.688944 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80419) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 21:26:38.689101 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.689228 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.689381 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.689513 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.689636 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.689798 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.689902 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.690085 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.690167 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.690350 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.690430 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.690619 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.690708 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.690894 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.690976 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.691165 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.691439 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.691707 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.714318 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.715171 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.716367 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80420) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 21:26:38.716649 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.717323 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80419) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 21:26:38.717605 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.721269 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80420) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 21:26:38.721547 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.721825 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.722236 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80419) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 21:26:38.722520 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.722806 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.728370 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80420) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 21:26:38.728655 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.729438 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80419) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 21:26:38.729681 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.732932 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80420) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 21:26:38.733218 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.733507 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.733734 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80419) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 21:26:38.733817 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.734029 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.734113 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.734316 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.734399 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.734580 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.734669 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.734855 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.734938 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.735130 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.735404 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.735675 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.750929 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.751220 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.751674 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.751956 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.755097 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80420) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 21:26:38.755817 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80419) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 21:26:38.758229 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.758524 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.758954 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.759256 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.763492 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80420) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 21:26:38.764167 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80419) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 21:26:38.766642 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80420) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 21:26:38.767367 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80419) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 21:26:38.769788 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.770084 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.770365 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.770524 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.770656 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.770828 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.770919 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.771129 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.771212 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.771429 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.771718 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.772007 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.788332 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80420) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 21:26:38.788612 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.788876 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.789007 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80419) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 21:26:38.789137 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.789279 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.789537 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.789806 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.795930 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.796735 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.797482 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.797753 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.798308 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.798588 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.800567 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80420) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 21:26:38.800846 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.801138 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.801432 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80419) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 21:26:38.801515 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.801715 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.801801 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.802015 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.802310 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.802602 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.813098 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80420) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 21:26:38.813376 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.813657 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.813936 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.814108 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80419) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 21:26:38.814194 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.814392 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.814477 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.814676 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.814759 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.814958 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.815239 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.815514 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.815803 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.830770 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80420) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 21:26:38.831887 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80419) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 21:26:38.833697 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80420) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 21:26:38.834873 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80419) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 21:26:38.836627 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.837831 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.839046 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.840345 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.841222 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80420) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 21:26:38.841506 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.841783 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.842503 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80419) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 21:26:38.842794 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.843082 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.848136 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.849549 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.849812 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80420) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 21:26:38.851138 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80419) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 21:26:38.852712 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.853000 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.853281 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.853554 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.854075 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.854372 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.854662 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.854946 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.861540 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80420) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 21:26:38.861823 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.862358 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.863269 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80419) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 21:26:38.863560 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.863846 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.869129 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80420) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 21:26:38.869406 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.869682 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.869953 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.870233 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.870571 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.870712 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80419) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 02 21:26:38.870853 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.870996 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.871129 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.871282 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.871506 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.871588 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.871787 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.871877 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.872088 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.872170 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.872372 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.872505 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.872645 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.872727 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.872903 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80420) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.873057 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.873347 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.873640 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.873921 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.874192 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.874459 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80419) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 02 21:26:38.907303 dv-cinder-851449-4-smb devstack@keystone.service[80420]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f54369a9c0 pid: 80420 (default app) Aug 02 21:26:38.908615 dv-cinder-851449-4-smb devstack@keystone.service[80419]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f54369a9c0 pid: 80419 (default app) Aug 02 21:26:38.910560 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f43e589-0b0b-484b-8021-73b17d0ed686 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:38.910846 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f43e589-0b0b-484b-8021-73b17d0ed686 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:38.911120 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f43e589-0b0b-484b-8021-73b17d0ed686 None None] PATH_INFO: `/v3` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:38.915435 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1/1] 10.222.0.70 () {50 vars in 791 bytes} [Tue Aug 2 21:26:38 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:46.578951 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f53db65-b612-43a7-ad55-5ad8a957a2be None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:46.579474 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f53db65-b612-43a7-ad55-5ad8a957a2be None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:46.579474 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f53db65-b612-43a7-ad55-5ad8a957a2be None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:46.583836 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1/2] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:26:46 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:26:46.588991 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a8063c-fa91-4c60-82c0-177f5240f67c None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:46.589420 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a8063c-fa91-4c60-82c0-177f5240f67c None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:46.589543 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a8063c-fa91-4c60-82c0-177f5240f67c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:46.660846 dv-cinder-851449-4-smb devstack@keystone.service[80420]: INFO dbcounter [None req-d7a8063c-fa91-4c60-82c0-177f5240f67c None None] Registered counter for database keystone Aug 02 21:26:46.680350 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG oslo_db.sqlalchemy.engines [None req-d7a8063c-fa91-4c60-82c0-177f5240f67c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80420) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 21:26:46.686572 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writer thread running {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 21:26:46.871065 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG passlib.handlers.bcrypt [None req-d7a8063c-fa91-4c60-82c0-177f5240f67c None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80420) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 02 21:26:46.871420 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG passlib.handlers.bcrypt [None req-d7a8063c-fa91-4c60-82c0-177f5240f67c None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80420) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 02 21:26:46.928949 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-d7a8063c-fa91-4c60-82c0-177f5240f67c None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:26:46.930568 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-d7a8063c-fa91-4c60-82c0-177f5240f67c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:26:47.062438 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 2/3] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:26:46 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 474 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 02 21:26:47.199356 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f53db65-b612-43a7-ad55-5ad8a957a2be None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:47.268756 dv-cinder-851449-4-smb devstack@keystone.service[80419]: INFO dbcounter [None req-1f53db65-b612-43a7-ad55-5ad8a957a2be None None] Registered counter for database keystone Aug 02 21:26:47.289751 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG oslo_db.sqlalchemy.engines [None req-1f53db65-b612-43a7-ad55-5ad8a957a2be None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80419) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 02 21:26:47.296626 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writer thread running {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 02 21:26:47.415610 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f53db65-b612-43a7-ad55-5ad8a957a2be None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:47.420506 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24238ba-8d33-464a-804d-b9db398b5874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:47.421139 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24238ba-8d33-464a-804d-b9db398b5874 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:47.421429 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24238ba-8d33-464a-804d-b9db398b5874 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:47.421707 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24238ba-8d33-464a-804d-b9db398b5874 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:47.429878 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24238ba-8d33-464a-804d-b9db398b5874 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:47.481835 dv-cinder-851449-4-smb devstack@keystone.service[80419]: WARNING keystone.common.rbac_enforcer.enforcer [None req-a24238ba-8d33-464a-804d-b9db398b5874 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 02 21:26:47.482184 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24238ba-8d33-464a-804d-b9db398b5874 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:47.492506 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 2/4] 10.222.0.70 () {58 vars in 1324 bytes} [Tue Aug 2 21:26:47 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 02 21:26:47.498522 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a8063c-fa91-4c60-82c0-177f5240f67c None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:47.512743 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a8063c-fa91-4c60-82c0-177f5240f67c None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:47.517190 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2285fb19-ba0b-4f03-b116-ade652d95c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:47.518296 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2285fb19-ba0b-4f03-b116-ade652d95c85 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:47.518579 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2285fb19-ba0b-4f03-b116-ade652d95c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:47.518856 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2285fb19-ba0b-4f03-b116-ade652d95c85 admin admin] PATH_INFO: `/v3/projects/9e62ec835a2f4472a37ccfe5a26c44f7` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:47.520373 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2285fb19-ba0b-4f03-b116-ade652d95c85 admin admin] RBAC: Authorizing `identity:get_project(project_id=9e62ec835a2f4472a37ccfe5a26c44f7)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:47.570710 dv-cinder-851449-4-smb devstack@keystone.service[80420]: WARNING keystone.common.rbac_enforcer.enforcer [None req-2285fb19-ba0b-4f03-b116-ade652d95c85 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 02 21:26:47.571054 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2285fb19-ba0b-4f03-b116-ade652d95c85 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:47.575677 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 3/5] 10.222.0.70 () {56 vars in 1207 bytes} [Tue Aug 2 21:26:47 2022] GET /identity/v3/projects/9e62ec835a2f4472a37ccfe5a26c44f7 => generated 344 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:49.565860 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3ae383-272f-4b02-bbf7-6784f4dff384 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:49.566362 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3ae383-272f-4b02-bbf7-6784f4dff384 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:49.566362 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3ae383-272f-4b02-bbf7-6784f4dff384 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:49.570543 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 3/6] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:26:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:26:49.575772 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4052dd87-53e5-478b-8bfa-908078bf1c06 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:49.576192 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4052dd87-53e5-478b-8bfa-908078bf1c06 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:49.576343 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4052dd87-53e5-478b-8bfa-908078bf1c06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:49.596633 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-4052dd87-53e5-478b-8bfa-908078bf1c06 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:26:49.598149 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-4052dd87-53e5-478b-8bfa-908078bf1c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:26:49.605976 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 4/7] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:26:49 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 02 21:26:49.628220 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3ae383-272f-4b02-bbf7-6784f4dff384 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:49.640924 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3ae383-272f-4b02-bbf7-6784f4dff384 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:49.645180 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f02c4fe-7819-4ef3-a3d5-b47a6f271fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:49.645786 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f02c4fe-7819-4ef3-a3d5-b47a6f271fca admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:49.646076 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f02c4fe-7819-4ef3-a3d5-b47a6f271fca admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:49.646358 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f02c4fe-7819-4ef3-a3d5-b47a6f271fca admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:49.654140 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f02c4fe-7819-4ef3-a3d5-b47a6f271fca admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:49.655931 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f02c4fe-7819-4ef3-a3d5-b47a6f271fca admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:49.664702 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 4/8] 10.222.0.70 () {58 vars in 1324 bytes} [Tue Aug 2 21:26:49 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 02 21:26:49.669886 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4052dd87-53e5-478b-8bfa-908078bf1c06 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:49.678748 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4052dd87-53e5-478b-8bfa-908078bf1c06 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:49.683059 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1007d035-60df-4c8b-8a9e-91ab9ebc3048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:49.683682 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1007d035-60df-4c8b-8a9e-91ab9ebc3048 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:49.683963 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1007d035-60df-4c8b-8a9e-91ab9ebc3048 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:49.684258 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1007d035-60df-4c8b-8a9e-91ab9ebc3048 admin admin] PATH_INFO: `/v3/users/94e9c2ea79ff4d5fa5dea3f64a3c9a29` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:49.686148 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1007d035-60df-4c8b-8a9e-91ab9ebc3048 admin admin] RBAC: Authorizing `identity:get_user(user_id=94e9c2ea79ff4d5fa5dea3f64a3c9a29)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:49.687971 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1007d035-60df-4c8b-8a9e-91ab9ebc3048 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:49.689527 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 5/9] 10.222.0.70 () {56 vars in 1198 bytes} [Tue Aug 2 21:26:49 2022] GET /identity/v3/users/94e9c2ea79ff4d5fa5dea3f64a3c9a29 => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:51.732755 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3318c8e-66e4-43cf-8155-1e4084302a4c None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:51.733279 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3318c8e-66e4-43cf-8155-1e4084302a4c None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:51.733371 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3318c8e-66e4-43cf-8155-1e4084302a4c None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:51.734669 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 5/10] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:26:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 21:26:51.740067 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098b2aa4-6a46-4fc5-83e5-d263cca027f4 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:51.740534 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098b2aa4-6a46-4fc5-83e5-d263cca027f4 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:51.740776 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098b2aa4-6a46-4fc5-83e5-d263cca027f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:51.761260 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-098b2aa4-6a46-4fc5-83e5-d263cca027f4 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:26:51.763322 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-098b2aa4-6a46-4fc5-83e5-d263cca027f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:26:51.767608 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5900ee-944e-45e0-abce-bc1dd5b95177 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:51.767941 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5900ee-944e-45e0-abce-bc1dd5b95177 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:51.768348 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5900ee-944e-45e0-abce-bc1dd5b95177 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:51.769768 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 6/11] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:26:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 21:26:51.774913 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dd9b4a-19b2-48b6-b514-424476872d61 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:51.775203 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dd9b4a-19b2-48b6-b514-424476872d61 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:51.775489 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dd9b4a-19b2-48b6-b514-424476872d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:51.817759 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG passlib.handlers.bcrypt [None req-54dd9b4a-19b2-48b6-b514-424476872d61 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80419) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 02 21:26:51.818190 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG passlib.handlers.bcrypt [None req-54dd9b4a-19b2-48b6-b514-424476872d61 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80419) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 02 21:26:51.844242 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 6/12] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:26:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:26:51.864343 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-54dd9b4a-19b2-48b6-b514-424476872d61 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:26:51.865934 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-54dd9b4a-19b2-48b6-b514-424476872d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:26:51.867285 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098b2aa4-6a46-4fc5-83e5-d263cca027f4 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:51.891546 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:51.965420 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 7/13] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:26:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 21:26:51.973744 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098b2aa4-6a46-4fc5-83e5-d263cca027f4 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:51.987986 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dd9b4a-19b2-48b6-b514-424476872d61 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:52.007899 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7740964d-9438-4182-bc1c-d8d04c1750a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:52.008576 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7740964d-9438-4182-bc1c-d8d04c1750a5 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:52.008868 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7740964d-9438-4182-bc1c-d8d04c1750a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:52.009152 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7740964d-9438-4182-bc1c-d8d04c1750a5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:52.020487 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7740964d-9438-4182-bc1c-d8d04c1750a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:26:52.029823 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-7740964d-9438-4182-bc1c-d8d04c1750a5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 21:26:52.029823 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:26:52.029823 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:26:52.029823 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:26:52.029823 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:26:52.029823 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:26:52.029823 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:26:52.029823 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:26:52.029823 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:26:52.029823 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:26:52.029823 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:26:52.029823 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:26:52.029823 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:26:52.029823 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:26:52.029823 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:26:52.029823 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:26:52.030897 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:26:52.030897 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:26:52.030897 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:26:52.030897 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:26:52.030897 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:26:52.030897 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:26:52.030897 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:26:52.030897 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:26:52.030897 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:26:52.030897 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:26:52.030897 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:26:52.030897 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:26:52.030897 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:26:52.030897 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:26:52.030897 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:26:52.030897 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:26:52.031739 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:26:52.031739 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:26:52.031739 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:26:52.031739 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:26:52.031739 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:26:52.031739 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:26:52.031739 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:26:52.031739 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:26:52.031739 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:26:52.031739 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:26:52.031739 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 21:26:52.031739 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:26:52.031739 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 7/14] 10.222.0.70 () {56 vars in 1096 bytes} [Tue Aug 2 21:26:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 21:26:52.036774 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7740964d-9438-4182-bc1c-d8d04c1750a5 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:52.087213 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dd9b4a-19b2-48b6-b514-424476872d61 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:52.089573 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:52.117741 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:52.126440 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ab9000-ce66-48ac-80b2-8621c9a15763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:52.127319 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ab9000-ce66-48ac-80b2-8621c9a15763 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:52.127608 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ab9000-ce66-48ac-80b2-8621c9a15763 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:52.127888 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ab9000-ce66-48ac-80b2-8621c9a15763 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:52.136128 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7740964d-9438-4182-bc1c-d8d04c1750a5 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:52.170504 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae0b6d8-d62c-4558-8750-1abaf9b03749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:52.171125 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae0b6d8-d62c-4558-8750-1abaf9b03749 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:52.171415 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae0b6d8-d62c-4558-8750-1abaf9b03749 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:52.171695 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae0b6d8-d62c-4558-8750-1abaf9b03749 None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:52.172459 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae0b6d8-d62c-4558-8750-1abaf9b03749 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:26:52.172772 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae0b6d8-d62c-4558-8750-1abaf9b03749 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:52.174165 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae0b6d8-d62c-4558-8750-1abaf9b03749 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:52.185902 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 8/15] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 2 21:26:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:26:52.191368 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae0b6d8-d62c-4558-8750-1abaf9b03749 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:52.194849 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ab9000-ce66-48ac-80b2-8621c9a15763 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:52.196415 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ab9000-ce66-48ac-80b2-8621c9a15763 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:52.299014 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 8/16] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 2 21:26:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 02 21:26:52.304853 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ab9000-ce66-48ac-80b2-8621c9a15763 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:52.308081 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:52.402261 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae0b6d8-d62c-4558-8750-1abaf9b03749 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:52.409282 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ab9000-ce66-48ac-80b2-8621c9a15763 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:52.436380 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8de5d0-3136-483c-9540-7ab8528d18c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:52.437035 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8de5d0-3136-483c-9540-7ab8528d18c0 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:52.437320 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8de5d0-3136-483c-9540-7ab8528d18c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:52.437596 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8de5d0-3136-483c-9540-7ab8528d18c0 None admin] PATH_INFO: `/v3/users/94e9c2ea79ff4d5fa5dea3f64a3c9a29` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:52.438885 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8de5d0-3136-483c-9540-7ab8528d18c0 None admin] RBAC: Authorizing `identity:get_user(user_id=94e9c2ea79ff4d5fa5dea3f64a3c9a29)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:52.440366 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8de5d0-3136-483c-9540-7ab8528d18c0 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:52.441958 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 9/17] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Aug 2 21:26:52 2022] GET /identity/v3/users/94e9c2ea79ff4d5fa5dea3f64a3c9a29 => generated 247 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:26:52.443607 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7d16e3-979e-4c42-8461-dfcf2a16ecf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:52.444509 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7d16e3-979e-4c42-8461-dfcf2a16ecf7 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:52.444793 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7d16e3-979e-4c42-8461-dfcf2a16ecf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:52.445066 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7d16e3-979e-4c42-8461-dfcf2a16ecf7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:52.447304 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8de5d0-3136-483c-9540-7ab8528d18c0 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:52.462128 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:52.463802 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7d16e3-979e-4c42-8461-dfcf2a16ecf7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:52.465253 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7d16e3-979e-4c42-8461-dfcf2a16ecf7 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:52.483610 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-7f7d16e3-979e-4c42-8461-dfcf2a16ecf7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:26:52.483610 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:26:52.483610 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:26:52.483610 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:26:52.483610 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:26:52.483610 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:26:52.483610 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:26:52.483610 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:26:52.483610 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:26:52.483610 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:26:52.483610 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:26:52.483610 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:26:52.483610 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:26:52.483610 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:26:52.483610 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:26:52.484554 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:26:52.484554 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:26:52.484554 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:26:52.484554 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:26:52.484554 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:26:52.484554 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:26:52.484554 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:26:52.484554 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:26:52.484554 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:26:52.484554 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:26:52.484554 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:26:52.484554 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:26:52.484554 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:26:52.484554 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:26:52.484554 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:26:52.484554 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:26:52.484554 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:26:52.485504 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:26:52.485504 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:26:52.485504 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:26:52.485504 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:26:52.485504 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 9/18] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 2 21:26:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 21:26:52.490898 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7d16e3-979e-4c42-8461-dfcf2a16ecf7 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:52.546728 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:52.550749 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8de5d0-3136-483c-9540-7ab8528d18c0 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:52.584060 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f381205b-80a9-4997-9e13-2e15d15e4c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:52.584734 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f381205b-80a9-4997-9e13-2e15d15e4c9d None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:52.585022 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f381205b-80a9-4997-9e13-2e15d15e4c9d None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:52.585302 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f381205b-80a9-4997-9e13-2e15d15e4c9d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:52.586497 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f381205b-80a9-4997-9e13-2e15d15e4c9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:52.587966 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f381205b-80a9-4997-9e13-2e15d15e4c9d None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:52.589756 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 10/19] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 2 21:26:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:26:52.591322 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7d16e3-979e-4c42-8461-dfcf2a16ecf7 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:52.595273 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f381205b-80a9-4997-9e13-2e15d15e4c9d None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:52.627542 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281c843f-2d7d-4cf1-9d5a-c0d19e3b4e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:52.628162 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c843f-2d7d-4cf1-9d5a-c0d19e3b4e37 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:52.628473 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c843f-2d7d-4cf1-9d5a-c0d19e3b4e37 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:52.628752 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281c843f-2d7d-4cf1-9d5a-c0d19e3b4e37 None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:52.629447 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281c843f-2d7d-4cf1-9d5a-c0d19e3b4e37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:26:52.629756 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281c843f-2d7d-4cf1-9d5a-c0d19e3b4e37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:52.631137 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281c843f-2d7d-4cf1-9d5a-c0d19e3b4e37 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:52.655082 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 10/20] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 2 21:26:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:26:52.678223 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:52.699730 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f381205b-80a9-4997-9e13-2e15d15e4c9d None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:52.736174 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38b69a6-63b3-47db-840d-935be7cbc852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:52.736846 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38b69a6-63b3-47db-840d-935be7cbc852 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:52.737411 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38b69a6-63b3-47db-840d-935be7cbc852 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:52.737695 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38b69a6-63b3-47db-840d-935be7cbc852 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:52.738509 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38b69a6-63b3-47db-840d-935be7cbc852 None admin] RBAC: Adding query filter params (role.id=3e32dbf75f9b41f5adb9fe59851267bb, scope.domain.id=default, user.id=94e9c2ea79ff4d5fa5dea3f64a3c9a29) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:26:52.738824 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38b69a6-63b3-47db-840d-935be7cbc852 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:52.740325 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38b69a6-63b3-47db-840d-935be7cbc852 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:52.748485 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 11/21] 10.222.0.70 () {56 vars in 1322 bytes} [Tue Aug 2 21:26:52 2022] GET /identity/v3/role_assignments?user.id=94e9c2ea79ff4d5fa5dea3f64a3c9a29&scope.domain.id=default&role.id=3e32dbf75f9b41f5adb9fe59851267bb => generated 233 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:26:55.088296 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec78d71-ff71-47a7-975f-f53e57d50618 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:55.089162 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec78d71-ff71-47a7-975f-f53e57d50618 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:55.089583 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec78d71-ff71-47a7-975f-f53e57d50618 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:55.091639 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 11/22] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:26:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:26:55.097147 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d47d41-dcfc-4c21-8085-02e92604c0bb None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:55.097556 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d47d41-dcfc-4c21-8085-02e92604c0bb None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:55.097902 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d47d41-dcfc-4c21-8085-02e92604c0bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:55.116084 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80be958-d1e8-4dcd-8510-b27f1aee2737 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:55.116578 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80be958-d1e8-4dcd-8510-b27f1aee2737 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:55.116860 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80be958-d1e8-4dcd-8510-b27f1aee2737 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:55.118189 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 12/23] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:26:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 21:26:55.123992 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b9317-988c-47f5-9276-b0f1888dfa33 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:55.124300 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b9317-988c-47f5-9276-b0f1888dfa33 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:55.124584 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730b9317-988c-47f5-9276-b0f1888dfa33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:55.136279 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-e0d47d41-dcfc-4c21-8085-02e92604c0bb None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:26:55.137482 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-e0d47d41-dcfc-4c21-8085-02e92604c0bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:26:55.161263 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-730b9317-988c-47f5-9276-b0f1888dfa33 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:26:55.162465 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-730b9317-988c-47f5-9276-b0f1888dfa33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:26:55.224544 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 12/24] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:26:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:26:55.224544 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6402e5-f3f4-44ad-b1ab-1cd03c7cc872 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:55.224544 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6402e5-f3f4-44ad-b1ab-1cd03c7cc872 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:55.224544 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6402e5-f3f4-44ad-b1ab-1cd03c7cc872 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:55.225804 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 13/25] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:26:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:26:55.244804 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499073bc-c27d-4d3c-ac8a-8c14db301c27 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:55.245145 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499073bc-c27d-4d3c-ac8a-8c14db301c27 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:55.245371 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499073bc-c27d-4d3c-ac8a-8c14db301c27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:55.287770 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-499073bc-c27d-4d3c-ac8a-8c14db301c27 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:26:55.292463 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-499073bc-c27d-4d3c-ac8a-8c14db301c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:26:55.328344 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 13/26] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:26:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 21:26:55.329299 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730b9317-988c-47f5-9276-b0f1888dfa33 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:55.436652 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:55.437401 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 14/27] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:26:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:26:55.438134 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499073bc-c27d-4d3c-ac8a-8c14db301c27 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:55.448545 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:55.548338 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730b9317-988c-47f5-9276-b0f1888dfa33 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:55.616524 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c093f7a-5c3d-4edc-806f-ce6a13775ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:55.617195 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c093f7a-5c3d-4edc-806f-ce6a13775ff2 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:55.617480 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c093f7a-5c3d-4edc-806f-ce6a13775ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:55.617822 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c093f7a-5c3d-4edc-806f-ce6a13775ff2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:55.644654 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499073bc-c27d-4d3c-ac8a-8c14db301c27 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:55.647095 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c093f7a-5c3d-4edc-806f-ce6a13775ff2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:26:55.654396 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-1c093f7a-5c3d-4edc-806f-ce6a13775ff2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 21:26:55.654396 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:26:55.654396 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:26:55.654396 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:26:55.654396 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:26:55.654396 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:26:55.654396 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:26:55.654396 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:26:55.654396 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:26:55.654396 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:26:55.654396 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:26:55.654396 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:26:55.654396 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:26:55.654396 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:26:55.654396 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:26:55.654396 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:26:55.655246 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:26:55.655246 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:26:55.655246 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:26:55.655246 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:26:55.655246 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:26:55.655246 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:26:55.655246 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:26:55.655246 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:26:55.655246 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:26:55.655246 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:26:55.655246 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:26:55.655246 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:26:55.655246 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:26:55.655246 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:26:55.655246 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:26:55.655246 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:26:55.655990 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:26:55.655990 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:26:55.655990 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:26:55.655990 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:26:55.655990 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:26:55.655990 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:26:55.655990 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:26:55.655990 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:26:55.655990 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:26:55.655990 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:26:55.655990 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 21:26:55.655990 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:26:55.665859 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 14/28] 10.222.0.70 () {56 vars in 1096 bytes} [Tue Aug 2 21:26:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:26:55.666763 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c093f7a-5c3d-4edc-806f-ce6a13775ff2 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:55.710398 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85033cea-a7d1-4bcd-baab-9f78aebf2ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:55.711193 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85033cea-a7d1-4bcd-baab-9f78aebf2ec5 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:55.711482 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85033cea-a7d1-4bcd-baab-9f78aebf2ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:55.711759 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85033cea-a7d1-4bcd-baab-9f78aebf2ec5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:55.726743 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85033cea-a7d1-4bcd-baab-9f78aebf2ec5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:55.728247 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85033cea-a7d1-4bcd-baab-9f78aebf2ec5 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:55.751425 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-85033cea-a7d1-4bcd-baab-9f78aebf2ec5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:26:55.751425 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:26:55.751425 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:26:55.751425 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:26:55.751425 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:26:55.751425 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:26:55.751425 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:26:55.751425 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:26:55.751425 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:26:55.751425 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:26:55.751425 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:26:55.751425 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:26:55.751425 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:26:55.751425 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:26:55.751425 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:26:55.752900 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:26:55.752900 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:26:55.752900 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:26:55.752900 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:26:55.752900 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:26:55.752900 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:26:55.752900 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:26:55.752900 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:26:55.752900 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:26:55.752900 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:26:55.752900 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:26:55.752900 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:26:55.752900 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:26:55.752900 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:26:55.752900 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:26:55.752900 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:26:55.752900 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:26:55.753726 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:26:55.753726 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:26:55.753726 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:26:55.753726 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:26:55.753726 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 15/29] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 2 21:26:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:26:55.753726 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85033cea-a7d1-4bcd-baab-9f78aebf2ec5 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:55.796963 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c093f7a-5c3d-4edc-806f-ce6a13775ff2 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:55.830613 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:55.882572 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85033cea-a7d1-4bcd-baab-9f78aebf2ec5 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:55.913872 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:55.925623 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94b3247-c9a8-4679-9988-e384c1ee4b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:55.926572 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94b3247-c9a8-4679-9988-e384c1ee4b3c None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:55.927101 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94b3247-c9a8-4679-9988-e384c1ee4b3c None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:55.927675 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94b3247-c9a8-4679-9988-e384c1ee4b3c None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:55.928655 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94b3247-c9a8-4679-9988-e384c1ee4b3c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:26:55.929177 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94b3247-c9a8-4679-9988-e384c1ee4b3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:55.930826 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94b3247-c9a8-4679-9988-e384c1ee4b3c None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:55.941158 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 16/30] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 2 21:26:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:55.942831 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d19128-d501-418f-ac11-202cc54b4a46 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:55.943342 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d19128-d501-418f-ac11-202cc54b4a46 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:55.943812 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d19128-d501-418f-ac11-202cc54b4a46 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:55.945517 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 17/31] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:26:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:26:55.946412 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d19128-d501-418f-ac11-202cc54b4a46 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:55.952867 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e97c490-e682-4133-85dc-58b9e7cef201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:55.953511 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e97c490-e682-4133-85dc-58b9e7cef201 None admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:55.953797 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e97c490-e682-4133-85dc-58b9e7cef201 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:55.954077 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e97c490-e682-4133-85dc-58b9e7cef201 None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:55.954793 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e97c490-e682-4133-85dc-58b9e7cef201 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:55.956203 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e97c490-e682-4133-85dc-58b9e7cef201 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:56.062860 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d19128-d501-418f-ac11-202cc54b4a46 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:56.082072 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:56.101668 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17da38e3-d3eb-4bf2-9533-a550090be74d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:56.103137 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da38e3-d3eb-4bf2-9533-a550090be74d None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:56.103637 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da38e3-d3eb-4bf2-9533-a550090be74d None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:56.104123 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da38e3-d3eb-4bf2-9533-a550090be74d None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:56.105097 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17da38e3-d3eb-4bf2-9533-a550090be74d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:26:56.105637 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17da38e3-d3eb-4bf2-9533-a550090be74d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:56.107246 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17da38e3-d3eb-4bf2-9533-a550090be74d None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:56.115053 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 15/32] 10.222.0.70 () {60 vars in 1131 bytes} [Tue Aug 2 21:26:55 2022] POST /identity/v3/roles => generated 219 bytes in 449 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:26:56.123582 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e97c490-e682-4133-85dc-58b9e7cef201 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:56.143325 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 18/33] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 2 21:26:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:56.146809 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568d8d75-6e1c-4223-a01b-6588dbd6f771 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:56.147405 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568d8d75-6e1c-4223-a01b-6588dbd6f771 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:56.148381 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568d8d75-6e1c-4223-a01b-6588dbd6f771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:56.181328 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-568d8d75-6e1c-4223-a01b-6588dbd6f771 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:26:56.183137 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-568d8d75-6e1c-4223-a01b-6588dbd6f771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:26:56.302044 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e97c490-e682-4133-85dc-58b9e7cef201 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:56.304899 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 19/34] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:26:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:26:56.306631 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568d8d75-6e1c-4223-a01b-6588dbd6f771 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:56.342734 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9989d7b2-1110-44c9-ad2e-74b3a3dc7762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:56.343711 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9989d7b2-1110-44c9-ad2e-74b3a3dc7762 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:56.344399 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9989d7b2-1110-44c9-ad2e-74b3a3dc7762 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:56.344832 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9989d7b2-1110-44c9-ad2e-74b3a3dc7762 None admin] PATH_INFO: `/v3/users/94e9c2ea79ff4d5fa5dea3f64a3c9a29` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:56.346639 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9989d7b2-1110-44c9-ad2e-74b3a3dc7762 None admin] RBAC: Authorizing `identity:get_user(user_id=94e9c2ea79ff4d5fa5dea3f64a3c9a29)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:56.348223 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9989d7b2-1110-44c9-ad2e-74b3a3dc7762 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:56.350055 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 16/35] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Aug 2 21:26:56 2022] GET /identity/v3/users/94e9c2ea79ff4d5fa5dea3f64a3c9a29 => generated 247 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:56.351162 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f64f5ac-45fb-407f-9dcf-b2fbed971934 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:56.351455 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f64f5ac-45fb-407f-9dcf-b2fbed971934 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:56.351735 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f64f5ac-45fb-407f-9dcf-b2fbed971934 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:56.353138 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 17/36] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:26:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:26:56.353662 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f64f5ac-45fb-407f-9dcf-b2fbed971934 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:56.398971 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:56.444283 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568d8d75-6e1c-4223-a01b-6588dbd6f771 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:56.455243 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:56.476554 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f64f5ac-45fb-407f-9dcf-b2fbed971934 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:56.481439 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cd243a-1362-4519-8523-9145f6941781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:56.482070 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cd243a-1362-4519-8523-9145f6941781 None admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:56.482356 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cd243a-1362-4519-8523-9145f6941781 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:56.482635 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cd243a-1362-4519-8523-9145f6941781 None admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:56.483325 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cd243a-1362-4519-8523-9145f6941781 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:56.484829 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cd243a-1362-4519-8523-9145f6941781 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:56.514044 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825989ad-4bb9-477c-9ec0-fee2ac4ab976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:56.514684 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825989ad-4bb9-477c-9ec0-fee2ac4ab976 None admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:56.515374 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825989ad-4bb9-477c-9ec0-fee2ac4ab976 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:56.515679 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825989ad-4bb9-477c-9ec0-fee2ac4ab976 None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:56.516489 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825989ad-4bb9-477c-9ec0-fee2ac4ab976 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:56.517891 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825989ad-4bb9-477c-9ec0-fee2ac4ab976 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:56.532676 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 18/37] 10.222.0.70 () {60 vars in 1131 bytes} [Tue Aug 2 21:26:56 2022] POST /identity/v3/roles => generated 225 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:26:56.533330 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825989ad-4bb9-477c-9ec0-fee2ac4ab976 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:56.628356 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 20/38] 10.222.0.70 () {60 vars in 1141 bytes} [Tue Aug 2 21:26:56 2022] POST /identity/v3/projects => generated 301 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:26:56.628356 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646bf9af-4c22-44ee-bc91-c39811d91cee None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:56.628356 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646bf9af-4c22-44ee-bc91-c39811d91cee None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:56.628356 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646bf9af-4c22-44ee-bc91-c39811d91cee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:56.654317 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-646bf9af-4c22-44ee-bc91-c39811d91cee None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:26:56.655968 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-646bf9af-4c22-44ee-bc91-c39811d91cee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:26:56.677846 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:56.689214 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825989ad-4bb9-477c-9ec0-fee2ac4ab976 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:56.742095 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256cb03b-ca5c-4c15-8c0c-2a879b7ad52a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:56.743898 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256cb03b-ca5c-4c15-8c0c-2a879b7ad52a None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:56.744520 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256cb03b-ca5c-4c15-8c0c-2a879b7ad52a None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:56.744520 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256cb03b-ca5c-4c15-8c0c-2a879b7ad52a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:56.746646 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 21/39] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:26:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:26:56.748521 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e76750f-5d1d-48ae-904b-50b3725b67a3 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:56.748826 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e76750f-5d1d-48ae-904b-50b3725b67a3 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:56.749109 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e76750f-5d1d-48ae-904b-50b3725b67a3 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:56.749226 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256cb03b-ca5c-4c15-8c0c-2a879b7ad52a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:56.750636 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 22/40] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:26:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:26:56.750747 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256cb03b-ca5c-4c15-8c0c-2a879b7ad52a None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:56.752474 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 19/41] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 2 21:26:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:56.756340 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d02c223-c12c-4b81-849c-0fa9cd07479d None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:56.756646 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d02c223-c12c-4b81-849c-0fa9cd07479d None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:56.756932 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d02c223-c12c-4b81-849c-0fa9cd07479d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:56.760290 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256cb03b-ca5c-4c15-8c0c-2a879b7ad52a None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:56.778927 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-8d02c223-c12c-4b81-849c-0fa9cd07479d None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:26:56.780161 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-8d02c223-c12c-4b81-849c-0fa9cd07479d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:26:56.865022 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 23/42] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:26:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 21:26:56.865936 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d02c223-c12c-4b81-849c-0fa9cd07479d None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:56.887880 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:56.889341 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256cb03b-ca5c-4c15-8c0c-2a879b7ad52a None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:56.924701 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f24493-f4a1-4a94-9601-521106a77e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:56.925372 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f24493-f4a1-4a94-9601-521106a77e59 None admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:56.925665 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f24493-f4a1-4a94-9601-521106a77e59 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:56.925949 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f24493-f4a1-4a94-9601-521106a77e59 None admin] PATH_INFO: `/v3/domains/default/users/94e9c2ea79ff4d5fa5dea3f64a3c9a29/roles/3e32dbf75f9b41f5adb9fe59851267bb` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:56.927929 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f24493-f4a1-4a94-9601-521106a77e59 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=94e9c2ea79ff4d5fa5dea3f64a3c9a29, role_id=3e32dbf75f9b41f5adb9fe59851267bb)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:56.929436 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f24493-f4a1-4a94-9601-521106a77e59 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:56.943325 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 20/43] 10.222.0.70 () {58 vars in 1361 bytes} [Tue Aug 2 21:26:56 2022] PUT /identity/v3/domains/default/users/94e9c2ea79ff4d5fa5dea3f64a3c9a29/roles/3e32dbf75f9b41f5adb9fe59851267bb => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:26:56.943968 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f24493-f4a1-4a94-9601-521106a77e59 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:56.973153 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:56.986045 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d02c223-c12c-4b81-849c-0fa9cd07479d None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:57.030322 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ab04e6-d133-4ad7-a778-6e0fb507b284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:57.030972 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab04e6-d133-4ad7-a778-6e0fb507b284 None admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:57.031261 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab04e6-d133-4ad7-a778-6e0fb507b284 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:57.031541 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab04e6-d133-4ad7-a778-6e0fb507b284 None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:57.032292 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ab04e6-d133-4ad7-a778-6e0fb507b284 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:57.034222 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ab04e6-d133-4ad7-a778-6e0fb507b284 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:57.051296 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 24/44] 10.222.0.70 () {60 vars in 1131 bytes} [Tue Aug 2 21:26:56 2022] POST /identity/v3/roles => generated 223 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:26:57.068074 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f24493-f4a1-4a94-9601-521106a77e59 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:57.110763 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5743fc91-c32e-4378-87bd-4c9bb7849a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:57.111456 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5743fc91-c32e-4378-87bd-4c9bb7849a2d None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:57.111751 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5743fc91-c32e-4378-87bd-4c9bb7849a2d None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:57.112035 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5743fc91-c32e-4378-87bd-4c9bb7849a2d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:57.113668 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5743fc91-c32e-4378-87bd-4c9bb7849a2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:57.115175 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5743fc91-c32e-4378-87bd-4c9bb7849a2d None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:57.117210 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 21/45] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 2 21:26:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:57.123134 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ab04e6-d133-4ad7-a778-6e0fb507b284 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:57.215200 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:57.239442 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ab04e6-d133-4ad7-a778-6e0fb507b284 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:57.275007 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112e3161-0dfb-4083-902f-ef501f56b72c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:57.275641 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112e3161-0dfb-4083-902f-ef501f56b72c None admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:57.275932 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112e3161-0dfb-4083-902f-ef501f56b72c None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:57.276214 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112e3161-0dfb-4083-902f-ef501f56b72c None admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:57.276955 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112e3161-0dfb-4083-902f-ef501f56b72c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:57.278935 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112e3161-0dfb-4083-902f-ef501f56b72c None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:57.308215 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 25/46] 10.222.0.70 () {60 vars in 1141 bytes} [Tue Aug 2 21:26:57 2022] POST /identity/v3/projects => generated 312 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:26:58.964503 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc4f57a-243d-4a4d-88ac-febd34dc5076 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:58.965017 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc4f57a-243d-4a4d-88ac-febd34dc5076 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:58.965100 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc4f57a-243d-4a4d-88ac-febd34dc5076 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:58.967049 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 22/47] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:26:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:26:58.972156 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586c1d13-c942-4e0e-9175-14ee529d73c1 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:58.972588 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586c1d13-c942-4e0e-9175-14ee529d73c1 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:58.972763 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586c1d13-c942-4e0e-9175-14ee529d73c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:58.991366 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-586c1d13-c942-4e0e-9175-14ee529d73c1 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:26:58.992589 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-586c1d13-c942-4e0e-9175-14ee529d73c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:26:59.058635 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 26/48] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:26:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:26:59.082014 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc4f57a-243d-4a4d-88ac-febd34dc5076 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:59.171731 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:59.182350 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc4f57a-243d-4a4d-88ac-febd34dc5076 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:59.215901 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d02d3e-2857-4d03-92ea-82216e08014a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:59.216530 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d02d3e-2857-4d03-92ea-82216e08014a None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:59.216819 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d02d3e-2857-4d03-92ea-82216e08014a None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:59.217097 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d02d3e-2857-4d03-92ea-82216e08014a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:59.227541 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d02d3e-2857-4d03-92ea-82216e08014a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:26:59.232559 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-22d02d3e-2857-4d03-92ea-82216e08014a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 21:26:59.232559 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:26:59.232559 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:26:59.232559 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:26:59.232559 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:26:59.232559 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:26:59.232559 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:26:59.232559 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:26:59.232559 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:26:59.232559 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:26:59.232559 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:26:59.232559 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:26:59.232559 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:26:59.232559 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:26:59.232559 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:26:59.232559 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:26:59.233379 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:26:59.233379 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:26:59.233379 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:26:59.233379 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:26:59.233379 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:26:59.233379 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:26:59.233379 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:26:59.233379 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:26:59.233379 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:26:59.233379 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:26:59.233379 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:26:59.233379 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:26:59.233379 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:26:59.233379 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:26:59.233379 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:26:59.233379 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:26:59.234234 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:26:59.234234 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:26:59.234234 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:26:59.234234 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:26:59.234234 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:26:59.234234 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:26:59.234234 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:26:59.234234 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:26:59.234234 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:26:59.234234 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:26:59.234234 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 21:26:59.234234 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:26:59.234234 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 23/49] 10.222.0.70 () {56 vars in 1096 bytes} [Tue Aug 2 21:26:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:26:59.239846 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586c1d13-c942-4e0e-9175-14ee529d73c1 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:59.304889 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:59.308118 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e672ae13-ad9e-4719-adf6-75a1279169e4 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:59.308442 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e672ae13-ad9e-4719-adf6-75a1279169e4 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:59.308734 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e672ae13-ad9e-4719-adf6-75a1279169e4 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:59.310771 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 24/50] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:26:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:26:59.315630 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b008f-49fc-43ae-92a6-1b1e9a177b3e None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:59.315925 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b008f-49fc-43ae-92a6-1b1e9a177b3e None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:59.316211 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b008f-49fc-43ae-92a6-1b1e9a177b3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:59.334713 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-b15b008f-49fc-43ae-92a6-1b1e9a177b3e None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:26:59.336246 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-b15b008f-49fc-43ae-92a6-1b1e9a177b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:26:59.346068 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586c1d13-c942-4e0e-9175-14ee529d73c1 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:59.379308 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11718d3a-46eb-4262-ac4b-c8015371d9e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:59.379937 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11718d3a-46eb-4262-ac4b-c8015371d9e8 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:59.380540 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11718d3a-46eb-4262-ac4b-c8015371d9e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:59.380821 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11718d3a-46eb-4262-ac4b-c8015371d9e8 None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:59.381545 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11718d3a-46eb-4262-ac4b-c8015371d9e8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:26:59.381853 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11718d3a-46eb-4262-ac4b-c8015371d9e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:59.383245 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11718d3a-46eb-4262-ac4b-c8015371d9e8 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:59.391880 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 27/51] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 2 21:26:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:26:59.397521 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11718d3a-46eb-4262-ac4b-c8015371d9e8 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:59.403131 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 25/52] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:26:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 21:26:59.424882 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15b008f-49fc-43ae-92a6-1b1e9a177b3e None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:59.493827 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11718d3a-46eb-4262-ac4b-c8015371d9e8 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:59.503255 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:59.517655 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:59.522750 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15b008f-49fc-43ae-92a6-1b1e9a177b3e None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:59.528741 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ea8870-5abc-44a5-b05e-ea915b875369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:59.529384 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ea8870-5abc-44a5-b05e-ea915b875369 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:59.529673 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ea8870-5abc-44a5-b05e-ea915b875369 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:59.529953 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ea8870-5abc-44a5-b05e-ea915b875369 None admin] PATH_INFO: `/v3/users/94e9c2ea79ff4d5fa5dea3f64a3c9a29` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:59.531130 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ea8870-5abc-44a5-b05e-ea915b875369 None admin] RBAC: Authorizing `identity:get_user(user_id=94e9c2ea79ff4d5fa5dea3f64a3c9a29)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:59.532638 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ea8870-5abc-44a5-b05e-ea915b875369 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:59.534250 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 28/53] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Aug 2 21:26:59 2022] GET /identity/v3/users/94e9c2ea79ff4d5fa5dea3f64a3c9a29 => generated 247 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:26:59.539680 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ea8870-5abc-44a5-b05e-ea915b875369 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:59.556993 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b5ed68-bf2a-4968-b206-b1da3260b33d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:59.557790 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b5ed68-bf2a-4968-b206-b1da3260b33d None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:59.558080 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b5ed68-bf2a-4968-b206-b1da3260b33d None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:59.558358 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b5ed68-bf2a-4968-b206-b1da3260b33d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:59.560022 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b5ed68-bf2a-4968-b206-b1da3260b33d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:59.561499 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b5ed68-bf2a-4968-b206-b1da3260b33d None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:59.563056 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 26/54] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 2 21:26:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:26:59.568559 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b5ed68-bf2a-4968-b206-b1da3260b33d None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:59.640172 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ea8870-5abc-44a5-b05e-ea915b875369 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:59.669566 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b5ed68-bf2a-4968-b206-b1da3260b33d None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:59.673728 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38553ba5-ffb9-4104-910e-e3296a25414b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:59.674371 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38553ba5-ffb9-4104-910e-e3296a25414b None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:59.674658 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38553ba5-ffb9-4104-910e-e3296a25414b None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:59.674938 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38553ba5-ffb9-4104-910e-e3296a25414b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:59.676085 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38553ba5-ffb9-4104-910e-e3296a25414b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:59.677581 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38553ba5-ffb9-4104-910e-e3296a25414b None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:59.679166 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 29/55] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 2 21:26:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:26:59.684827 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38553ba5-ffb9-4104-910e-e3296a25414b None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:26:59.704346 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f3b832-5a57-405c-b488-d6a9dbce31fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:59.704976 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f3b832-5a57-405c-b488-d6a9dbce31fa None admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:59.705263 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f3b832-5a57-405c-b488-d6a9dbce31fa None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:59.705545 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f3b832-5a57-405c-b488-d6a9dbce31fa None admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:59.706222 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f3b832-5a57-405c-b488-d6a9dbce31fa None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:59.707673 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f3b832-5a57-405c-b488-d6a9dbce31fa None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:59.730159 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:59.744362 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 27/56] 10.222.0.70 () {60 vars in 1140 bytes} [Tue Aug 2 21:26:59 2022] POST /identity/v3/projects => generated 298 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 21:26:59.752421 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:26:59.798224 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38553ba5-ffb9-4104-910e-e3296a25414b None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:26:59.833841 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed41fef3-66f7-403b-8b33-63c58c978c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:26:59.834481 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed41fef3-66f7-403b-8b33-63c58c978c52 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:26:59.834780 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed41fef3-66f7-403b-8b33-63c58c978c52 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:26:59.835065 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed41fef3-66f7-403b-8b33-63c58c978c52 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:26:59.835874 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed41fef3-66f7-403b-8b33-63c58c978c52 None admin] RBAC: Adding query filter params (role.id=3e32dbf75f9b41f5adb9fe59851267bb, scope.domain.id=default, user.id=94e9c2ea79ff4d5fa5dea3f64a3c9a29) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:26:59.836193 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed41fef3-66f7-403b-8b33-63c58c978c52 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:26:59.837709 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed41fef3-66f7-403b-8b33-63c58c978c52 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:26:59.844852 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 30/57] 10.222.0.70 () {56 vars in 1322 bytes} [Tue Aug 2 21:26:59 2022] GET /identity/v3/role_assignments?user.id=94e9c2ea79ff4d5fa5dea3f64a3c9a29&scope.domain.id=default&role.id=3e32dbf75f9b41f5adb9fe59851267bb => generated 530 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:27:01.750712 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f442500d-1695-4d89-9504-73c9ccb00801 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:01.751211 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f442500d-1695-4d89-9504-73c9ccb00801 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:01.751293 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f442500d-1695-4d89-9504-73c9ccb00801 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:01.752669 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 28/58] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:27:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:27:01.757767 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a05a75b-da11-4777-8f93-79bd86dde663 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:01.758163 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a05a75b-da11-4777-8f93-79bd86dde663 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:01.758369 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a05a75b-da11-4777-8f93-79bd86dde663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:01.776103 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-6a05a75b-da11-4777-8f93-79bd86dde663 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:01.777342 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-6a05a75b-da11-4777-8f93-79bd86dde663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:01.842979 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 31/59] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:27:01.867277 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f442500d-1695-4d89-9504-73c9ccb00801 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:01.967472 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f442500d-1695-4d89-9504-73c9ccb00801 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:01.999410 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00ceebc-b5a6-4d15-aee2-c6caff7983a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:02.000040 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00ceebc-b5a6-4d15-aee2-c6caff7983a0 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:02.000355 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00ceebc-b5a6-4d15-aee2-c6caff7983a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:02.000639 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00ceebc-b5a6-4d15-aee2-c6caff7983a0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:02.001847 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00ceebc-b5a6-4d15-aee2-c6caff7983a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:02.003250 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00ceebc-b5a6-4d15-aee2-c6caff7983a0 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:02.004842 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 29/60] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 2 21:27:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:02.010213 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a05a75b-da11-4777-8f93-79bd86dde663 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:02.063550 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:02.107464 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a05a75b-da11-4777-8f93-79bd86dde663 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:02.141893 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e9dcdf-0764-4d2b-bf9d-035b2586bee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:02.142529 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e9dcdf-0764-4d2b-bf9d-035b2586bee6 None admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:02.142817 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e9dcdf-0764-4d2b-bf9d-035b2586bee6 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:02.143098 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e9dcdf-0764-4d2b-bf9d-035b2586bee6 None admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:02.143805 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e9dcdf-0764-4d2b-bf9d-035b2586bee6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:02.145309 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e9dcdf-0764-4d2b-bf9d-035b2586bee6 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:02.171748 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 32/61] 10.222.0.70 () {60 vars in 1132 bytes} [Tue Aug 2 21:27:02 2022] POST /identity/v3/users => generated 275 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:27:05.279674 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91045b0-66c9-458e-8e9f-3a8f414af15a None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:05.280201 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91045b0-66c9-458e-8e9f-3a8f414af15a None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:05.280318 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91045b0-66c9-458e-8e9f-3a8f414af15a None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:05.281635 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 30/62] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:27:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:27:05.292075 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a29dd6-a40b-45b0-9c1b-9674026525b9 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:05.292470 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a29dd6-a40b-45b0-9c1b-9674026525b9 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:05.292687 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a29dd6-a40b-45b0-9c1b-9674026525b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:05.321249 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-47a29dd6-a40b-45b0-9c1b-9674026525b9 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:05.322626 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-47a29dd6-a40b-45b0-9c1b-9674026525b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:05.323559 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c70933f-05d0-438d-9cf1-de86d3576182 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:05.323854 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c70933f-05d0-438d-9cf1-de86d3576182 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:05.324136 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c70933f-05d0-438d-9cf1-de86d3576182 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:05.326312 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 31/63] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:27:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:27:05.337859 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731c7115-df9a-4426-8aab-211cf5e9d011 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:05.338151 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731c7115-df9a-4426-8aab-211cf5e9d011 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:05.338440 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731c7115-df9a-4426-8aab-211cf5e9d011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:05.356927 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-731c7115-df9a-4426-8aab-211cf5e9d011 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:05.358155 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-731c7115-df9a-4426-8aab-211cf5e9d011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:05.424838 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 33/64] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:27:05.445189 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a29dd6-a40b-45b0-9c1b-9674026525b9 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:05.467149 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:05.479725 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 32/65] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 21:27:05.503372 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731c7115-df9a-4426-8aab-211cf5e9d011 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:05.520304 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:05.639649 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a29dd6-a40b-45b0-9c1b-9674026525b9 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:05.653273 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731c7115-df9a-4426-8aab-211cf5e9d011 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:05.683705 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd67e67-21e2-48f5-a14c-7e713b449973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:05.685003 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd67e67-21e2-48f5-a14c-7e713b449973 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:05.685516 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd67e67-21e2-48f5-a14c-7e713b449973 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:05.686117 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd67e67-21e2-48f5-a14c-7e713b449973 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:05.691793 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8218b9c4-7243-4a93-bf2e-3fde17ec104b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:05.692485 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8218b9c4-7243-4a93-bf2e-3fde17ec104b None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:05.692782 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8218b9c4-7243-4a93-bf2e-3fde17ec104b None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:05.693068 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8218b9c4-7243-4a93-bf2e-3fde17ec104b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:05.699300 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd67e67-21e2-48f5-a14c-7e713b449973 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:27:05.704897 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8218b9c4-7243-4a93-bf2e-3fde17ec104b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:27:05.706132 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-6dd67e67-21e2-48f5-a14c-7e713b449973 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 21:27:05.706132 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:05.706132 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:05.706132 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:05.706132 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:05.706132 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:05.706132 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:05.706132 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:05.706132 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:05.706132 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:05.706132 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:05.706132 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:05.706132 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:27:05.706132 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:27:05.706132 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:27:05.706132 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:27:05.706978 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:27:05.706978 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:27:05.706978 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:27:05.706978 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:27:05.706978 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:05.706978 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:05.706978 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:05.706978 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:05.706978 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:05.706978 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:05.706978 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:05.706978 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:05.706978 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:05.706978 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:05.706978 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:05.706978 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:05.707819 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:05.707819 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:05.707819 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:05.707819 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:05.707819 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:27:05.707819 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:27:05.707819 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:27:05.707819 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:27:05.707819 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:27:05.707819 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:27:05.707819 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 21:27:05.707819 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:27:05.710068 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-8218b9c4-7243-4a93-bf2e-3fde17ec104b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 21:27:05.710068 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:05.710068 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:05.710068 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:05.710068 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:05.710068 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:05.710068 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:05.710068 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:05.710068 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:05.710068 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:05.710068 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:05.710068 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:05.710068 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:27:05.710068 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:27:05.710068 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:27:05.710068 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:27:05.710889 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:27:05.710889 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:27:05.710889 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:27:05.710889 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:27:05.710889 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:05.710889 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:05.710889 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:05.710889 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:05.710889 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:05.710889 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:05.710889 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:05.710889 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:05.710889 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:05.710889 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:05.710889 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:05.710889 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:05.711616 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:05.711616 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:05.711616 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:05.711616 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:05.711616 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:27:05.711616 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:27:05.711616 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:27:05.711616 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:27:05.711616 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:27:05.711616 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:27:05.711616 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 21:27:05.711616 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:27:05.711616 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 33/66] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 2 21:27:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 21:27:05.713029 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 34/67] 10.222.0.70 () {56 vars in 1096 bytes} [Tue Aug 2 21:27:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 21:27:05.713209 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d0d522-0cd3-49cd-84b8-46eb28c4cebb None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:05.716564 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d0d522-0cd3-49cd-84b8-46eb28c4cebb None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:05.716564 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d0d522-0cd3-49cd-84b8-46eb28c4cebb None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:05.716564 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 34/68] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:27:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:27:05.718706 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd67e67-21e2-48f5-a14c-7e713b449973 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:05.721318 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d0d522-0cd3-49cd-84b8-46eb28c4cebb None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:05.787955 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:05.837351 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d0d522-0cd3-49cd-84b8-46eb28c4cebb None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:05.841430 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:05.847727 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd67e67-21e2-48f5-a14c-7e713b449973 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:05.876403 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5686ce45-ca03-4905-9004-a659d7aedb91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:05.877039 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5686ce45-ca03-4905-9004-a659d7aedb91 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:05.877333 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5686ce45-ca03-4905-9004-a659d7aedb91 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:05.877624 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5686ce45-ca03-4905-9004-a659d7aedb91 None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:05.878344 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5686ce45-ca03-4905-9004-a659d7aedb91 None admin] RBAC: Adding query filter params (name=member) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:05.878658 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5686ce45-ca03-4905-9004-a659d7aedb91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:05.880122 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5686ce45-ca03-4905-9004-a659d7aedb91 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:05.884723 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ed3cfa-1f1f-420a-89b3-695ac64c6564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:05.885568 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ed3cfa-1f1f-420a-89b3-695ac64c6564 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:05.885860 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ed3cfa-1f1f-420a-89b3-695ac64c6564 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:05.886140 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ed3cfa-1f1f-420a-89b3-695ac64c6564 None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:05.886869 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ed3cfa-1f1f-420a-89b3-695ac64c6564 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:05.887743 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ed3cfa-1f1f-420a-89b3-695ac64c6564 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:05.889139 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ed3cfa-1f1f-420a-89b3-695ac64c6564 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:05.894809 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 35/69] 10.222.0.70 () {56 vars in 1101 bytes} [Tue Aug 2 21:27:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:27:05.895986 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5855856-6bfa-4594-864d-77f2797f9550 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:05.896303 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5855856-6bfa-4594-864d-77f2797f9550 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:05.896592 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5855856-6bfa-4594-864d-77f2797f9550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:05.898536 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 35/70] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 2 21:27:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:05.901566 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a204cf4-48cb-4173-a08e-5afdc98b6762 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:05.901865 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a204cf4-48cb-4173-a08e-5afdc98b6762 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:05.902146 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a204cf4-48cb-4173-a08e-5afdc98b6762 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:05.904250 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 36/71] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:27:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:27:05.905268 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eb96f0-ad5b-4239-9f07-f77bf1bb092e None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:05.905556 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eb96f0-ad5b-4239-9f07-f77bf1bb092e None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:05.905838 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eb96f0-ad5b-4239-9f07-f77bf1bb092e None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:05.907049 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 37/72] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:27:05 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:27:05.907748 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eb96f0-ad5b-4239-9f07-f77bf1bb092e None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:05.916892 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-d5855856-6bfa-4594-864d-77f2797f9550 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:05.918110 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-d5855856-6bfa-4594-864d-77f2797f9550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:05.986115 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 36/73] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:27:05.988396 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5855856-6bfa-4594-864d-77f2797f9550 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:06.011075 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eb96f0-ad5b-4239-9f07-f77bf1bb092e None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:06.037529 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:06.045330 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4a15c4-7ba6-46ae-83ca-f3c6058c542d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:06.045975 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4a15c4-7ba6-46ae-83ca-f3c6058c542d None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:06.046264 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4a15c4-7ba6-46ae-83ca-f3c6058c542d None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:06.046551 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4a15c4-7ba6-46ae-83ca-f3c6058c542d None admin] PATH_INFO: `/v3/users/19d387c06a3e450fbcd87cab2ec693c1` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:06.060678 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4a15c4-7ba6-46ae-83ca-f3c6058c542d None admin] RBAC: Authorizing `identity:get_user(user_id=19d387c06a3e450fbcd87cab2ec693c1)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:06.062162 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4a15c4-7ba6-46ae-83ca-f3c6058c542d None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:06.063827 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 38/74] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Aug 2 21:27:05 2022] GET /identity/v3/users/19d387c06a3e450fbcd87cab2ec693c1 => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:06.068577 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a52b600-d490-482a-b521-b936f3d1b308 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:06.068577 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a52b600-d490-482a-b521-b936f3d1b308 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:06.068577 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a52b600-d490-482a-b521-b936f3d1b308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:06.082838 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-4a52b600-d490-482a-b521-b936f3d1b308 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:06.084042 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-4a52b600-d490-482a-b521-b936f3d1b308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:06.092204 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5855856-6bfa-4594-864d-77f2797f9550 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:06.098205 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:06.126420 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0355e4c6-f513-4118-ba64-c997b9abcf16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:06.127072 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0355e4c6-f513-4118-ba64-c997b9abcf16 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:06.127358 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0355e4c6-f513-4118-ba64-c997b9abcf16 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:06.127636 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0355e4c6-f513-4118-ba64-c997b9abcf16 None admin] PATH_INFO: `/v3/users/94e9c2ea79ff4d5fa5dea3f64a3c9a29` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:06.128838 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0355e4c6-f513-4118-ba64-c997b9abcf16 None admin] RBAC: Authorizing `identity:get_user(user_id=94e9c2ea79ff4d5fa5dea3f64a3c9a29)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:06.130288 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0355e4c6-f513-4118-ba64-c997b9abcf16 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:06.131887 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 37/75] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Aug 2 21:27:05 2022] GET /identity/v3/users/94e9c2ea79ff4d5fa5dea3f64a3c9a29 => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:06.133009 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b6c170-7139-46ce-b4d3-e3cc10aa81f4 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:06.133298 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b6c170-7139-46ce-b4d3-e3cc10aa81f4 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:06.133578 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b6c170-7139-46ce-b4d3-e3cc10aa81f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:06.151549 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-46b6c170-7139-46ce-b4d3-e3cc10aa81f4 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:06.152724 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-46b6c170-7139-46ce-b4d3-e3cc10aa81f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:06.153515 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 39/76] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:27:06.154222 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a52b600-d490-482a-b521-b936f3d1b308 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:06.219266 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 38/77] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:27:06.221140 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b6c170-7139-46ce-b4d3-e3cc10aa81f4 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:06.267478 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a52b600-d490-482a-b521-b936f3d1b308 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:06.270715 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:06.305521 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e937d40-41bd-4e7b-93c1-7186c27fa1a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:06.306167 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e937d40-41bd-4e7b-93c1-7186c27fa1a4 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:06.306461 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e937d40-41bd-4e7b-93c1-7186c27fa1a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:06.306731 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e937d40-41bd-4e7b-93c1-7186c27fa1a4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:06.317994 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e937d40-41bd-4e7b-93c1-7186c27fa1a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:27:06.322952 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-3e937d40-41bd-4e7b-93c1-7186c27fa1a4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 21:27:06.322952 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:06.322952 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:06.322952 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:06.322952 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:06.322952 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:06.322952 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:06.322952 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:06.322952 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:06.322952 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:06.322952 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:06.322952 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:06.322952 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:27:06.322952 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:27:06.322952 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:27:06.322952 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:27:06.323785 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:27:06.323785 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:27:06.323785 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:27:06.323785 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:27:06.323785 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:06.323785 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:06.323785 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:06.323785 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:06.323785 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:06.323785 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:06.323785 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:06.323785 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:06.323785 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:06.323785 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:06.323785 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:06.323785 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:06.326510 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:06.326510 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:06.326510 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:06.326510 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:06.326510 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:27:06.326510 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:27:06.326510 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:27:06.326510 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:27:06.326510 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:27:06.326510 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:27:06.326510 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 21:27:06.326510 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:27:06.327104 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b6c170-7139-46ce-b4d3-e3cc10aa81f4 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:06.327471 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 40/78] 10.222.0.70 () {56 vars in 1114 bytes} [Tue Aug 2 21:27:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:06.327471 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e937d40-41bd-4e7b-93c1-7186c27fa1a4 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:06.338942 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:06.362585 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9a910a-2fe8-4459-9b0d-ed7eadbb00ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:06.363213 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a910a-2fe8-4459-9b0d-ed7eadbb00ed None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:06.363500 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a910a-2fe8-4459-9b0d-ed7eadbb00ed None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:06.363775 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a910a-2fe8-4459-9b0d-ed7eadbb00ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:06.428440 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e937d40-41bd-4e7b-93c1-7186c27fa1a4 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:06.432073 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9a910a-2fe8-4459-9b0d-ed7eadbb00ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:06.433598 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9a910a-2fe8-4459-9b0d-ed7eadbb00ed None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:06.462504 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5a2ef2-961c-4997-acdf-3a9b29ee93b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:06.463136 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5a2ef2-961c-4997-acdf-3a9b29ee93b5 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:06.463424 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5a2ef2-961c-4997-acdf-3a9b29ee93b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:06.463757 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5a2ef2-961c-4997-acdf-3a9b29ee93b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:06.479688 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:06.530391 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5a2ef2-961c-4997-acdf-3a9b29ee93b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:06.531665 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 39/79] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 2 21:27:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 21:27:06.532177 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5a2ef2-961c-4997-acdf-3a9b29ee93b5 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:06.537108 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9a910a-2fe8-4459-9b0d-ed7eadbb00ed None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:06.543120 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:06.629742 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 41/80] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 2 21:27:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 21:27:06.630586 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5a2ef2-961c-4997-acdf-3a9b29ee93b5 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:06.637462 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9a910a-2fe8-4459-9b0d-ed7eadbb00ed None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:06.671201 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea118172-58d8-48f1-bc4d-1e1c10420d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:06.671840 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea118172-58d8-48f1-bc4d-1e1c10420d21 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:06.672119 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea118172-58d8-48f1-bc4d-1e1c10420d21 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:06.672427 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea118172-58d8-48f1-bc4d-1e1c10420d21 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:06.682981 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea118172-58d8-48f1-bc4d-1e1c10420d21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:27:06.688439 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-ea118172-58d8-48f1-bc4d-1e1c10420d21 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 21:27:06.688439 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:06.688439 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:06.688439 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:06.688439 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:06.688439 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:06.688439 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:06.688439 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:06.688439 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:06.688439 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:06.688439 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:06.688439 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:06.688439 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:27:06.688439 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:27:06.688439 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:27:06.688439 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:27:06.689447 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:27:06.689447 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:27:06.689447 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:27:06.689447 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:27:06.689447 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:06.689447 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:06.689447 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:06.689447 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:06.689447 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:06.689447 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:06.689447 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:06.689447 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:06.689447 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:06.689447 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:06.689447 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:06.689447 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:06.690356 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:06.690356 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:06.690356 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:06.690356 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:06.690356 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:27:06.690356 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:27:06.690356 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:27:06.690356 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:27:06.690356 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:27:06.690356 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:27:06.690356 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 21:27:06.690356 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:27:06.690356 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 40/81] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 2 21:27:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:06.690356 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea118172-58d8-48f1-bc4d-1e1c10420d21 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:06.704659 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:06.735977 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5a2ef2-961c-4997-acdf-3a9b29ee93b5 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:06.747515 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:06.771541 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba450f4-f9b6-440e-a9d9-22abd8b84547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:06.772180 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba450f4-f9b6-440e-a9d9-22abd8b84547 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:06.772500 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba450f4-f9b6-440e-a9d9-22abd8b84547 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:06.772778 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba450f4-f9b6-440e-a9d9-22abd8b84547 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:06.773929 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba450f4-f9b6-440e-a9d9-22abd8b84547 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:06.775398 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba450f4-f9b6-440e-a9d9-22abd8b84547 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:06.777026 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 42/82] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 2 21:27:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:06.780287 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba450f4-f9b6-440e-a9d9-22abd8b84547 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:06.806635 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea118172-58d8-48f1-bc4d-1e1c10420d21 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:06.839759 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542981ce-1271-4503-b11a-7813f5ce95d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:06.840947 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542981ce-1271-4503-b11a-7813f5ce95d9 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:06.841231 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542981ce-1271-4503-b11a-7813f5ce95d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:06.841504 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542981ce-1271-4503-b11a-7813f5ce95d9 None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:06.842214 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542981ce-1271-4503-b11a-7813f5ce95d9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:06.842518 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542981ce-1271-4503-b11a-7813f5ce95d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:06.843907 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542981ce-1271-4503-b11a-7813f5ce95d9 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:06.851734 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 41/83] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Aug 2 21:27:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:06.852542 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542981ce-1271-4503-b11a-7813f5ce95d9 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:06.882450 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba450f4-f9b6-440e-a9d9-22abd8b84547 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:06.919378 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6295cb-d475-4f50-8929-578e025a15c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:06.920027 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6295cb-d475-4f50-8929-578e025a15c0 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:06.920346 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6295cb-d475-4f50-8929-578e025a15c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:06.920632 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6295cb-d475-4f50-8929-578e025a15c0 None admin] PATH_INFO: `/v3/projects/66ccc6e8e7254f0795008b4785dcdaa7` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:06.921184 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:06.921820 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6295cb-d475-4f50-8929-578e025a15c0 None admin] RBAC: Authorizing `identity:get_project(project_id=66ccc6e8e7254f0795008b4785dcdaa7)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:06.923831 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6295cb-d475-4f50-8929-578e025a15c0 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:06.925543 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 43/84] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Aug 2 21:27:06 2022] GET /identity/v3/projects/66ccc6e8e7254f0795008b4785dcdaa7 => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:06.926316 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6295cb-d475-4f50-8929-578e025a15c0 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:06.955160 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542981ce-1271-4503-b11a-7813f5ce95d9 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:06.972064 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:06.990465 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e2dd6b-e226-4e31-bee5-5d299aef04f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:06.991117 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e2dd6b-e226-4e31-bee5-5d299aef04f2 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:06.991408 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e2dd6b-e226-4e31-bee5-5d299aef04f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:06.991692 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e2dd6b-e226-4e31-bee5-5d299aef04f2 None admin] PATH_INFO: `/v3/projects/66ccc6e8e7254f0795008b4785dcdaa7` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:06.992898 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e2dd6b-e226-4e31-bee5-5d299aef04f2 None admin] RBAC: Authorizing `identity:get_project(project_id=66ccc6e8e7254f0795008b4785dcdaa7)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:06.994345 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e2dd6b-e226-4e31-bee5-5d299aef04f2 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:06.996019 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 42/85] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Aug 2 21:27:06 2022] GET /identity/v3/projects/66ccc6e8e7254f0795008b4785dcdaa7 => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:06.996019 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e2dd6b-e226-4e31-bee5-5d299aef04f2 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:07.025485 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6295cb-d475-4f50-8929-578e025a15c0 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:07.059619 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff6181f-186d-4cc9-be9f-022cfcca3309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:07.060262 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff6181f-186d-4cc9-be9f-022cfcca3309 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:07.061987 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff6181f-186d-4cc9-be9f-022cfcca3309 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:07.061987 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff6181f-186d-4cc9-be9f-022cfcca3309 None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:07.061987 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff6181f-186d-4cc9-be9f-022cfcca3309 None admin] RBAC: Adding query filter params (name=member) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:07.061987 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff6181f-186d-4cc9-be9f-022cfcca3309 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:07.063200 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff6181f-186d-4cc9-be9f-022cfcca3309 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:07.075991 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 44/86] 10.222.0.70 () {56 vars in 1101 bytes} [Tue Aug 2 21:27:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:07.076872 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff6181f-186d-4cc9-be9f-022cfcca3309 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:07.102044 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e2dd6b-e226-4e31-bee5-5d299aef04f2 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:07.135744 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad73d7a8-5e30-4144-97d4-d6208e876dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:07.136410 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad73d7a8-5e30-4144-97d4-d6208e876dac None admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:07.136698 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad73d7a8-5e30-4144-97d4-d6208e876dac None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:07.136993 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad73d7a8-5e30-4144-97d4-d6208e876dac None admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:07.137708 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad73d7a8-5e30-4144-97d4-d6208e876dac None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:07.139180 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad73d7a8-5e30-4144-97d4-d6208e876dac None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:07.153874 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:07.167897 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 43/87] 10.222.0.70 () {60 vars in 1132 bytes} [Tue Aug 2 21:27:06 2022] POST /identity/v3/users => generated 289 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:27:07.167897 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad73d7a8-5e30-4144-97d4-d6208e876dac None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:07.183905 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff6181f-186d-4cc9-be9f-022cfcca3309 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:07.195942 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:07.228514 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cf45c1-5fe2-4c0c-bfc6-cbae56a0c182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:07.229504 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cf45c1-5fe2-4c0c-bfc6-cbae56a0c182 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:07.229990 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cf45c1-5fe2-4c0c-bfc6-cbae56a0c182 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:07.230564 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cf45c1-5fe2-4c0c-bfc6-cbae56a0c182 None admin] PATH_INFO: `/v3/users/19d387c06a3e450fbcd87cab2ec693c1` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:07.232140 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cf45c1-5fe2-4c0c-bfc6-cbae56a0c182 None admin] RBAC: Authorizing `identity:get_user(user_id=19d387c06a3e450fbcd87cab2ec693c1)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:07.233840 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cf45c1-5fe2-4c0c-bfc6-cbae56a0c182 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:07.235894 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 45/88] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Aug 2 21:27:07 2022] GET /identity/v3/users/19d387c06a3e450fbcd87cab2ec693c1 => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:07.236956 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cf45c1-5fe2-4c0c-bfc6-cbae56a0c182 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:07.304942 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad73d7a8-5e30-4144-97d4-d6208e876dac None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:07.348007 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49ed6ff-2737-462d-9908-e302ed9a1e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:07.349381 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49ed6ff-2737-462d-9908-e302ed9a1e9e None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:07.349671 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49ed6ff-2737-462d-9908-e302ed9a1e9e None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:07.349959 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49ed6ff-2737-462d-9908-e302ed9a1e9e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:07.350763 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49ed6ff-2737-462d-9908-e302ed9a1e9e None admin] RBAC: Adding query filter params (role.id=462e3381a85c42a9959201f9aa122f7c, scope.project.id=66ccc6e8e7254f0795008b4785dcdaa7, user.id=19d387c06a3e450fbcd87cab2ec693c1) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:07.351080 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49ed6ff-2737-462d-9908-e302ed9a1e9e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:07.352553 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49ed6ff-2737-462d-9908-e302ed9a1e9e None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:07.360017 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cf45c1-5fe2-4c0c-bfc6-cbae56a0c182 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:07.360918 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 44/89] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Aug 2 21:27:07 2022] GET /identity/v3/role_assignments?user.id=19d387c06a3e450fbcd87cab2ec693c1&scope.project.id=66ccc6e8e7254f0795008b4785dcdaa7&role.id=462e3381a85c42a9959201f9aa122f7c => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:07.361738 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49ed6ff-2737-462d-9908-e302ed9a1e9e None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:07.411319 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10500cc6-b659-4a1c-8a59-48db76c86277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:07.411974 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10500cc6-b659-4a1c-8a59-48db76c86277 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:07.412297 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10500cc6-b659-4a1c-8a59-48db76c86277 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:07.412575 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10500cc6-b659-4a1c-8a59-48db76c86277 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:07.413841 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10500cc6-b659-4a1c-8a59-48db76c86277 None admin] RBAC: Adding query filter params (role.id=3e32dbf75f9b41f5adb9fe59851267bb, scope.project.id=66ccc6e8e7254f0795008b4785dcdaa7, user.id=94e9c2ea79ff4d5fa5dea3f64a3c9a29) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:07.414989 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10500cc6-b659-4a1c-8a59-48db76c86277 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:07.416954 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10500cc6-b659-4a1c-8a59-48db76c86277 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:07.424967 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 46/90] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Aug 2 21:27:07 2022] GET /identity/v3/role_assignments?user.id=94e9c2ea79ff4d5fa5dea3f64a3c9a29&scope.project.id=66ccc6e8e7254f0795008b4785dcdaa7&role.id=3e32dbf75f9b41f5adb9fe59851267bb => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:07.431520 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10500cc6-b659-4a1c-8a59-48db76c86277 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:07.438846 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:07.505913 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:07.508658 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49ed6ff-2737-462d-9908-e302ed9a1e9e None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:07.563987 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb17acc-53ac-4abd-982d-b7bd3d239839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:07.564693 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb17acc-53ac-4abd-982d-b7bd3d239839 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:07.564989 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb17acc-53ac-4abd-982d-b7bd3d239839 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:07.565272 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb17acc-53ac-4abd-982d-b7bd3d239839 None admin] PATH_INFO: `/v3/users/19d387c06a3e450fbcd87cab2ec693c1` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:07.566536 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb17acc-53ac-4abd-982d-b7bd3d239839 None admin] RBAC: Authorizing `identity:get_user(user_id=19d387c06a3e450fbcd87cab2ec693c1)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:07.568866 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb17acc-53ac-4abd-982d-b7bd3d239839 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:07.571106 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 45/91] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Aug 2 21:27:07 2022] GET /identity/v3/users/19d387c06a3e450fbcd87cab2ec693c1 => generated 275 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:07.577860 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb17acc-53ac-4abd-982d-b7bd3d239839 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:07.600996 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10500cc6-b659-4a1c-8a59-48db76c86277 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:07.648652 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bbb182-b586-48e1-a868-2a58e2ee57c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:07.649308 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bbb182-b586-48e1-a868-2a58e2ee57c3 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:07.649599 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bbb182-b586-48e1-a868-2a58e2ee57c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:07.649883 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bbb182-b586-48e1-a868-2a58e2ee57c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:07.715709 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb17acc-53ac-4abd-982d-b7bd3d239839 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:07.760926 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bbb182-b586-48e1-a868-2a58e2ee57c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:07.763303 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:07.765318 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bbb182-b586-48e1-a868-2a58e2ee57c3 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:07.780922 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bc3fc1-c471-4341-bfd0-0becb833a419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:07.781569 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bc3fc1-c471-4341-bfd0-0becb833a419 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:07.781864 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bc3fc1-c471-4341-bfd0-0becb833a419 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:07.782148 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bc3fc1-c471-4341-bfd0-0becb833a419 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:07.851582 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:07.882539 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bc3fc1-c471-4341-bfd0-0becb833a419 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:07.884053 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bc3fc1-c471-4341-bfd0-0becb833a419 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:08.002190 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 47/92] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 2 21:27:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 571 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 21:27:08.013347 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bbb182-b586-48e1-a868-2a58e2ee57c3 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:08.034187 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 46/93] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 2 21:27:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 21:27:08.039938 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bc3fc1-c471-4341-bfd0-0becb833a419 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:08.128607 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:08.133492 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bbb182-b586-48e1-a868-2a58e2ee57c3 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:08.169678 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e2d0a3-da83-45f6-b2d3-7596361cf355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:08.170339 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e2d0a3-da83-45f6-b2d3-7596361cf355 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:08.170631 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e2d0a3-da83-45f6-b2d3-7596361cf355 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:08.170913 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e2d0a3-da83-45f6-b2d3-7596361cf355 None admin] PATH_INFO: `/v3/projects/66ccc6e8e7254f0795008b4785dcdaa7` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:08.172111 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e2d0a3-da83-45f6-b2d3-7596361cf355 None admin] RBAC: Authorizing `identity:get_project(project_id=66ccc6e8e7254f0795008b4785dcdaa7)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:08.173609 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e2d0a3-da83-45f6-b2d3-7596361cf355 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:08.175297 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 48/94] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Aug 2 21:27:08 2022] GET /identity/v3/projects/66ccc6e8e7254f0795008b4785dcdaa7 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:27:08.181280 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e2d0a3-da83-45f6-b2d3-7596361cf355 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:08.212363 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:08.276897 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bc3fc1-c471-4341-bfd0-0becb833a419 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:08.326429 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e2d0a3-da83-45f6-b2d3-7596361cf355 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:08.355113 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a746af-8c12-4120-9504-2f469affe1f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:08.356371 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a746af-8c12-4120-9504-2f469affe1f1 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:08.356668 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a746af-8c12-4120-9504-2f469affe1f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:08.356955 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a746af-8c12-4120-9504-2f469affe1f1 None admin] PATH_INFO: `/v3/projects/3cbe3de66eb54839bb11bf3ab8bc66f2` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:08.359018 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a746af-8c12-4120-9504-2f469affe1f1 None admin] RBAC: Authorizing `identity:get_project(project_id=3cbe3de66eb54839bb11bf3ab8bc66f2)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:08.360528 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a746af-8c12-4120-9504-2f469affe1f1 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:08.362490 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 47/95] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Aug 2 21:27:08 2022] GET /identity/v3/projects/3cbe3de66eb54839bb11bf3ab8bc66f2 => generated 312 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:08.369613 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a746af-8c12-4120-9504-2f469affe1f1 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:08.401143 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec84ffc-d195-4d8b-bb44-ab3437588920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:08.401780 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec84ffc-d195-4d8b-bb44-ab3437588920 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:08.402066 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec84ffc-d195-4d8b-bb44-ab3437588920 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:08.402350 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec84ffc-d195-4d8b-bb44-ab3437588920 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:08.403696 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec84ffc-d195-4d8b-bb44-ab3437588920 None admin] RBAC: Adding query filter params (role.id=14ed906e656a4c1cabd17ceae4a1f872, scope.project.id=66ccc6e8e7254f0795008b4785dcdaa7, user.id=19d387c06a3e450fbcd87cab2ec693c1) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:08.404015 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec84ffc-d195-4d8b-bb44-ab3437588920 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:08.405516 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec84ffc-d195-4d8b-bb44-ab3437588920 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:08.420067 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 49/96] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Aug 2 21:27:08 2022] GET /identity/v3/role_assignments?user.id=19d387c06a3e450fbcd87cab2ec693c1&scope.project.id=66ccc6e8e7254f0795008b4785dcdaa7&role.id=14ed906e656a4c1cabd17ceae4a1f872 => generated 259 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:27:08.504852 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:08.511894 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a746af-8c12-4120-9504-2f469affe1f1 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:08.550050 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baea6465-d533-49e1-afc2-6fca5f8c95d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:08.550604 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baea6465-d533-49e1-afc2-6fca5f8c95d6 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:08.550893 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baea6465-d533-49e1-afc2-6fca5f8c95d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:08.551176 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baea6465-d533-49e1-afc2-6fca5f8c95d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:08.551996 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baea6465-d533-49e1-afc2-6fca5f8c95d6 None admin] RBAC: Adding query filter params (role.id=462e3381a85c42a9959201f9aa122f7c, scope.project.id=3cbe3de66eb54839bb11bf3ab8bc66f2, user.id=19d387c06a3e450fbcd87cab2ec693c1) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:08.552344 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baea6465-d533-49e1-afc2-6fca5f8c95d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:08.553848 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baea6465-d533-49e1-afc2-6fca5f8c95d6 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:08.560107 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 48/97] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Aug 2 21:27:08 2022] GET /identity/v3/role_assignments?user.id=19d387c06a3e450fbcd87cab2ec693c1&scope.project.id=3cbe3de66eb54839bb11bf3ab8bc66f2&role.id=462e3381a85c42a9959201f9aa122f7c => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:10.029208 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1646dae-8306-4304-9550-22ee4cc2dd7c None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:10.029713 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1646dae-8306-4304-9550-22ee4cc2dd7c None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:10.029784 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1646dae-8306-4304-9550-22ee4cc2dd7c None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:10.031425 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 50/98] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:27:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:27:10.045500 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e726e6d0-07b1-4577-b0db-69829371392c None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:10.045966 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e726e6d0-07b1-4577-b0db-69829371392c None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:10.046146 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e726e6d0-07b1-4577-b0db-69829371392c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:10.070543 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-e726e6d0-07b1-4577-b0db-69829371392c None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:10.071742 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-e726e6d0-07b1-4577-b0db-69829371392c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:10.158776 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 49/99] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:27:10.205973 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1646dae-8306-4304-9550-22ee4cc2dd7c None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:10.308652 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:10.332542 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1646dae-8306-4304-9550-22ee4cc2dd7c None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:10.339584 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe237ba-e08e-4358-8057-bbed6ebb2e3d None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:10.339878 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe237ba-e08e-4358-8057-bbed6ebb2e3d None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:10.340195 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe237ba-e08e-4358-8057-bbed6ebb2e3d None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:10.341716 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 50/100] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:27:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:27:10.346381 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b583c067-ae2e-4580-b023-17ed77145e3d None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:10.346674 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b583c067-ae2e-4580-b023-17ed77145e3d None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:10.346959 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b583c067-ae2e-4580-b023-17ed77145e3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:10.385159 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-b583c067-ae2e-4580-b023-17ed77145e3d None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:10.386391 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-b583c067-ae2e-4580-b023-17ed77145e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:10.393345 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5f6e0a-5041-413a-b544-d2471f13661f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:10.394117 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5f6e0a-5041-413a-b544-d2471f13661f None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:10.394416 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5f6e0a-5041-413a-b544-d2471f13661f None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:10.394699 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5f6e0a-5041-413a-b544-d2471f13661f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:10.397385 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5f6e0a-5041-413a-b544-d2471f13661f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:10.398854 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5f6e0a-5041-413a-b544-d2471f13661f None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:10.400509 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 51/101] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 2 21:27:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:10.405464 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf97065-6a62-432f-bb10-a370a3b05923 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:10.405760 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf97065-6a62-432f-bb10-a370a3b05923 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:10.406047 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf97065-6a62-432f-bb10-a370a3b05923 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:10.407436 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 52/102] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:27:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:27:10.412071 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf97065-6a62-432f-bb10-a370a3b05923 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:10.510200 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 51/103] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 02 21:27:10.511962 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57dd118-bd1e-46f9-aeee-0829c869161f None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:10.511962 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57dd118-bd1e-46f9-aeee-0829c869161f None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:10.512122 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57dd118-bd1e-46f9-aeee-0829c869161f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:10.529858 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-c57dd118-bd1e-46f9-aeee-0829c869161f None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:10.531062 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-c57dd118-bd1e-46f9-aeee-0829c869161f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:10.549687 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:10.623957 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf97065-6a62-432f-bb10-a370a3b05923 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:10.625177 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 52/104] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:27:10.626228 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57dd118-bd1e-46f9-aeee-0829c869161f None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:10.687730 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8c764a-fb57-4231-8501-2ec230739eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:10.688396 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8c764a-fb57-4231-8501-2ec230739eb1 None admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:10.688686 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8c764a-fb57-4231-8501-2ec230739eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:10.688965 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8c764a-fb57-4231-8501-2ec230739eb1 None admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:10.689666 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8c764a-fb57-4231-8501-2ec230739eb1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:10.691160 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8c764a-fb57-4231-8501-2ec230739eb1 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:10.712982 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:10.740997 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 53/105] 10.222.0.70 () {60 vars in 1141 bytes} [Tue Aug 2 21:27:10 2022] POST /identity/v3/projects => generated 302 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:27:10.741762 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8c764a-fb57-4231-8501-2ec230739eb1 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:10.828750 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57dd118-bd1e-46f9-aeee-0829c869161f None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:10.903674 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85b3720-1143-4935-97e0-0e4d3164d4be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:10.904379 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85b3720-1143-4935-97e0-0e4d3164d4be None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:10.904671 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85b3720-1143-4935-97e0-0e4d3164d4be None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:10.904950 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85b3720-1143-4935-97e0-0e4d3164d4be None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:10.927462 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85b3720-1143-4935-97e0-0e4d3164d4be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:27:10.938032 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-e85b3720-1143-4935-97e0-0e4d3164d4be None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 21:27:10.938032 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:10.938032 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:10.938032 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:10.938032 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:10.938032 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:10.938032 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:10.938032 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:10.938032 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:10.938032 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:10.938032 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:10.938032 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:10.938032 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:27:10.938032 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:27:10.938032 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:27:10.938032 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:27:10.938957 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:27:10.938957 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:27:10.938957 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:27:10.938957 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:27:10.938957 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:10.938957 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:10.938957 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:10.938957 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:10.938957 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:10.938957 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:10.938957 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:10.938957 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:10.938957 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:10.938957 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:10.938957 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:10.938957 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:10.939694 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:10.939694 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:10.939694 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:10.939694 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:10.939694 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:27:10.939694 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:27:10.939694 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:27:10.939694 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:27:10.939694 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:27:10.939694 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:27:10.939694 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 21:27:10.939694 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:27:10.940861 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 53/106] 10.222.0.70 () {56 vars in 1096 bytes} [Tue Aug 2 21:27:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:10.945626 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0904bac4-5db0-48ee-bb87-91dce3d0b548 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:10.945917 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0904bac4-5db0-48ee-bb87-91dce3d0b548 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:10.946183 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0904bac4-5db0-48ee-bb87-91dce3d0b548 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:10.947722 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 54/107] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:27:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:27:10.950355 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0904bac4-5db0-48ee-bb87-91dce3d0b548 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:10.970109 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:10.971909 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8c764a-fb57-4231-8501-2ec230739eb1 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:11.014497 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb7852a-ebfd-4d98-a2e9-0fd6b6372c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:11.015168 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb7852a-ebfd-4d98-a2e9-0fd6b6372c6d None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:11.015458 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb7852a-ebfd-4d98-a2e9-0fd6b6372c6d None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:11.015741 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb7852a-ebfd-4d98-a2e9-0fd6b6372c6d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:11.028274 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb7852a-ebfd-4d98-a2e9-0fd6b6372c6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:27:11.034532 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-5fb7852a-ebfd-4d98-a2e9-0fd6b6372c6d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 21:27:11.034532 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:11.034532 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:11.034532 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:11.034532 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:11.034532 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:11.034532 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:11.034532 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:11.034532 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:11.034532 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:11.034532 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:11.034532 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:11.034532 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:27:11.034532 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:27:11.034532 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:27:11.034532 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:27:11.037391 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:27:11.037391 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:27:11.037391 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:27:11.037391 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:27:11.037391 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:11.037391 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:11.037391 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:11.037391 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:11.037391 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:11.037391 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:11.037391 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:11.037391 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:11.037391 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:11.037391 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:11.037391 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:11.037391 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:11.039241 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:11.039241 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:11.039241 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:11.039241 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:11.039241 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:27:11.039241 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:27:11.039241 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:27:11.039241 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:27:11.039241 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:27:11.039241 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:27:11.039241 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 21:27:11.039241 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:27:11.039241 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 54/108] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 2 21:27:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:11.039241 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98cbbd2-a43c-4494-b075-2ad7510eaf5e None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:11.045376 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98cbbd2-a43c-4494-b075-2ad7510eaf5e None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:11.045376 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98cbbd2-a43c-4494-b075-2ad7510eaf5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:11.061619 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-d98cbbd2-a43c-4494-b075-2ad7510eaf5e None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:11.062895 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-d98cbbd2-a43c-4494-b075-2ad7510eaf5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:11.084307 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0904bac4-5db0-48ee-bb87-91dce3d0b548 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:11.114293 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:11.128249 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f4cdfa-619c-4450-976c-40ddc1d6096b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:11.129056 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f4cdfa-619c-4450-976c-40ddc1d6096b None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:11.129161 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f4cdfa-619c-4450-976c-40ddc1d6096b None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:11.129550 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f4cdfa-619c-4450-976c-40ddc1d6096b None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:11.130167 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f4cdfa-619c-4450-976c-40ddc1d6096b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:11.130482 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f4cdfa-619c-4450-976c-40ddc1d6096b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:11.131966 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f4cdfa-619c-4450-976c-40ddc1d6096b None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:11.141862 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 55/109] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 2 21:27:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:11.142409 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f4cdfa-619c-4450-976c-40ddc1d6096b None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:11.143673 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 55/110] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:27:11.152269 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98cbbd2-a43c-4494-b075-2ad7510eaf5e None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:11.228394 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:11.268406 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f4cdfa-619c-4450-976c-40ddc1d6096b None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:11.279619 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98cbbd2-a43c-4494-b075-2ad7510eaf5e None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:11.316351 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c776ed-d967-4813-ae8a-7022c2c39c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:11.317012 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c776ed-d967-4813-ae8a-7022c2c39c0f None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:11.317304 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c776ed-d967-4813-ae8a-7022c2c39c0f None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:11.317402 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bc4ccc-c898-49b4-9e10-1907fb3c2f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:11.317599 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c776ed-d967-4813-ae8a-7022c2c39c0f None admin] PATH_INFO: `/v3/users/94e9c2ea79ff4d5fa5dea3f64a3c9a29` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:11.317973 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc4ccc-c898-49b4-9e10-1907fb3c2f40 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:11.318356 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc4ccc-c898-49b4-9e10-1907fb3c2f40 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:11.318645 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bc4ccc-c898-49b4-9e10-1907fb3c2f40 None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:11.318802 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c776ed-d967-4813-ae8a-7022c2c39c0f None admin] RBAC: Authorizing `identity:get_user(user_id=94e9c2ea79ff4d5fa5dea3f64a3c9a29)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:11.319371 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bc4ccc-c898-49b4-9e10-1907fb3c2f40 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:11.319681 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bc4ccc-c898-49b4-9e10-1907fb3c2f40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:11.320292 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c776ed-d967-4813-ae8a-7022c2c39c0f None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:11.321106 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bc4ccc-c898-49b4-9e10-1907fb3c2f40 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:11.322231 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 56/111] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Aug 2 21:27:11 2022] GET /identity/v3/users/94e9c2ea79ff4d5fa5dea3f64a3c9a29 => generated 247 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:11.327616 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c776ed-d967-4813-ae8a-7022c2c39c0f None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:11.330965 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 56/112] 10.222.0.70 () {56 vars in 1101 bytes} [Tue Aug 2 21:27:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:11.332444 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993b34b7-b8b9-4e53-b4bc-85289c5dd1aa None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:11.332742 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993b34b7-b8b9-4e53-b4bc-85289c5dd1aa None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:11.333025 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993b34b7-b8b9-4e53-b4bc-85289c5dd1aa None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:11.334578 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 57/113] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:27:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:27:11.335098 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993b34b7-b8b9-4e53-b4bc-85289c5dd1aa None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:11.385286 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:11.438607 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c776ed-d967-4813-ae8a-7022c2c39c0f None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:11.456061 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993b34b7-b8b9-4e53-b4bc-85289c5dd1aa None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:11.474213 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3465c8-69dd-4d30-935e-11402b4f9063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:11.474949 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3465c8-69dd-4d30-935e-11402b4f9063 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:11.475310 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3465c8-69dd-4d30-935e-11402b4f9063 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:11.475662 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3465c8-69dd-4d30-935e-11402b4f9063 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:11.487066 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3465c8-69dd-4d30-935e-11402b4f9063 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:27:11.489788 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:11.492644 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-da3465c8-69dd-4d30-935e-11402b4f9063 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 21:27:11.492644 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:11.492644 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:11.492644 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:11.492644 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:11.492644 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:11.492644 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:11.492644 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:11.492644 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:11.492644 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:11.492644 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:11.492644 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:11.492644 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:27:11.492644 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:27:11.492644 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:27:11.492644 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:27:11.494464 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:27:11.494464 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:27:11.494464 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:27:11.494464 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:27:11.494464 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:11.494464 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:11.494464 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:11.494464 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:11.494464 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:11.494464 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:11.494464 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:11.494464 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:11.494464 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:11.494464 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:11.494464 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:11.494464 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:11.495385 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:11.495385 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:11.495385 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:11.495385 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:11.495385 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:27:11.495385 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:27:11.495385 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:27:11.495385 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:27:11.495385 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:27:11.495385 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:27:11.495385 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 21:27:11.495385 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:27:11.501163 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 57/114] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 2 21:27:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:11.501163 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be6df2f-4729-4f9c-b4f0-408fa95c774a None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:11.501163 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be6df2f-4729-4f9c-b4f0-408fa95c774a None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:11.501163 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be6df2f-4729-4f9c-b4f0-408fa95c774a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:11.504323 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9aefdd-43ff-4c07-9bc5-c0c92f31cfb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:11.505201 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9aefdd-43ff-4c07-9bc5-c0c92f31cfb6 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:11.505628 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9aefdd-43ff-4c07-9bc5-c0c92f31cfb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:11.506139 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9aefdd-43ff-4c07-9bc5-c0c92f31cfb6 None admin] PATH_INFO: `/v3/projects/66ccc6e8e7254f0795008b4785dcdaa7` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:11.507540 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9aefdd-43ff-4c07-9bc5-c0c92f31cfb6 None admin] RBAC: Authorizing `identity:get_project(project_id=66ccc6e8e7254f0795008b4785dcdaa7)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:11.509340 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9aefdd-43ff-4c07-9bc5-c0c92f31cfb6 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:11.511260 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 58/115] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Aug 2 21:27:11 2022] GET /identity/v3/projects/66ccc6e8e7254f0795008b4785dcdaa7 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:11.512282 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9aefdd-43ff-4c07-9bc5-c0c92f31cfb6 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:11.522824 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-9be6df2f-4729-4f9c-b4f0-408fa95c774a None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:11.524111 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-9be6df2f-4729-4f9c-b4f0-408fa95c774a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:11.608333 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 58/116] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:27:11.608333 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be6df2f-4729-4f9c-b4f0-408fa95c774a None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:11.644190 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9aefdd-43ff-4c07-9bc5-c0c92f31cfb6 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:11.646807 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:11.680789 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63674c4b-1d89-4bcd-9158-b96cd767f839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:11.681581 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63674c4b-1d89-4bcd-9158-b96cd767f839 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:11.681963 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63674c4b-1d89-4bcd-9158-b96cd767f839 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:11.682361 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63674c4b-1d89-4bcd-9158-b96cd767f839 None admin] PATH_INFO: `/v3/users/f3be501a21084f37a3dbcea8181c9d84` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:11.697740 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63674c4b-1d89-4bcd-9158-b96cd767f839 None admin] RBAC: Authorizing `identity:get_user(user_id=f3be501a21084f37a3dbcea8181c9d84)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:11.699867 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63674c4b-1d89-4bcd-9158-b96cd767f839 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:11.701770 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 59/117] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Aug 2 21:27:11 2022] GET /identity/v3/users/f3be501a21084f37a3dbcea8181c9d84 => generated 289 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:11.702545 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63674c4b-1d89-4bcd-9158-b96cd767f839 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:11.719163 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be6df2f-4729-4f9c-b4f0-408fa95c774a None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:11.765479 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb023378-f159-4e9b-93c8-db63d3575aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:11.766111 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb023378-f159-4e9b-93c8-db63d3575aba None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:11.766397 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb023378-f159-4e9b-93c8-db63d3575aba None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:11.766678 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb023378-f159-4e9b-93c8-db63d3575aba None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:11.767502 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb023378-f159-4e9b-93c8-db63d3575aba None admin] RBAC: Adding query filter params (name=member) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:11.767912 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:11.768346 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb023378-f159-4e9b-93c8-db63d3575aba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:11.772896 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb023378-f159-4e9b-93c8-db63d3575aba None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:11.781684 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 59/118] 10.222.0.70 () {56 vars in 1101 bytes} [Tue Aug 2 21:27:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:11.782507 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb023378-f159-4e9b-93c8-db63d3575aba None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:11.818977 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63674c4b-1d89-4bcd-9158-b96cd767f839 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:11.853439 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd310f2-342a-4a86-9b68-03ad3c80cd93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:11.854116 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd310f2-342a-4a86-9b68-03ad3c80cd93 None admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:11.854413 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd310f2-342a-4a86-9b68-03ad3c80cd93 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:11.854697 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd310f2-342a-4a86-9b68-03ad3c80cd93 None admin] PATH_INFO: `/v3/projects/66ccc6e8e7254f0795008b4785dcdaa7/users/94e9c2ea79ff4d5fa5dea3f64a3c9a29/roles/3e32dbf75f9b41f5adb9fe59851267bb` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:11.857527 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd310f2-342a-4a86-9b68-03ad3c80cd93 None admin] RBAC: Authorizing `identity:create_grant(project_id=66ccc6e8e7254f0795008b4785dcdaa7, user_id=94e9c2ea79ff4d5fa5dea3f64a3c9a29, role_id=3e32dbf75f9b41f5adb9fe59851267bb)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:11.859313 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd310f2-342a-4a86-9b68-03ad3c80cd93 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:11.877017 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 60/119] 10.222.0.70 () {58 vars in 1439 bytes} [Tue Aug 2 21:27:11 2022] PUT /identity/v3/projects/66ccc6e8e7254f0795008b4785dcdaa7/users/94e9c2ea79ff4d5fa5dea3f64a3c9a29/roles/3e32dbf75f9b41f5adb9fe59851267bb => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:27:11.878545 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb758864-430a-4dd3-b62a-d71004feb5fa None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:11.878971 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb758864-430a-4dd3-b62a-d71004feb5fa None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:11.879483 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb758864-430a-4dd3-b62a-d71004feb5fa None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:11.881010 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 61/120] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:27:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:27:11.887906 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb758864-430a-4dd3-b62a-d71004feb5fa None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:11.923489 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb023378-f159-4e9b-93c8-db63d3575aba None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:11.928090 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:11.984942 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5088dc46-a1d6-4e5e-a8eb-07f00d696227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:11.985797 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5088dc46-a1d6-4e5e-a8eb-07f00d696227 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:11.986187 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5088dc46-a1d6-4e5e-a8eb-07f00d696227 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:11.986575 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5088dc46-a1d6-4e5e-a8eb-07f00d696227 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:12.006520 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5088dc46-a1d6-4e5e-a8eb-07f00d696227 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:27:12.013378 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-5088dc46-a1d6-4e5e-a8eb-07f00d696227 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 21:27:12.013378 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:12.013378 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:12.013378 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:12.013378 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:12.013378 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:12.013378 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:12.013378 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:12.013378 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:12.013378 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:12.013378 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:12.013378 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:12.013378 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:27:12.013378 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:27:12.013378 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:27:12.013378 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:27:12.014468 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:27:12.014468 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:27:12.014468 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:27:12.014468 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:27:12.014468 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:12.014468 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:12.014468 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:12.014468 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:12.014468 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:12.014468 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:12.014468 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:12.014468 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:12.014468 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:12.014468 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:12.014468 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:12.014468 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:12.015423 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:12.015423 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:12.015423 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:12.015423 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:12.015423 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:27:12.015423 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:27:12.015423 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:27:12.015423 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:27:12.015423 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:27:12.015423 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:27:12.015423 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 21:27:12.015423 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:27:12.020439 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 60/121] 10.222.0.70 () {56 vars in 1114 bytes} [Tue Aug 2 21:27:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:12.021889 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5088dc46-a1d6-4e5e-a8eb-07f00d696227 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:12.071806 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb758864-430a-4dd3-b62a-d71004feb5fa None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:12.101868 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:12.126582 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b5638c-a806-4d81-a14a-63a6c795e3e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:12.127130 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b5638c-a806-4d81-a14a-63a6c795e3e6 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:12.127468 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b5638c-a806-4d81-a14a-63a6c795e3e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:12.127749 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b5638c-a806-4d81-a14a-63a6c795e3e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:12.177916 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5088dc46-a1d6-4e5e-a8eb-07f00d696227 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:12.225837 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9670ec-cb30-462d-9857-5384c0b75fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:12.226934 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9670ec-cb30-462d-9857-5384c0b75fbe None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:12.227589 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9670ec-cb30-462d-9857-5384c0b75fbe None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:12.228024 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9670ec-cb30-462d-9857-5384c0b75fbe None admin] PATH_INFO: `/v3/users/19d387c06a3e450fbcd87cab2ec693c1` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:12.229883 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9670ec-cb30-462d-9857-5384c0b75fbe None admin] RBAC: Authorizing `identity:get_user(user_id=19d387c06a3e450fbcd87cab2ec693c1)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:12.232124 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9670ec-cb30-462d-9857-5384c0b75fbe None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:12.234506 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 61/122] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Aug 2 21:27:12 2022] GET /identity/v3/users/19d387c06a3e450fbcd87cab2ec693c1 => generated 275 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:12.236648 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b5638c-a806-4d81-a14a-63a6c795e3e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:12.238546 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b5638c-a806-4d81-a14a-63a6c795e3e6 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:12.240571 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6882d2d6-bbc6-4ea7-9367-c5d385e765f5 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:12.241000 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6882d2d6-bbc6-4ea7-9367-c5d385e765f5 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:12.241293 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6882d2d6-bbc6-4ea7-9367-c5d385e765f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:12.264083 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-6882d2d6-bbc6-4ea7-9367-c5d385e765f5 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:12.265435 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-6882d2d6-bbc6-4ea7-9367-c5d385e765f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:12.306945 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:12.357071 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 62/123] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 2 21:27:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 21:27:12.357634 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b5638c-a806-4d81-a14a-63a6c795e3e6 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:12.362531 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 62/124] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:27:12.363725 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6882d2d6-bbc6-4ea7-9367-c5d385e765f5 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:12.395348 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:12.486145 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6882d2d6-bbc6-4ea7-9367-c5d385e765f5 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:12.498516 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b5638c-a806-4d81-a14a-63a6c795e3e6 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:12.526766 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b843ba7d-3627-4b83-b7b5-8f5b8b85053c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:12.528980 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b843ba7d-3627-4b83-b7b5-8f5b8b85053c None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:12.529751 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b843ba7d-3627-4b83-b7b5-8f5b8b85053c None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:12.530253 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b843ba7d-3627-4b83-b7b5-8f5b8b85053c None admin] PATH_INFO: `/v3/projects/66ccc6e8e7254f0795008b4785dcdaa7` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:12.532149 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b843ba7d-3627-4b83-b7b5-8f5b8b85053c None admin] RBAC: Authorizing `identity:get_project(project_id=66ccc6e8e7254f0795008b4785dcdaa7)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:12.534376 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b843ba7d-3627-4b83-b7b5-8f5b8b85053c None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:12.536338 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 63/125] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Aug 2 21:27:12 2022] GET /identity/v3/projects/66ccc6e8e7254f0795008b4785dcdaa7 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:12.537404 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b843ba7d-3627-4b83-b7b5-8f5b8b85053c None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:12.543326 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5689ff2d-e2e4-4c11-bfe5-80ad82da50a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:12.543974 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5689ff2d-e2e4-4c11-bfe5-80ad82da50a7 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:12.544297 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5689ff2d-e2e4-4c11-bfe5-80ad82da50a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:12.544587 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5689ff2d-e2e4-4c11-bfe5-80ad82da50a7 None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:12.545320 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5689ff2d-e2e4-4c11-bfe5-80ad82da50a7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:12.545629 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5689ff2d-e2e4-4c11-bfe5-80ad82da50a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:12.547029 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5689ff2d-e2e4-4c11-bfe5-80ad82da50a7 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:12.557323 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 63/126] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Aug 2 21:27:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:12.562478 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5689ff2d-e2e4-4c11-bfe5-80ad82da50a7 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:12.578709 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:12.653102 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:12.671770 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b843ba7d-3627-4b83-b7b5-8f5b8b85053c None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:12.676158 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5689ff2d-e2e4-4c11-bfe5-80ad82da50a7 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:12.710851 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046aae1f-0538-4961-8be9-2ee94a07b83e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:12.711668 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046aae1f-0538-4961-8be9-2ee94a07b83e None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:12.712062 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046aae1f-0538-4961-8be9-2ee94a07b83e None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:12.712483 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046aae1f-0538-4961-8be9-2ee94a07b83e None admin] PATH_INFO: `/v3/projects/66ccc6e8e7254f0795008b4785dcdaa7` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:12.713871 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046aae1f-0538-4961-8be9-2ee94a07b83e None admin] RBAC: Authorizing `identity:get_project(project_id=66ccc6e8e7254f0795008b4785dcdaa7)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:12.716157 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046aae1f-0538-4961-8be9-2ee94a07b83e None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:12.718049 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d428e8-d065-4c1d-99df-5e71538c6669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:12.718490 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 64/127] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Aug 2 21:27:12 2022] GET /identity/v3/projects/66ccc6e8e7254f0795008b4785dcdaa7 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:12.719220 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d428e8-d065-4c1d-99df-5e71538c6669 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:12.719341 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046aae1f-0538-4961-8be9-2ee94a07b83e None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:12.719839 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d428e8-d065-4c1d-99df-5e71538c6669 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:12.720351 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d428e8-d065-4c1d-99df-5e71538c6669 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:12.731995 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d428e8-d065-4c1d-99df-5e71538c6669 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:27:12.738019 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-f5d428e8-d065-4c1d-99df-5e71538c6669 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 21:27:12.738019 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:12.738019 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:12.738019 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:12.738019 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:12.738019 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:12.738019 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:12.738019 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:12.738019 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:12.738019 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:12.738019 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:12.738019 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:12.738019 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:27:12.738019 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:27:12.738019 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:27:12.738019 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:27:12.738918 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:27:12.738918 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:27:12.738918 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:27:12.738918 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:27:12.738918 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:12.738918 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:12.738918 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:12.738918 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:12.738918 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:12.738918 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:12.738918 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:12.738918 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:12.738918 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:12.738918 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:12.738918 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:12.738918 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:12.739708 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:12.739708 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:12.739708 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:12.739708 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:12.739708 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:27:12.739708 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:27:12.739708 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:27:12.739708 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:27:12.739708 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:27:12.739708 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:27:12.739708 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 21:27:12.739708 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:27:12.741563 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 64/128] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 2 21:27:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:12.747049 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d428e8-d065-4c1d-99df-5e71538c6669 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:12.818198 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:12.825605 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046aae1f-0538-4961-8be9-2ee94a07b83e None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:12.853288 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d428e8-d065-4c1d-99df-5e71538c6669 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:12.861466 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a38129-d586-4acb-9421-85603d2cf536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:12.862498 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a38129-d586-4acb-9421-85603d2cf536 None admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:12.862860 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a38129-d586-4acb-9421-85603d2cf536 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:12.863215 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a38129-d586-4acb-9421-85603d2cf536 None admin] PATH_INFO: `/v3/projects/66ccc6e8e7254f0795008b4785dcdaa7/users/19d387c06a3e450fbcd87cab2ec693c1/roles/462e3381a85c42a9959201f9aa122f7c` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:12.865506 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a38129-d586-4acb-9421-85603d2cf536 None admin] RBAC: Authorizing `identity:create_grant(project_id=66ccc6e8e7254f0795008b4785dcdaa7, user_id=19d387c06a3e450fbcd87cab2ec693c1, role_id=462e3381a85c42a9959201f9aa122f7c)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:12.867021 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a38129-d586-4acb-9421-85603d2cf536 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:12.885137 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 65/129] 10.222.0.70 () {58 vars in 1439 bytes} [Tue Aug 2 21:27:12 2022] PUT /identity/v3/projects/66ccc6e8e7254f0795008b4785dcdaa7/users/19d387c06a3e450fbcd87cab2ec693c1/roles/462e3381a85c42a9959201f9aa122f7c => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:27:12.892320 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a38129-d586-4acb-9421-85603d2cf536 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:12.908439 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39c16d0-e674-4cc2-b2fd-012c4fa3ae72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:12.909022 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c16d0-e674-4cc2-b2fd-012c4fa3ae72 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:12.909370 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c16d0-e674-4cc2-b2fd-012c4fa3ae72 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:12.910560 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39c16d0-e674-4cc2-b2fd-012c4fa3ae72 None admin] PATH_INFO: `/v3/users/19d387c06a3e450fbcd87cab2ec693c1` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:12.912094 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39c16d0-e674-4cc2-b2fd-012c4fa3ae72 None admin] RBAC: Authorizing `identity:get_user(user_id=19d387c06a3e450fbcd87cab2ec693c1)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:12.913665 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39c16d0-e674-4cc2-b2fd-012c4fa3ae72 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:12.917017 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 65/130] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Aug 2 21:27:12 2022] GET /identity/v3/users/19d387c06a3e450fbcd87cab2ec693c1 => generated 275 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:12.926682 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39c16d0-e674-4cc2-b2fd-012c4fa3ae72 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:12.950554 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:13.087745 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a38129-d586-4acb-9421-85603d2cf536 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:13.118187 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39c16d0-e674-4cc2-b2fd-012c4fa3ae72 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:13.128480 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d67ab0f-fe3e-4d23-9813-7e3575a90577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:13.129121 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d67ab0f-fe3e-4d23-9813-7e3575a90577 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:13.129434 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d67ab0f-fe3e-4d23-9813-7e3575a90577 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:13.129716 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d67ab0f-fe3e-4d23-9813-7e3575a90577 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:13.130525 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d67ab0f-fe3e-4d23-9813-7e3575a90577 None admin] RBAC: Adding query filter params (role.id=acc98d865c4f4f5cab9d993de06dae36, scope.project.id=66ccc6e8e7254f0795008b4785dcdaa7, user.id=f3be501a21084f37a3dbcea8181c9d84) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:13.130839 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d67ab0f-fe3e-4d23-9813-7e3575a90577 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:13.132313 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d67ab0f-fe3e-4d23-9813-7e3575a90577 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:13.138693 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 66/131] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Aug 2 21:27:12 2022] GET /identity/v3/role_assignments?user.id=f3be501a21084f37a3dbcea8181c9d84&scope.project.id=66ccc6e8e7254f0795008b4785dcdaa7&role.id=acc98d865c4f4f5cab9d993de06dae36 => generated 259 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:13.139328 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d67ab0f-fe3e-4d23-9813-7e3575a90577 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:13.170591 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:13.172732 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b408f8-21eb-4b4c-83f9-137a44fad1dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:13.173614 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b408f8-21eb-4b4c-83f9-137a44fad1dc None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:13.174221 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b408f8-21eb-4b4c-83f9-137a44fad1dc None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:13.175063 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b408f8-21eb-4b4c-83f9-137a44fad1dc None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:13.177132 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b408f8-21eb-4b4c-83f9-137a44fad1dc None admin] RBAC: Adding query filter params (name=member) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:13.177676 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b408f8-21eb-4b4c-83f9-137a44fad1dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:13.180469 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b408f8-21eb-4b4c-83f9-137a44fad1dc None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:13.194280 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 66/132] 10.222.0.70 () {56 vars in 1101 bytes} [Tue Aug 2 21:27:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:13.196731 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44953a75-1107-427f-8a31-7cfd291a7243 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:13.197241 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44953a75-1107-427f-8a31-7cfd291a7243 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:13.198192 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44953a75-1107-427f-8a31-7cfd291a7243 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:13.204346 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 67/133] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:27:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:27:13.207142 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44953a75-1107-427f-8a31-7cfd291a7243 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:13.275469 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d67ab0f-fe3e-4d23-9813-7e3575a90577 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:13.318088 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:13.346354 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe370dc-6972-4c25-acae-4c1c3a7177ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:13.347091 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe370dc-6972-4c25-acae-4c1c3a7177ea None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:13.347383 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe370dc-6972-4c25-acae-4c1c3a7177ea None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:13.347666 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe370dc-6972-4c25-acae-4c1c3a7177ea None admin] PATH_INFO: `/v3/projects/66ccc6e8e7254f0795008b4785dcdaa7` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:13.349141 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe370dc-6972-4c25-acae-4c1c3a7177ea None admin] RBAC: Authorizing `identity:get_project(project_id=66ccc6e8e7254f0795008b4785dcdaa7)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:13.350612 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe370dc-6972-4c25-acae-4c1c3a7177ea None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:13.352552 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 67/134] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Aug 2 21:27:13 2022] GET /identity/v3/projects/66ccc6e8e7254f0795008b4785dcdaa7 => generated 298 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:13.353540 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c123d4d-896f-406a-9bac-07bd7634e278 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:13.353824 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c123d4d-896f-406a-9bac-07bd7634e278 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:13.354196 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c123d4d-896f-406a-9bac-07bd7634e278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:13.388758 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44953a75-1107-427f-8a31-7cfd291a7243 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:13.389497 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-1c123d4d-896f-406a-9bac-07bd7634e278 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:13.390690 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-1c123d4d-896f-406a-9bac-07bd7634e278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:13.427483 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae74560-51b0-40b2-82fa-24ada9922092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:13.428161 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae74560-51b0-40b2-82fa-24ada9922092 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:13.428484 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae74560-51b0-40b2-82fa-24ada9922092 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:13.428867 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae74560-51b0-40b2-82fa-24ada9922092 None admin] PATH_INFO: `/v3/users/19d387c06a3e450fbcd87cab2ec693c1` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:13.430078 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae74560-51b0-40b2-82fa-24ada9922092 None admin] RBAC: Authorizing `identity:get_user(user_id=19d387c06a3e450fbcd87cab2ec693c1)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:13.431535 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae74560-51b0-40b2-82fa-24ada9922092 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:13.433167 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 68/135] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Aug 2 21:27:13 2022] GET /identity/v3/users/19d387c06a3e450fbcd87cab2ec693c1 => generated 275 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:13.434034 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae74560-51b0-40b2-82fa-24ada9922092 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:13.462588 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 68/136] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:27:13.463518 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c123d4d-896f-406a-9bac-07bd7634e278 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:13.483150 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:13.566281 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae74560-51b0-40b2-82fa-24ada9922092 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:13.574032 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c123d4d-896f-406a-9bac-07bd7634e278 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:13.602749 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b84b67-dbc3-4427-9ed4-1a64acdc636a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:13.603549 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b84b67-dbc3-4427-9ed4-1a64acdc636a None admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:13.603834 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b84b67-dbc3-4427-9ed4-1a64acdc636a None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:13.604297 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b84b67-dbc3-4427-9ed4-1a64acdc636a None admin] PATH_INFO: `/v3/projects/66ccc6e8e7254f0795008b4785dcdaa7/users/19d387c06a3e450fbcd87cab2ec693c1/roles/14ed906e656a4c1cabd17ceae4a1f872` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:13.607236 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b84b67-dbc3-4427-9ed4-1a64acdc636a None admin] RBAC: Authorizing `identity:create_grant(project_id=66ccc6e8e7254f0795008b4785dcdaa7, user_id=19d387c06a3e450fbcd87cab2ec693c1, role_id=14ed906e656a4c1cabd17ceae4a1f872)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:13.608933 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b84b67-dbc3-4427-9ed4-1a64acdc636a None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:13.610097 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f6653c-ea20-4654-b885-b9b1010eaba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:13.610847 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f6653c-ea20-4654-b885-b9b1010eaba5 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:13.611233 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f6653c-ea20-4654-b885-b9b1010eaba5 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:13.611631 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f6653c-ea20-4654-b885-b9b1010eaba5 None admin] PATH_INFO: `/v3/projects/3cbe3de66eb54839bb11bf3ab8bc66f2` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:13.613568 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f6653c-ea20-4654-b885-b9b1010eaba5 None admin] RBAC: Authorizing `identity:get_project(project_id=3cbe3de66eb54839bb11bf3ab8bc66f2)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:13.615409 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f6653c-ea20-4654-b885-b9b1010eaba5 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:13.617385 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 69/137] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Aug 2 21:27:13 2022] GET /identity/v3/projects/3cbe3de66eb54839bb11bf3ab8bc66f2 => generated 312 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:13.618092 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f6653c-ea20-4654-b885-b9b1010eaba5 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:13.635374 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:13.643506 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 69/138] 10.222.0.70 () {58 vars in 1439 bytes} [Tue Aug 2 21:27:13 2022] PUT /identity/v3/projects/66ccc6e8e7254f0795008b4785dcdaa7/users/19d387c06a3e450fbcd87cab2ec693c1/roles/14ed906e656a4c1cabd17ceae4a1f872 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:27:13.645698 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b84b67-dbc3-4427-9ed4-1a64acdc636a None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:13.812499 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b84b67-dbc3-4427-9ed4-1a64acdc636a None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:13.813182 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:13.831101 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f6653c-ea20-4654-b885-b9b1010eaba5 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:13.876927 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db51047-72c3-452d-91a1-624ee3277543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:13.877975 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db51047-72c3-452d-91a1-624ee3277543 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:13.878285 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db51047-72c3-452d-91a1-624ee3277543 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:13.878568 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db51047-72c3-452d-91a1-624ee3277543 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:13.879777 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db51047-72c3-452d-91a1-624ee3277543 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:13.881825 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db51047-72c3-452d-91a1-624ee3277543 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:13.883501 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 70/139] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 2 21:27:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:13.889591 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db51047-72c3-452d-91a1-624ee3277543 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:13.898076 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2e1e14-04fb-4f60-82ec-79f185402134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:13.898779 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2e1e14-04fb-4f60-82ec-79f185402134 None admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:13.899065 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2e1e14-04fb-4f60-82ec-79f185402134 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:13.899360 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2e1e14-04fb-4f60-82ec-79f185402134 None admin] PATH_INFO: `/v3/projects/3cbe3de66eb54839bb11bf3ab8bc66f2/users/19d387c06a3e450fbcd87cab2ec693c1/roles/462e3381a85c42a9959201f9aa122f7c` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:13.901948 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2e1e14-04fb-4f60-82ec-79f185402134 None admin] RBAC: Authorizing `identity:create_grant(project_id=3cbe3de66eb54839bb11bf3ab8bc66f2, user_id=19d387c06a3e450fbcd87cab2ec693c1, role_id=462e3381a85c42a9959201f9aa122f7c)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:13.908492 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2e1e14-04fb-4f60-82ec-79f185402134 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:13.943702 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 70/140] 10.222.0.70 () {58 vars in 1439 bytes} [Tue Aug 2 21:27:13 2022] PUT /identity/v3/projects/3cbe3de66eb54839bb11bf3ab8bc66f2/users/19d387c06a3e450fbcd87cab2ec693c1/roles/462e3381a85c42a9959201f9aa122f7c => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:27:14.028297 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db51047-72c3-452d-91a1-624ee3277543 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:14.069056 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f94a62-3061-4253-9761-38b157c8aa57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:14.069617 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f94a62-3061-4253-9761-38b157c8aa57 None admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:14.069903 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f94a62-3061-4253-9761-38b157c8aa57 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:14.070181 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f94a62-3061-4253-9761-38b157c8aa57 None admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:14.070988 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f94a62-3061-4253-9761-38b157c8aa57 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:14.072495 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f94a62-3061-4253-9761-38b157c8aa57 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:14.109321 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 71/141] 10.222.0.70 () {60 vars in 1132 bytes} [Tue Aug 2 21:27:13 2022] POST /identity/v3/users => generated 283 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:27:14.351797 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57447de4-d3bb-4110-a972-e5c8c7466a8f None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:14.352311 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57447de4-d3bb-4110-a972-e5c8c7466a8f None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:14.352311 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57447de4-d3bb-4110-a972-e5c8c7466a8f None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:14.353684 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 71/142] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:27:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:27:14.361835 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b1e097-b024-486b-b6de-f627dd5965e2 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:14.362610 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b1e097-b024-486b-b6de-f627dd5965e2 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:14.362690 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b1e097-b024-486b-b6de-f627dd5965e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:14.383987 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-d9b1e097-b024-486b-b6de-f627dd5965e2 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:14.385282 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-d9b1e097-b024-486b-b6de-f627dd5965e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:14.388901 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:14.465794 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 72/143] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:27:14.489251 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57447de4-d3bb-4110-a972-e5c8c7466a8f None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:14.552466 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:14.597573 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57447de4-d3bb-4110-a972-e5c8c7466a8f None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:14.633089 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d313b8-3472-47d6-962d-b64bc6bd65a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:14.633667 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d313b8-3472-47d6-962d-b64bc6bd65a0 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:14.633953 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d313b8-3472-47d6-962d-b64bc6bd65a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:14.634231 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d313b8-3472-47d6-962d-b64bc6bd65a0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:14.645404 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d313b8-3472-47d6-962d-b64bc6bd65a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:27:14.650703 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-52d313b8-3472-47d6-962d-b64bc6bd65a0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 21:27:14.650703 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:14.650703 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:14.650703 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:14.650703 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:14.650703 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:14.650703 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:14.650703 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:14.650703 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:14.650703 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:14.650703 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:14.650703 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:14.650703 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:27:14.650703 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:27:14.650703 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:27:14.650703 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:27:14.651541 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:27:14.651541 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:27:14.651541 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:27:14.651541 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:27:14.651541 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:14.651541 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:14.651541 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:14.651541 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:14.651541 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:14.651541 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:14.651541 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:14.651541 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:14.651541 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:14.651541 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:14.651541 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:14.651541 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:14.652335 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:14.652335 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:14.652335 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:14.652335 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:14.652335 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:27:14.652335 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:27:14.652335 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:27:14.652335 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:27:14.652335 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:27:14.652335 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:27:14.652335 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 21:27:14.652335 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:27:14.652335 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 72/144] 10.222.0.70 () {56 vars in 1096 bytes} [Tue Aug 2 21:27:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:14.660413 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b1e097-b024-486b-b6de-f627dd5965e2 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:14.773514 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b1e097-b024-486b-b6de-f627dd5965e2 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:14.814491 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10f3277-3333-45cc-b12a-9657c8c93e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:14.815468 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f3277-3333-45cc-b12a-9657c8c93e3d None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:14.815964 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f3277-3333-45cc-b12a-9657c8c93e3d None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:14.816489 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f3277-3333-45cc-b12a-9657c8c93e3d None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:14.817494 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10f3277-3333-45cc-b12a-9657c8c93e3d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:14.817992 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10f3277-3333-45cc-b12a-9657c8c93e3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:14.819713 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10f3277-3333-45cc-b12a-9657c8c93e3d None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:14.831238 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 73/145] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 2 21:27:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:14.836428 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d313b8-3472-47d6-962d-b64bc6bd65a0 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:14.987608 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d313b8-3472-47d6-962d-b64bc6bd65a0 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:15.013534 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:15.033914 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a36a9f-3b99-48e8-ab7f-381978d85c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:15.034569 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a36a9f-3b99-48e8-ab7f-381978d85c28 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:15.034853 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a36a9f-3b99-48e8-ab7f-381978d85c28 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:15.035131 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a36a9f-3b99-48e8-ab7f-381978d85c28 None admin] PATH_INFO: `/v3/users/94e9c2ea79ff4d5fa5dea3f64a3c9a29` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:15.036576 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a36a9f-3b99-48e8-ab7f-381978d85c28 None admin] RBAC: Authorizing `identity:get_user(user_id=94e9c2ea79ff4d5fa5dea3f64a3c9a29)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:15.038030 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a36a9f-3b99-48e8-ab7f-381978d85c28 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:15.039630 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 73/146] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Aug 2 21:27:14 2022] GET /identity/v3/users/94e9c2ea79ff4d5fa5dea3f64a3c9a29 => generated 247 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:15.045324 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10f3277-3333-45cc-b12a-9657c8c93e3d None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:15.050939 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:15.242448 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10f3277-3333-45cc-b12a-9657c8c93e3d None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:15.291907 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79813112-ff08-4004-bd54-e3d0c4cc098d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:15.292957 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79813112-ff08-4004-bd54-e3d0c4cc098d None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:15.293759 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79813112-ff08-4004-bd54-e3d0c4cc098d None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:15.296333 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79813112-ff08-4004-bd54-e3d0c4cc098d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:15.382400 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79813112-ff08-4004-bd54-e3d0c4cc098d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:15.383885 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79813112-ff08-4004-bd54-e3d0c4cc098d None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:15.385763 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:15.506053 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 74/147] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 2 21:27:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 21:27:15.512781 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a36a9f-3b99-48e8-ab7f-381978d85c28 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:15.652266 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a36a9f-3b99-48e8-ab7f-381978d85c28 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:15.697089 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef22251-a843-4ac5-8f8b-9fde80f35ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:15.697753 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef22251-a843-4ac5-8f8b-9fde80f35ae2 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:15.698036 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef22251-a843-4ac5-8f8b-9fde80f35ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:15.698319 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef22251-a843-4ac5-8f8b-9fde80f35ae2 None admin] PATH_INFO: `/v3/projects/66ccc6e8e7254f0795008b4785dcdaa7` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:15.700047 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef22251-a843-4ac5-8f8b-9fde80f35ae2 None admin] RBAC: Authorizing `identity:get_project(project_id=66ccc6e8e7254f0795008b4785dcdaa7)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:15.701538 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef22251-a843-4ac5-8f8b-9fde80f35ae2 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:15.703199 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 74/148] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Aug 2 21:27:15 2022] GET /identity/v3/projects/66ccc6e8e7254f0795008b4785dcdaa7 => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:15.709249 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79813112-ff08-4004-bd54-e3d0c4cc098d None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:15.745137 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3fef6c-abfe-4d9a-bff3-5442867ce199 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:15.745450 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3fef6c-abfe-4d9a-bff3-5442867ce199 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:15.745710 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3fef6c-abfe-4d9a-bff3-5442867ce199 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:15.747262 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 75/149] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:27:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 21:27:15.760721 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdf3ec7-0b0d-4aca-b09a-863423558e84 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:15.760965 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdf3ec7-0b0d-4aca-b09a-863423558e84 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:15.761212 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdf3ec7-0b0d-4aca-b09a-863423558e84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:15.797249 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-6fdf3ec7-0b0d-4aca-b09a-863423558e84 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:15.798456 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-6fdf3ec7-0b0d-4aca-b09a-863423558e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:15.846133 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79813112-ff08-4004-bd54-e3d0c4cc098d None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:15.847949 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:15.887547 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d310ca2e-dd93-4cab-936a-229831ebd39a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:15.888242 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d310ca2e-dd93-4cab-936a-229831ebd39a None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:15.888539 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d310ca2e-dd93-4cab-936a-229831ebd39a None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:15.888814 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d310ca2e-dd93-4cab-936a-229831ebd39a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:15.889748 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d310ca2e-dd93-4cab-936a-229831ebd39a None admin] RBAC: Adding query filter params (role.id=3e32dbf75f9b41f5adb9fe59851267bb, scope.project.id=66ccc6e8e7254f0795008b4785dcdaa7, user.id=94e9c2ea79ff4d5fa5dea3f64a3c9a29) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:15.890128 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d310ca2e-dd93-4cab-936a-229831ebd39a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:15.891589 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d310ca2e-dd93-4cab-936a-229831ebd39a None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:15.898507 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 75/150] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Aug 2 21:27:15 2022] GET /identity/v3/role_assignments?user.id=94e9c2ea79ff4d5fa5dea3f64a3c9a29&scope.project.id=66ccc6e8e7254f0795008b4785dcdaa7&role.id=3e32dbf75f9b41f5adb9fe59851267bb => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:15.916982 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:15.940649 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 76/151] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 21:27:15.981519 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d310ca2e-dd93-4cab-936a-229831ebd39a None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:16.106346 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d310ca2e-dd93-4cab-936a-229831ebd39a None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:16.145714 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205e10d5-5bf3-4f00-af11-254e36d09852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:16.146374 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e10d5-5bf3-4f00-af11-254e36d09852 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:16.146657 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e10d5-5bf3-4f00-af11-254e36d09852 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:16.146934 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205e10d5-5bf3-4f00-af11-254e36d09852 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:16.158335 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205e10d5-5bf3-4f00-af11-254e36d09852 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:27:16.163432 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-205e10d5-5bf3-4f00-af11-254e36d09852 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 21:27:16.163432 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:16.163432 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:16.163432 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:16.163432 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:16.163432 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:16.163432 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:16.163432 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:16.163432 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:16.163432 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:16.163432 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:16.163432 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:16.163432 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:27:16.163432 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:27:16.163432 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:27:16.163432 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:27:16.164350 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:27:16.164350 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:27:16.164350 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:27:16.164350 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:27:16.164350 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:16.164350 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:16.164350 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:16.164350 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:16.164350 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:16.164350 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:16.164350 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:16.164350 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:16.164350 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:16.164350 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:16.164350 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:16.164350 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:16.165098 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:16.165098 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:16.165098 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:16.165098 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:16.165098 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:27:16.165098 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:27:16.165098 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:27:16.165098 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:27:16.165098 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:27:16.165098 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:27:16.165098 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 21:27:16.165098 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:27:16.165098 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 76/152] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 2 21:27:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:16.171184 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdf3ec7-0b0d-4aca-b09a-863423558e84 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:16.326287 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdf3ec7-0b0d-4aca-b09a-863423558e84 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:16.367748 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b018efc-829f-40c9-8b63-3db50aea2259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:16.368338 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b018efc-829f-40c9-8b63-3db50aea2259 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:16.368621 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b018efc-829f-40c9-8b63-3db50aea2259 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:16.368897 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b018efc-829f-40c9-8b63-3db50aea2259 None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:16.369621 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b018efc-829f-40c9-8b63-3db50aea2259 None admin] RBAC: Adding query filter params (name=member) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:16.369919 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b018efc-829f-40c9-8b63-3db50aea2259 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:16.371339 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b018efc-829f-40c9-8b63-3db50aea2259 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:16.383816 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 77/153] 10.222.0.70 () {56 vars in 1101 bytes} [Tue Aug 2 21:27:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:16.389649 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205e10d5-5bf3-4f00-af11-254e36d09852 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:16.436042 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:16.536470 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205e10d5-5bf3-4f00-af11-254e36d09852 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:16.576087 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898dc5b3-6d36-4211-a5ba-99c37e02c327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:16.576772 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898dc5b3-6d36-4211-a5ba-99c37e02c327 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:16.577061 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898dc5b3-6d36-4211-a5ba-99c37e02c327 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:16.577334 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898dc5b3-6d36-4211-a5ba-99c37e02c327 None admin] PATH_INFO: `/v3/users/19d387c06a3e450fbcd87cab2ec693c1` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:16.578600 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898dc5b3-6d36-4211-a5ba-99c37e02c327 None admin] RBAC: Authorizing `identity:get_user(user_id=19d387c06a3e450fbcd87cab2ec693c1)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:16.580069 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898dc5b3-6d36-4211-a5ba-99c37e02c327 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:16.581983 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 77/154] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Aug 2 21:27:16 2022] GET /identity/v3/users/19d387c06a3e450fbcd87cab2ec693c1 => generated 275 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:16.593376 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b018efc-829f-40c9-8b63-3db50aea2259 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:16.669545 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:16.731114 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b018efc-829f-40c9-8b63-3db50aea2259 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:16.774035 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14241a8-b658-474e-b2cb-426aab449072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:16.774661 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14241a8-b658-474e-b2cb-426aab449072 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:16.774978 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14241a8-b658-474e-b2cb-426aab449072 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:16.775265 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14241a8-b658-474e-b2cb-426aab449072 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:16.815837 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe31543-4d33-472a-8e92-3237d8524deb None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:16.816142 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe31543-4d33-472a-8e92-3237d8524deb None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:16.816440 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe31543-4d33-472a-8e92-3237d8524deb None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:16.818010 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 78/155] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:27:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:27:16.823201 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f9268-ca7a-4b3c-b3f6-48ebef497141 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:16.823482 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f9268-ca7a-4b3c-b3f6-48ebef497141 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:16.823759 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f9268-ca7a-4b3c-b3f6-48ebef497141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:16.857266 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-324f9268-ca7a-4b3c-b3f6-48ebef497141 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:16.859842 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-324f9268-ca7a-4b3c-b3f6-48ebef497141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:16.882846 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14241a8-b658-474e-b2cb-426aab449072 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:16.884371 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14241a8-b658-474e-b2cb-426aab449072 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:16.982540 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:16.993105 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 79/156] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 21:27:17.039215 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324f9268-ca7a-4b3c-b3f6-48ebef497141 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:17.060758 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 78/157] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 2 21:27:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 21:27:17.071966 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14241a8-b658-474e-b2cb-426aab449072 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:17.089114 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:17.209891 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324f9268-ca7a-4b3c-b3f6-48ebef497141 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:17.256561 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a96e64-836c-40a2-bd12-580a17e5327c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:17.257855 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a96e64-836c-40a2-bd12-580a17e5327c None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:17.258863 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a96e64-836c-40a2-bd12-580a17e5327c None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:17.259497 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a96e64-836c-40a2-bd12-580a17e5327c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:17.271868 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a96e64-836c-40a2-bd12-580a17e5327c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:27:17.278361 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-05a96e64-836c-40a2-bd12-580a17e5327c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 21:27:17.278361 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:17.278361 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:17.278361 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:17.278361 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:17.278361 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:17.278361 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:17.278361 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:17.278361 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:17.278361 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:17.278361 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:17.278361 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:17.278361 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:27:17.278361 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:27:17.278361 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:27:17.278361 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:27:17.279327 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:27:17.279327 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:27:17.279327 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:27:17.279327 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:27:17.279327 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:17.279327 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:17.279327 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:17.279327 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:17.279327 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:17.279327 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:17.279327 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:17.279327 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:17.279327 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:17.279327 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:17.279327 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:17.279327 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:17.280094 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:17.280094 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:17.280094 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:17.280094 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:17.280094 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:27:17.280094 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:27:17.280094 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:27:17.280094 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:27:17.280094 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:27:17.280094 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:27:17.280094 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 21:27:17.280094 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:27:17.284547 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14241a8-b658-474e-b2cb-426aab449072 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:17.293875 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 80/158] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 2 21:27:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 21:27:17.295433 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a83e458-ed35-4da0-87ee-64f0f8b50170 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:17.295889 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a83e458-ed35-4da0-87ee-64f0f8b50170 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:17.296360 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a83e458-ed35-4da0-87ee-64f0f8b50170 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:17.298643 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 81/159] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:27:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:27:17.304583 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27632cfb-ceaa-4d9e-972e-9232babde117 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:17.305033 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27632cfb-ceaa-4d9e-972e-9232babde117 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:17.305475 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27632cfb-ceaa-4d9e-972e-9232babde117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:17.327017 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-27632cfb-ceaa-4d9e-972e-9232babde117 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:17.328464 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-27632cfb-ceaa-4d9e-972e-9232babde117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:17.375035 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc219fe-35bf-41f4-8fab-4e541a9fc6f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:17.375855 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc219fe-35bf-41f4-8fab-4e541a9fc6f8 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:17.376405 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc219fe-35bf-41f4-8fab-4e541a9fc6f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:17.376638 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc219fe-35bf-41f4-8fab-4e541a9fc6f8 None admin] PATH_INFO: `/v3/projects/66ccc6e8e7254f0795008b4785dcdaa7` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:17.377919 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc219fe-35bf-41f4-8fab-4e541a9fc6f8 None admin] RBAC: Authorizing `identity:get_project(project_id=66ccc6e8e7254f0795008b4785dcdaa7)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:17.379467 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc219fe-35bf-41f4-8fab-4e541a9fc6f8 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:17.381473 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 79/160] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Aug 2 21:27:17 2022] GET /identity/v3/projects/66ccc6e8e7254f0795008b4785dcdaa7 => generated 298 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:27:17.389186 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc219fe-35bf-41f4-8fab-4e541a9fc6f8 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:17.418613 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:17.471776 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 82/161] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 21:27:17.473198 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27632cfb-ceaa-4d9e-972e-9232babde117 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:17.507665 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:17.573335 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc219fe-35bf-41f4-8fab-4e541a9fc6f8 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:17.626918 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c91376-3dd0-4e5c-bf01-80033d30da58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:17.628205 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c91376-3dd0-4e5c-bf01-80033d30da58 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:17.628677 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c91376-3dd0-4e5c-bf01-80033d30da58 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:17.629106 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c91376-3dd0-4e5c-bf01-80033d30da58 None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:17.629969 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c91376-3dd0-4e5c-bf01-80033d30da58 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:17.630410 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c91376-3dd0-4e5c-bf01-80033d30da58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:17.631943 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c91376-3dd0-4e5c-bf01-80033d30da58 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:17.648275 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 80/162] 10.222.0.70 () {56 vars in 1101 bytes} [Tue Aug 2 21:27:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:17.649419 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c91376-3dd0-4e5c-bf01-80033d30da58 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:17.694493 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27632cfb-ceaa-4d9e-972e-9232babde117 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:17.759345 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382a2c16-9fa5-4e2a-a1e3-8bf001335c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:17.760710 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382a2c16-9fa5-4e2a-a1e3-8bf001335c38 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:17.761295 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382a2c16-9fa5-4e2a-a1e3-8bf001335c38 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:17.761775 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382a2c16-9fa5-4e2a-a1e3-8bf001335c38 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:17.762729 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382a2c16-9fa5-4e2a-a1e3-8bf001335c38 None admin] RBAC: Adding query filter params (role.id=462e3381a85c42a9959201f9aa122f7c, scope.project.id=66ccc6e8e7254f0795008b4785dcdaa7, user.id=19d387c06a3e450fbcd87cab2ec693c1) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:17.763193 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382a2c16-9fa5-4e2a-a1e3-8bf001335c38 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:17.764986 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382a2c16-9fa5-4e2a-a1e3-8bf001335c38 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:17.778261 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 83/163] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Aug 2 21:27:17 2022] GET /identity/v3/role_assignments?user.id=19d387c06a3e450fbcd87cab2ec693c1&scope.project.id=66ccc6e8e7254f0795008b4785dcdaa7&role.id=462e3381a85c42a9959201f9aa122f7c => generated 608 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:17.779909 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382a2c16-9fa5-4e2a-a1e3-8bf001335c38 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:17.786680 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:17.839155 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c91376-3dd0-4e5c-bf01-80033d30da58 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:17.878146 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190f09fd-7cfc-43c6-82f8-50833bae0fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:17.878802 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f09fd-7cfc-43c6-82f8-50833bae0fef None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:17.879088 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f09fd-7cfc-43c6-82f8-50833bae0fef None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:17.879368 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190f09fd-7cfc-43c6-82f8-50833bae0fef None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:17.891758 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190f09fd-7cfc-43c6-82f8-50833bae0fef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:27:17.897769 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-190f09fd-7cfc-43c6-82f8-50833bae0fef None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 21:27:17.897769 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:17.897769 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:17.897769 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:17.897769 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:17.897769 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:17.897769 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:17.897769 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:17.897769 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:17.897769 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:17.897769 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:17.897769 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:17.897769 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:27:17.897769 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:27:17.897769 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:27:17.897769 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:27:17.898679 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:27:17.898679 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:27:17.898679 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:27:17.898679 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:27:17.898679 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:17.898679 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:17.898679 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:17.898679 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:17.898679 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:17.898679 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:17.898679 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:17.898679 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:17.898679 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:17.898679 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:17.898679 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:17.898679 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:17.899688 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:17.899688 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:17.899688 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:17.899688 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:17.899688 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:27:17.899688 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:27:17.899688 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:27:17.899688 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:27:17.899688 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:27:17.899688 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:27:17.899688 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 21:27:17.899688 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:27:17.899688 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 81/164] 10.222.0.70 () {56 vars in 1114 bytes} [Tue Aug 2 21:27:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:17.900669 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2d7c5d-74ae-4ff2-8618-9591891c659e None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:17.904675 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2d7c5d-74ae-4ff2-8618-9591891c659e None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:17.904969 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2d7c5d-74ae-4ff2-8618-9591891c659e None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:17.906530 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 82/165] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:27:17 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:27:17.908825 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2d7c5d-74ae-4ff2-8618-9591891c659e None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:17.978290 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:18.002831 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382a2c16-9fa5-4e2a-a1e3-8bf001335c38 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:18.044804 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be2e903-8ec6-4596-8ebd-f54f2bd482ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:18.045385 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be2e903-8ec6-4596-8ebd-f54f2bd482ae None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:18.045668 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be2e903-8ec6-4596-8ebd-f54f2bd482ae None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:18.046077 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be2e903-8ec6-4596-8ebd-f54f2bd482ae None admin] PATH_INFO: `/v3/users/f3be501a21084f37a3dbcea8181c9d84` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:18.047413 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be2e903-8ec6-4596-8ebd-f54f2bd482ae None admin] RBAC: Authorizing `identity:get_user(user_id=f3be501a21084f37a3dbcea8181c9d84)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:18.049082 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be2e903-8ec6-4596-8ebd-f54f2bd482ae None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:18.051604 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 84/166] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Aug 2 21:27:17 2022] GET /identity/v3/users/f3be501a21084f37a3dbcea8181c9d84 => generated 289 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:18.052825 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf819aa4-870b-4e96-bfda-2e3bbd67ff5d None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:18.053080 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf819aa4-870b-4e96-bfda-2e3bbd67ff5d None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:18.053360 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf819aa4-870b-4e96-bfda-2e3bbd67ff5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:18.074095 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-cf819aa4-870b-4e96-bfda-2e3bbd67ff5d None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:18.076028 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-cf819aa4-870b-4e96-bfda-2e3bbd67ff5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:18.153267 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 85/167] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:27:18.154149 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf819aa4-870b-4e96-bfda-2e3bbd67ff5d None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:18.160883 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2d7c5d-74ae-4ff2-8618-9591891c659e None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:18.238436 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:18.252931 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf4c34b-5579-48f0-a40b-5b1f016ae898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:18.253801 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf4c34b-5579-48f0-a40b-5b1f016ae898 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:18.254252 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf4c34b-5579-48f0-a40b-5b1f016ae898 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:18.254723 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf4c34b-5579-48f0-a40b-5b1f016ae898 None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:18.255582 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf4c34b-5579-48f0-a40b-5b1f016ae898 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:18.256026 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf4c34b-5579-48f0-a40b-5b1f016ae898 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:18.257583 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf4c34b-5579-48f0-a40b-5b1f016ae898 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:18.264029 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:18.268253 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf819aa4-870b-4e96-bfda-2e3bbd67ff5d None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:18.276325 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 83/168] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Aug 2 21:27:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:18.277603 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf4c34b-5579-48f0-a40b-5b1f016ae898 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:18.316352 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738b705b-7134-4f58-90fb-3691849743a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:18.317297 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738b705b-7134-4f58-90fb-3691849743a0 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:18.317867 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738b705b-7134-4f58-90fb-3691849743a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:18.318321 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738b705b-7134-4f58-90fb-3691849743a0 None admin] PATH_INFO: `/v3/projects/66ccc6e8e7254f0795008b4785dcdaa7` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:18.319689 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738b705b-7134-4f58-90fb-3691849743a0 None admin] RBAC: Authorizing `identity:get_project(project_id=66ccc6e8e7254f0795008b4785dcdaa7)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:18.321461 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738b705b-7134-4f58-90fb-3691849743a0 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:18.323326 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 86/169] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Aug 2 21:27:18 2022] GET /identity/v3/projects/66ccc6e8e7254f0795008b4785dcdaa7 => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:18.324889 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738b705b-7134-4f58-90fb-3691849743a0 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:18.436571 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738b705b-7134-4f58-90fb-3691849743a0 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:18.491531 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f00d07-00e1-4610-a0f1-6a594343e580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:18.492167 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f00d07-00e1-4610-a0f1-6a594343e580 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:18.492470 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f00d07-00e1-4610-a0f1-6a594343e580 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:18.492741 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f00d07-00e1-4610-a0f1-6a594343e580 None admin] PATH_INFO: `/v3/users/19d387c06a3e450fbcd87cab2ec693c1` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:18.494076 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f00d07-00e1-4610-a0f1-6a594343e580 None admin] RBAC: Authorizing `identity:get_user(user_id=19d387c06a3e450fbcd87cab2ec693c1)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:18.495544 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f00d07-00e1-4610-a0f1-6a594343e580 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:18.497221 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 87/170] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Aug 2 21:27:18 2022] GET /identity/v3/users/19d387c06a3e450fbcd87cab2ec693c1 => generated 275 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:18.502062 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f00d07-00e1-4610-a0f1-6a594343e580 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:18.520483 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf4c34b-5579-48f0-a40b-5b1f016ae898 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:18.533470 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:18.577697 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8972b6-c60b-4051-9f7c-8bf41c4273f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:18.578259 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8972b6-c60b-4051-9f7c-8bf41c4273f1 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:18.578540 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8972b6-c60b-4051-9f7c-8bf41c4273f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:18.578820 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8972b6-c60b-4051-9f7c-8bf41c4273f1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:18.589453 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8972b6-c60b-4051-9f7c-8bf41c4273f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:27:18.595274 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-2f8972b6-c60b-4051-9f7c-8bf41c4273f1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 21:27:18.595274 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:18.595274 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:18.595274 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:18.595274 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:18.595274 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:18.595274 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:18.595274 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:18.595274 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:18.595274 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:18.595274 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:18.595274 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:18.595274 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:27:18.595274 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:27:18.595274 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:27:18.595274 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:27:18.596139 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:27:18.596139 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:27:18.596139 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:27:18.596139 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:27:18.596139 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:18.596139 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:18.596139 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:18.596139 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:18.596139 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:18.596139 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:18.596139 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:18.596139 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:18.596139 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:18.596139 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:18.596139 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:18.596139 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:18.596961 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:18.596961 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:18.596961 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:18.596961 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:18.596961 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:27:18.596961 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:27:18.596961 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:27:18.596961 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:27:18.596961 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:27:18.596961 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:27:18.596961 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 21:27:18.596961 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:27:18.596961 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 84/171] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 2 21:27:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:18.598162 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8972b6-c60b-4051-9f7c-8bf41c4273f1 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:18.642897 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f00d07-00e1-4610-a0f1-6a594343e580 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:18.679824 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b160bd-e359-4c19-a6f5-2318f6da0c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:18.680377 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:18.681279 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b160bd-e359-4c19-a6f5-2318f6da0c37 None admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:18.681562 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b160bd-e359-4c19-a6f5-2318f6da0c37 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:18.681838 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b160bd-e359-4c19-a6f5-2318f6da0c37 None admin] PATH_INFO: `/v3/projects/66ccc6e8e7254f0795008b4785dcdaa7/users/f3be501a21084f37a3dbcea8181c9d84/roles/acc98d865c4f4f5cab9d993de06dae36` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:18.684581 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b160bd-e359-4c19-a6f5-2318f6da0c37 None admin] RBAC: Authorizing `identity:create_grant(project_id=66ccc6e8e7254f0795008b4785dcdaa7, user_id=f3be501a21084f37a3dbcea8181c9d84, role_id=acc98d865c4f4f5cab9d993de06dae36)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:18.686600 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b160bd-e359-4c19-a6f5-2318f6da0c37 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:18.702039 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 88/172] 10.222.0.70 () {58 vars in 1439 bytes} [Tue Aug 2 21:27:18 2022] PUT /identity/v3/projects/66ccc6e8e7254f0795008b4785dcdaa7/users/f3be501a21084f37a3dbcea8181c9d84/roles/acc98d865c4f4f5cab9d993de06dae36 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:27:18.703841 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faf0a55-a39c-4cdd-8a95-87189ee80299 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:18.704126 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faf0a55-a39c-4cdd-8a95-87189ee80299 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:18.704429 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faf0a55-a39c-4cdd-8a95-87189ee80299 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:18.706466 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 89/173] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:27:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:27:18.707173 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faf0a55-a39c-4cdd-8a95-87189ee80299 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:18.758430 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8972b6-c60b-4051-9f7c-8bf41c4273f1 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:18.830821 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb848a0f-46d5-4d1e-8e1b-94a9359bc713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:18.831431 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb848a0f-46d5-4d1e-8e1b-94a9359bc713 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:18.831716 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb848a0f-46d5-4d1e-8e1b-94a9359bc713 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:18.831989 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb848a0f-46d5-4d1e-8e1b-94a9359bc713 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:18.839384 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:18.881996 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faf0a55-a39c-4cdd-8a95-87189ee80299 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:18.923573 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70779cb-150b-4752-bfa6-b49c0fe13c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:18.924190 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70779cb-150b-4752-bfa6-b49c0fe13c11 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:18.926277 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70779cb-150b-4752-bfa6-b49c0fe13c11 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:18.926277 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70779cb-150b-4752-bfa6-b49c0fe13c11 None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:18.926277 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70779cb-150b-4752-bfa6-b49c0fe13c11 None admin] RBAC: Adding query filter params (name=member) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:18.926277 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70779cb-150b-4752-bfa6-b49c0fe13c11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:18.927233 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70779cb-150b-4752-bfa6-b49c0fe13c11 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:18.930548 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb848a0f-46d5-4d1e-8e1b-94a9359bc713 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:18.932081 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb848a0f-46d5-4d1e-8e1b-94a9359bc713 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:18.935656 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 90/174] 10.222.0.70 () {56 vars in 1101 bytes} [Tue Aug 2 21:27:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:18.937217 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efecabf-2028-4858-b804-9438b766149f None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:18.937575 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efecabf-2028-4858-b804-9438b766149f None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:18.937919 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efecabf-2028-4858-b804-9438b766149f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:18.955924 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-4efecabf-2028-4858-b804-9438b766149f None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:18.957225 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-4efecabf-2028-4858-b804-9438b766149f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:19.005815 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:19.029861 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 91/175] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:27:19.031418 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1744c4a4-e1e3-4e9b-b874-ecd6e046437a None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:19.031773 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1744c4a4-e1e3-4e9b-b874-ecd6e046437a None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:19.032116 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1744c4a4-e1e3-4e9b-b874-ecd6e046437a None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:19.033741 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 92/176] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:27:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:27:19.034639 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1744c4a4-e1e3-4e9b-b874-ecd6e046437a None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:19.070608 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 85/177] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 2 21:27:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 21:27:19.071875 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a236806-b51c-40f7-b8e1-754374508024 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:19.072165 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a236806-b51c-40f7-b8e1-754374508024 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:19.072457 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a236806-b51c-40f7-b8e1-754374508024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:19.090727 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-1a236806-b51c-40f7-b8e1-754374508024 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:19.091919 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-1a236806-b51c-40f7-b8e1-754374508024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:19.104823 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:19.147052 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1744c4a4-e1e3-4e9b-b874-ecd6e046437a None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:19.165471 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 86/178] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:27:19.166397 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a236806-b51c-40f7-b8e1-754374508024 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:19.185401 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ed503a-b615-4d54-898a-98968a3e1c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:19.186432 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ed503a-b615-4d54-898a-98968a3e1c70 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:19.187007 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ed503a-b615-4d54-898a-98968a3e1c70 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:19.187531 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ed503a-b615-4d54-898a-98968a3e1c70 None admin] PATH_INFO: `/v3/users/19d387c06a3e450fbcd87cab2ec693c1` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:19.188772 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ed503a-b615-4d54-898a-98968a3e1c70 None admin] RBAC: Authorizing `identity:get_user(user_id=19d387c06a3e450fbcd87cab2ec693c1)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:19.190232 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ed503a-b615-4d54-898a-98968a3e1c70 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:19.192120 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 93/179] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Aug 2 21:27:19 2022] GET /identity/v3/users/19d387c06a3e450fbcd87cab2ec693c1 => generated 275 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:19.193301 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9aefac-7616-4dda-aa3c-1ef621d04b9e None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:19.193587 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9aefac-7616-4dda-aa3c-1ef621d04b9e None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:19.193865 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9aefac-7616-4dda-aa3c-1ef621d04b9e None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:19.195227 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 94/180] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:27:19 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:27:19.195796 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9aefac-7616-4dda-aa3c-1ef621d04b9e None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:19.270931 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:19.291356 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a236806-b51c-40f7-b8e1-754374508024 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:19.316657 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9aefac-7616-4dda-aa3c-1ef621d04b9e None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:19.330992 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c4f7db-4882-4ae1-a56b-06602bdbd63b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:19.331644 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c4f7db-4882-4ae1-a56b-06602bdbd63b None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:19.331924 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c4f7db-4882-4ae1-a56b-06602bdbd63b None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:19.332201 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c4f7db-4882-4ae1-a56b-06602bdbd63b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:19.343617 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c4f7db-4882-4ae1-a56b-06602bdbd63b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:27:19.347834 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:19.348527 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-f3c4f7db-4882-4ae1-a56b-06602bdbd63b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 21:27:19.348527 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:19.348527 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:19.348527 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:19.348527 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:19.348527 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:19.348527 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:19.348527 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:19.348527 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:19.348527 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:19.348527 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:19.348527 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:19.348527 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:27:19.348527 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:27:19.348527 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:27:19.348527 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:27:19.349386 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:27:19.349386 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:27:19.349386 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:27:19.349386 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:27:19.349386 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:19.349386 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:19.349386 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:19.349386 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:19.349386 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:19.349386 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:19.349386 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:19.349386 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:19.349386 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:19.349386 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:19.349386 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:19.349386 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:19.350158 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:19.350158 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:19.350158 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:19.350158 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:19.350158 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:27:19.350158 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:27:19.350158 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:27:19.350158 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:27:19.350158 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:27:19.350158 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:27:19.350158 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 21:27:19.350158 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:27:19.350158 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 87/181] 10.222.0.70 () {56 vars in 1096 bytes} [Tue Aug 2 21:27:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:19.355341 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c4f7db-4882-4ae1-a56b-06602bdbd63b None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:19.358475 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a0b739-8bd0-47f4-87c0-856ce48508e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:19.359657 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a0b739-8bd0-47f4-87c0-856ce48508e0 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:19.360624 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a0b739-8bd0-47f4-87c0-856ce48508e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:19.360914 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a0b739-8bd0-47f4-87c0-856ce48508e0 None admin] PATH_INFO: `/v3/projects/66ccc6e8e7254f0795008b4785dcdaa7` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:19.362116 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a0b739-8bd0-47f4-87c0-856ce48508e0 None admin] RBAC: Authorizing `identity:get_project(project_id=66ccc6e8e7254f0795008b4785dcdaa7)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:19.363818 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a0b739-8bd0-47f4-87c0-856ce48508e0 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:19.368832 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 95/182] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Aug 2 21:27:19 2022] GET /identity/v3/projects/66ccc6e8e7254f0795008b4785dcdaa7 => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:19.368832 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a0b739-8bd0-47f4-87c0-856ce48508e0 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:19.468464 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a0b739-8bd0-47f4-87c0-856ce48508e0 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:19.469538 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c4f7db-4882-4ae1-a56b-06602bdbd63b None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:19.506503 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef57f39-a6cd-463d-afd8-947b883dee3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:19.507292 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa490a4-a64d-44f1-a395-4c04c3fe41cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:19.507944 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa490a4-a64d-44f1-a395-4c04c3fe41cd None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:19.508225 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa490a4-a64d-44f1-a395-4c04c3fe41cd None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:19.508530 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa490a4-a64d-44f1-a395-4c04c3fe41cd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:19.509048 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef57f39-a6cd-463d-afd8-947b883dee3b None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:19.509826 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef57f39-a6cd-463d-afd8-947b883dee3b None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:19.510857 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef57f39-a6cd-463d-afd8-947b883dee3b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:19.524446 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa490a4-a64d-44f1-a395-4c04c3fe41cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:27:19.531782 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-eaa490a4-a64d-44f1-a395-4c04c3fe41cd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 21:27:19.531782 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:19.531782 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:19.531782 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:19.531782 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:19.531782 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:19.531782 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:19.531782 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:19.531782 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:19.531782 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:19.531782 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:19.531782 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:19.531782 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:27:19.531782 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:27:19.531782 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:27:19.531782 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:27:19.532717 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:27:19.532717 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:27:19.532717 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:27:19.532717 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:27:19.532717 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:19.532717 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:19.532717 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:19.532717 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:19.532717 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:19.532717 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:19.532717 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:19.532717 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:19.532717 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:19.532717 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:19.532717 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:19.532717 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:19.533539 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:19.533539 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:19.533539 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:19.533539 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:19.533539 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:27:19.533539 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:27:19.533539 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:27:19.533539 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:27:19.533539 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:27:19.533539 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:27:19.533539 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 21:27:19.533539 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:27:19.533539 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 88/183] 10.222.0.70 () {56 vars in 1114 bytes} [Tue Aug 2 21:27:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:19.534761 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dbf5bb-0bc0-4c8f-8474-82a47ba22c53 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:19.534858 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dbf5bb-0bc0-4c8f-8474-82a47ba22c53 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:19.535109 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dbf5bb-0bc0-4c8f-8474-82a47ba22c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:19.555561 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-79dbf5bb-0bc0-4c8f-8474-82a47ba22c53 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:19.557179 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-79dbf5bb-0bc0-4c8f-8474-82a47ba22c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:19.559736 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:19.586023 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:19.588846 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef57f39-a6cd-463d-afd8-947b883dee3b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:19.591066 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef57f39-a6cd-463d-afd8-947b883dee3b None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:19.631353 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 89/184] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:27:19.632492 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dbf5bb-0bc0-4c8f-8474-82a47ba22c53 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:19.710597 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 96/185] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 2 21:27:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 21:27:19.711604 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef57f39-a6cd-463d-afd8-947b883dee3b None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:19.740585 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dbf5bb-0bc0-4c8f-8474-82a47ba22c53 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:19.775661 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6785b7-67f6-4c1e-b559-d2e025e7235f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:19.776604 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6785b7-67f6-4c1e-b559-d2e025e7235f None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:19.777123 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6785b7-67f6-4c1e-b559-d2e025e7235f None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:19.778043 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6785b7-67f6-4c1e-b559-d2e025e7235f None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:19.778890 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6785b7-67f6-4c1e-b559-d2e025e7235f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:19.779332 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6785b7-67f6-4c1e-b559-d2e025e7235f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:19.781113 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6785b7-67f6-4c1e-b559-d2e025e7235f None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:19.786644 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:19.796492 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 90/186] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 2 21:27:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:19.797363 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6785b7-67f6-4c1e-b559-d2e025e7235f None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:19.813798 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:19.817653 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef57f39-a6cd-463d-afd8-947b883dee3b None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:19.854018 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e7885c-71e5-40c4-9180-f5fea7af1538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:19.854647 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e7885c-71e5-40c4-9180-f5fea7af1538 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:19.854937 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e7885c-71e5-40c4-9180-f5fea7af1538 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:19.855219 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e7885c-71e5-40c4-9180-f5fea7af1538 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:19.856619 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e7885c-71e5-40c4-9180-f5fea7af1538 None admin] RBAC: Adding query filter params (role.id=14ed906e656a4c1cabd17ceae4a1f872, scope.project.id=66ccc6e8e7254f0795008b4785dcdaa7, user.id=19d387c06a3e450fbcd87cab2ec693c1) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:19.856937 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e7885c-71e5-40c4-9180-f5fea7af1538 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:19.858548 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e7885c-71e5-40c4-9180-f5fea7af1538 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:19.868355 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 97/187] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Aug 2 21:27:19 2022] GET /identity/v3/role_assignments?user.id=19d387c06a3e450fbcd87cab2ec693c1&scope.project.id=66ccc6e8e7254f0795008b4785dcdaa7&role.id=14ed906e656a4c1cabd17ceae4a1f872 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:19.868355 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e7885c-71e5-40c4-9180-f5fea7af1538 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:19.930770 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6785b7-67f6-4c1e-b559-d2e025e7235f None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:19.972658 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c6d79a-4177-470a-95d3-a53dd3608bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:19.973640 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c6d79a-4177-470a-95d3-a53dd3608bad None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:19.974101 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c6d79a-4177-470a-95d3-a53dd3608bad None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:19.974552 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c6d79a-4177-470a-95d3-a53dd3608bad None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:19.975554 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c6d79a-4177-470a-95d3-a53dd3608bad None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:19.976104 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c6d79a-4177-470a-95d3-a53dd3608bad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:19.977772 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c6d79a-4177-470a-95d3-a53dd3608bad None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:19.988131 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 91/188] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Aug 2 21:27:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:19.989240 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c6d79a-4177-470a-95d3-a53dd3608bad None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:19.994372 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e7885c-71e5-40c4-9180-f5fea7af1538 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:20.034576 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e15443-7dc0-4935-a13d-bcb22a65ca4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:20.035236 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e15443-7dc0-4935-a13d-bcb22a65ca4b None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:20.035524 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e15443-7dc0-4935-a13d-bcb22a65ca4b None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:20.035803 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e15443-7dc0-4935-a13d-bcb22a65ca4b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:20.037104 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e15443-7dc0-4935-a13d-bcb22a65ca4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:20.038685 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e15443-7dc0-4935-a13d-bcb22a65ca4b None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:20.040587 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 98/189] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 2 21:27:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:20.041347 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e15443-7dc0-4935-a13d-bcb22a65ca4b None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:20.059929 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:20.079458 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:20.110922 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c6d79a-4177-470a-95d3-a53dd3608bad None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:20.151448 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b283e730-683a-4e50-904c-1684fdeb30f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:20.152113 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b283e730-683a-4e50-904c-1684fdeb30f5 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:20.153027 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b283e730-683a-4e50-904c-1684fdeb30f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:20.153315 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b283e730-683a-4e50-904c-1684fdeb30f5 None admin] PATH_INFO: `/v3/projects/3cbe3de66eb54839bb11bf3ab8bc66f2` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:20.154591 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b283e730-683a-4e50-904c-1684fdeb30f5 None admin] RBAC: Authorizing `identity:get_project(project_id=3cbe3de66eb54839bb11bf3ab8bc66f2)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:20.156053 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b283e730-683a-4e50-904c-1684fdeb30f5 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:20.157975 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 92/190] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Aug 2 21:27:19 2022] GET /identity/v3/projects/3cbe3de66eb54839bb11bf3ab8bc66f2 => generated 312 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:20.158553 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b283e730-683a-4e50-904c-1684fdeb30f5 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:20.166450 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e15443-7dc0-4935-a13d-bcb22a65ca4b None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:20.203027 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38f4cec-644a-472e-a945-aae6b4372ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:20.203964 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38f4cec-644a-472e-a945-aae6b4372ff3 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:20.204437 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38f4cec-644a-472e-a945-aae6b4372ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:20.204721 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38f4cec-644a-472e-a945-aae6b4372ff3 None admin] PATH_INFO: `/v3/users/deffc34201024488be9585982829564b` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:20.219814 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38f4cec-644a-472e-a945-aae6b4372ff3 None admin] RBAC: Authorizing `identity:get_user(user_id=deffc34201024488be9585982829564b)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:20.221389 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38f4cec-644a-472e-a945-aae6b4372ff3 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:20.223259 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 99/191] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Aug 2 21:27:20 2022] GET /identity/v3/users/deffc34201024488be9585982829564b => generated 283 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:20.224004 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38f4cec-644a-472e-a945-aae6b4372ff3 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:20.266490 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b283e730-683a-4e50-904c-1684fdeb30f5 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:20.301597 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:20.308291 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9717693d-3f2a-4d86-b448-675433dcff11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:20.309706 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9717693d-3f2a-4d86-b448-675433dcff11 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:20.310168 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9717693d-3f2a-4d86-b448-675433dcff11 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:20.310621 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9717693d-3f2a-4d86-b448-675433dcff11 None admin] PATH_INFO: `/v3/users/deffc34201024488be9585982829564b` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:20.311980 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9717693d-3f2a-4d86-b448-675433dcff11 None admin] RBAC: Authorizing `identity:get_user(user_id=deffc34201024488be9585982829564b)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:20.313683 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9717693d-3f2a-4d86-b448-675433dcff11 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:20.315496 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 93/192] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Aug 2 21:27:20 2022] GET /identity/v3/users/deffc34201024488be9585982829564b => generated 283 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:20.316473 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9717693d-3f2a-4d86-b448-675433dcff11 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:20.334879 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:20.346981 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38f4cec-644a-472e-a945-aae6b4372ff3 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:20.385696 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf0b763-8f19-4767-82b7-68a2ce844ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:20.386477 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf0b763-8f19-4767-82b7-68a2ce844ca4 None admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:20.387385 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf0b763-8f19-4767-82b7-68a2ce844ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:20.387733 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf0b763-8f19-4767-82b7-68a2ce844ca4 None admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:20.388548 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf0b763-8f19-4767-82b7-68a2ce844ca4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:20.390080 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf0b763-8f19-4767-82b7-68a2ce844ca4 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:20.414748 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 100/193] 10.222.0.70 () {60 vars in 1132 bytes} [Tue Aug 2 21:27:20 2022] POST /identity/v3/users => generated 297 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:27:20.421270 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf0b763-8f19-4767-82b7-68a2ce844ca4 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:20.428892 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9717693d-3f2a-4d86-b448-675433dcff11 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:20.469793 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134b76e9-621d-4dcf-947a-8f9931cc12d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:20.470390 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134b76e9-621d-4dcf-947a-8f9931cc12d8 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:20.470684 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134b76e9-621d-4dcf-947a-8f9931cc12d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:20.470962 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134b76e9-621d-4dcf-947a-8f9931cc12d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:20.471768 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134b76e9-621d-4dcf-947a-8f9931cc12d8 None admin] RBAC: Adding query filter params (role.id=462e3381a85c42a9959201f9aa122f7c, scope.project.id=3cbe3de66eb54839bb11bf3ab8bc66f2, user.id=19d387c06a3e450fbcd87cab2ec693c1) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:20.472088 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134b76e9-621d-4dcf-947a-8f9931cc12d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:20.473714 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134b76e9-621d-4dcf-947a-8f9931cc12d8 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:20.485215 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 94/194] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Aug 2 21:27:20 2022] GET /identity/v3/role_assignments?user.id=19d387c06a3e450fbcd87cab2ec693c1&scope.project.id=3cbe3de66eb54839bb11bf3ab8bc66f2&role.id=462e3381a85c42a9959201f9aa122f7c => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:20.485215 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134b76e9-621d-4dcf-947a-8f9931cc12d8 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:20.617945 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:20.619105 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf0b763-8f19-4767-82b7-68a2ce844ca4 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:20.673524 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5de94f-e9ac-4731-9079-9e2b2cce01a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:20.674570 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5de94f-e9ac-4731-9079-9e2b2cce01a1 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:20.674869 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5de94f-e9ac-4731-9079-9e2b2cce01a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:20.675151 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5de94f-e9ac-4731-9079-9e2b2cce01a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:20.679701 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134b76e9-621d-4dcf-947a-8f9931cc12d8 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:20.699702 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:20.726663 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c227a0e4-5e13-4566-abc2-f6fdd02348b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:20.727384 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c227a0e4-5e13-4566-abc2-f6fdd02348b9 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:20.727669 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c227a0e4-5e13-4566-abc2-f6fdd02348b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:20.727952 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c227a0e4-5e13-4566-abc2-f6fdd02348b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:20.781048 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5de94f-e9ac-4731-9079-9e2b2cce01a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:20.782554 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5de94f-e9ac-4731-9079-9e2b2cce01a1 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:20.831516 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c227a0e4-5e13-4566-abc2-f6fdd02348b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:20.833182 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c227a0e4-5e13-4566-abc2-f6fdd02348b9 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:20.914514 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 101/195] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 2 21:27:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 21:27:20.915852 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384a3016-02a9-413d-a307-484e3ad6eb47 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:20.915985 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384a3016-02a9-413d-a307-484e3ad6eb47 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:20.916204 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384a3016-02a9-413d-a307-484e3ad6eb47 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:20.918566 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:20.921859 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 102/196] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:27:20 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:27:20.923633 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384a3016-02a9-413d-a307-484e3ad6eb47 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:20.972574 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 95/197] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 2 21:27:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 21:27:20.974137 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe51cfa0-0103-4a86-b576-47b145dcfc9f None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:20.974600 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe51cfa0-0103-4a86-b576-47b145dcfc9f None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:20.975013 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe51cfa0-0103-4a86-b576-47b145dcfc9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:20.990372 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:20.998696 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-fe51cfa0-0103-4a86-b576-47b145dcfc9f None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:21.000621 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-fe51cfa0-0103-4a86-b576-47b145dcfc9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:21.046128 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384a3016-02a9-413d-a307-484e3ad6eb47 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:21.081587 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 96/198] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:27:21.082764 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe51cfa0-0103-4a86-b576-47b145dcfc9f None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:21.093448 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da4a923-d2d1-42e6-8c08-d0380e0b672b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:21.094353 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da4a923-d2d1-42e6-8c08-d0380e0b672b None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:21.095133 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da4a923-d2d1-42e6-8c08-d0380e0b672b None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:21.095561 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da4a923-d2d1-42e6-8c08-d0380e0b672b None admin] PATH_INFO: `/v3/projects/73bf4e4564964659b960ebf8920609ff` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:21.097537 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da4a923-d2d1-42e6-8c08-d0380e0b672b None admin] RBAC: Authorizing `identity:get_project(project_id=73bf4e4564964659b960ebf8920609ff)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:21.099310 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da4a923-d2d1-42e6-8c08-d0380e0b672b None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:21.102173 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 103/199] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Aug 2 21:27:20 2022] GET /identity/v3/projects/73bf4e4564964659b960ebf8920609ff => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:27:21.110002 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da4a923-d2d1-42e6-8c08-d0380e0b672b None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:21.198127 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:21.209722 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe51cfa0-0103-4a86-b576-47b145dcfc9f None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:21.222124 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da4a923-d2d1-42e6-8c08-d0380e0b672b None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:21.237155 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:21.259711 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d0874c-2705-4f0d-9e8f-a3a6d0a82b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:21.260495 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d0874c-2705-4f0d-9e8f-a3a6d0a82b96 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:21.261144 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d0874c-2705-4f0d-9e8f-a3a6d0a82b96 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:21.261521 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d0874c-2705-4f0d-9e8f-a3a6d0a82b96 None admin] PATH_INFO: `/v3/projects/73bf4e4564964659b960ebf8920609ff` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:21.263721 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d0874c-2705-4f0d-9e8f-a3a6d0a82b96 None admin] RBAC: Authorizing `identity:get_project(project_id=73bf4e4564964659b960ebf8920609ff)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:21.265422 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d0874c-2705-4f0d-9e8f-a3a6d0a82b96 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:21.265540 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c19330-551e-412b-8afa-4149f55529dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:21.266180 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c19330-551e-412b-8afa-4149f55529dd None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:21.266539 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c19330-551e-412b-8afa-4149f55529dd None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:21.266948 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c19330-551e-412b-8afa-4149f55529dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:21.267442 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 97/200] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Aug 2 21:27:21 2022] GET /identity/v3/projects/73bf4e4564964659b960ebf8920609ff => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:21.268209 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c19330-551e-412b-8afa-4149f55529dd None admin] RBAC: Adding query filter params (role.id=3e32dbf75f9b41f5adb9fe59851267bb, scope.project.id=73bf4e4564964659b960ebf8920609ff, user.id=deffc34201024488be9585982829564b) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:21.268680 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c19330-551e-412b-8afa-4149f55529dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:21.270185 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c19330-551e-412b-8afa-4149f55529dd None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:21.273005 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d0874c-2705-4f0d-9e8f-a3a6d0a82b96 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:21.276800 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 104/201] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Aug 2 21:27:21 2022] GET /identity/v3/role_assignments?user.id=deffc34201024488be9585982829564b&scope.project.id=73bf4e4564964659b960ebf8920609ff&role.id=3e32dbf75f9b41f5adb9fe59851267bb => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:21.288198 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c19330-551e-412b-8afa-4149f55529dd None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:21.399135 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d0874c-2705-4f0d-9e8f-a3a6d0a82b96 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:21.442173 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dfc9a4-a5d4-4151-8b62-1a6296da3585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:21.442833 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dfc9a4-a5d4-4151-8b62-1a6296da3585 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:21.443115 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dfc9a4-a5d4-4151-8b62-1a6296da3585 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:21.443388 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dfc9a4-a5d4-4151-8b62-1a6296da3585 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:21.455571 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dfc9a4-a5d4-4151-8b62-1a6296da3585 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:27:21.461067 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-c0dfc9a4-a5d4-4151-8b62-1a6296da3585 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 21:27:21.461067 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:21.461067 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:21.461067 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:21.461067 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:21.461067 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:21.461067 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:21.461067 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:21.461067 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:21.461067 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:21.461067 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:21.461067 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:21.461067 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:27:21.461067 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:27:21.461067 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:27:21.461067 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:27:21.462049 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:27:21.462049 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:27:21.462049 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:27:21.462049 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:27:21.462049 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:21.462049 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:21.462049 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:21.462049 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:21.462049 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:21.462049 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:21.462049 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:21.462049 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:21.462049 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:21.462049 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:21.462049 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:21.462049 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:21.462847 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:21.462847 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:21.462847 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:21.462847 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:21.462847 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:27:21.462847 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:27:21.462847 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:27:21.462847 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:27:21.462847 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:27:21.462847 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:27:21.462847 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 21:27:21.462847 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:27:21.462847 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 98/202] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 2 21:27:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:21.469297 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dfc9a4-a5d4-4151-8b62-1a6296da3585 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:21.509692 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:21.554064 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c19330-551e-412b-8afa-4149f55529dd None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:21.623726 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65ab2a0-a13f-4bd5-abc9-da4ae48ac9c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:21.624358 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65ab2a0-a13f-4bd5-abc9-da4ae48ac9c8 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:21.624651 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65ab2a0-a13f-4bd5-abc9-da4ae48ac9c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:21.624930 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65ab2a0-a13f-4bd5-abc9-da4ae48ac9c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:21.625741 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65ab2a0-a13f-4bd5-abc9-da4ae48ac9c8 None admin] RBAC: Adding query filter params (role.id=14ed906e656a4c1cabd17ceae4a1f872, scope.project.id=73bf4e4564964659b960ebf8920609ff, user.id=deffc34201024488be9585982829564b) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:21.626059 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65ab2a0-a13f-4bd5-abc9-da4ae48ac9c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:21.627511 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65ab2a0-a13f-4bd5-abc9-da4ae48ac9c8 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:21.635833 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 105/203] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Aug 2 21:27:21 2022] GET /identity/v3/role_assignments?user.id=deffc34201024488be9585982829564b&scope.project.id=73bf4e4564964659b960ebf8920609ff&role.id=14ed906e656a4c1cabd17ceae4a1f872 => generated 259 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:21.660979 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dfc9a4-a5d4-4151-8b62-1a6296da3585 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:21.721054 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c59063-4b93-40b1-ba5f-4ef6fa8e2b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:21.721788 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c59063-4b93-40b1-ba5f-4ef6fa8e2b7a None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:21.722079 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c59063-4b93-40b1-ba5f-4ef6fa8e2b7a None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:21.722367 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c59063-4b93-40b1-ba5f-4ef6fa8e2b7a None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:21.723118 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c59063-4b93-40b1-ba5f-4ef6fa8e2b7a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:21.723429 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c59063-4b93-40b1-ba5f-4ef6fa8e2b7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:21.724886 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c59063-4b93-40b1-ba5f-4ef6fa8e2b7a None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:21.735268 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 99/204] 10.222.0.70 () {56 vars in 1101 bytes} [Tue Aug 2 21:27:21 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:27:21.741114 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65ab2a0-a13f-4bd5-abc9-da4ae48ac9c8 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:21.826073 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:21.901844 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65ab2a0-a13f-4bd5-abc9-da4ae48ac9c8 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:21.966477 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5162ea-d478-4522-9b38-00dd6027d12a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:21.967153 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5162ea-d478-4522-9b38-00dd6027d12a None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:21.967442 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5162ea-d478-4522-9b38-00dd6027d12a None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:21.967724 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5162ea-d478-4522-9b38-00dd6027d12a None admin] PATH_INFO: `/v3/users/f3be501a21084f37a3dbcea8181c9d84` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:21.973204 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5162ea-d478-4522-9b38-00dd6027d12a None admin] RBAC: Authorizing `identity:get_user(user_id=f3be501a21084f37a3dbcea8181c9d84)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:21.974760 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5162ea-d478-4522-9b38-00dd6027d12a None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:21.976944 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 106/205] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Aug 2 21:27:21 2022] GET /identity/v3/users/f3be501a21084f37a3dbcea8181c9d84 => generated 289 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:21.989427 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c59063-4b93-40b1-ba5f-4ef6fa8e2b7a None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:22.119435 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:22.143015 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c59063-4b93-40b1-ba5f-4ef6fa8e2b7a None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:22.188811 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c805749d-63f5-415a-8926-caa253c1e385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:22.189454 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c805749d-63f5-415a-8926-caa253c1e385 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:22.189742 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c805749d-63f5-415a-8926-caa253c1e385 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:22.190025 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c805749d-63f5-415a-8926-caa253c1e385 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:22.289326 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c805749d-63f5-415a-8926-caa253c1e385 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:22.289326 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c805749d-63f5-415a-8926-caa253c1e385 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:22.405394 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:22.429121 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 100/206] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 2 21:27:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 21:27:22.434991 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5162ea-d478-4522-9b38-00dd6027d12a None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:22.545982 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5162ea-d478-4522-9b38-00dd6027d12a None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:22.560278 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:22.604945 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf293810-0d02-4199-ad34-81d8888fa86e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:22.605638 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf293810-0d02-4199-ad34-81d8888fa86e None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:22.605929 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf293810-0d02-4199-ad34-81d8888fa86e None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:22.606211 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf293810-0d02-4199-ad34-81d8888fa86e None admin] PATH_INFO: `/v3/projects/66ccc6e8e7254f0795008b4785dcdaa7` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:22.607434 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf293810-0d02-4199-ad34-81d8888fa86e None admin] RBAC: Authorizing `identity:get_project(project_id=66ccc6e8e7254f0795008b4785dcdaa7)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:22.608940 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf293810-0d02-4199-ad34-81d8888fa86e None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:22.610931 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 107/207] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Aug 2 21:27:22 2022] GET /identity/v3/projects/66ccc6e8e7254f0795008b4785dcdaa7 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:22.617121 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c805749d-63f5-415a-8926-caa253c1e385 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:22.763950 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c805749d-63f5-415a-8926-caa253c1e385 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:22.811583 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5decb8df-4af4-477e-9e93-c4d83193e83c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:22.812220 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5decb8df-4af4-477e-9e93-c4d83193e83c None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:22.812534 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5decb8df-4af4-477e-9e93-c4d83193e83c None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:22.812818 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5decb8df-4af4-477e-9e93-c4d83193e83c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:22.813619 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5decb8df-4af4-477e-9e93-c4d83193e83c None admin] RBAC: Adding query filter params (role.id=acc98d865c4f4f5cab9d993de06dae36, scope.project.id=66ccc6e8e7254f0795008b4785dcdaa7, user.id=f3be501a21084f37a3dbcea8181c9d84) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:22.813938 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5decb8df-4af4-477e-9e93-c4d83193e83c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:22.815395 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5decb8df-4af4-477e-9e93-c4d83193e83c None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:22.821500 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 101/208] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Aug 2 21:27:22 2022] GET /identity/v3/role_assignments?user.id=f3be501a21084f37a3dbcea8181c9d84&scope.project.id=66ccc6e8e7254f0795008b4785dcdaa7&role.id=acc98d865c4f4f5cab9d993de06dae36 => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:23.019781 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3b0ec6-add9-42f1-84ed-ea18b9541bf5 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:23.020304 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3b0ec6-add9-42f1-84ed-ea18b9541bf5 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:23.020550 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3b0ec6-add9-42f1-84ed-ea18b9541bf5 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:23.022334 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 108/209] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:27:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:27:23.028246 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ba1f7c-5d47-48f0-8c18-9590438db2a3 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:23.028660 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ba1f7c-5d47-48f0-8c18-9590438db2a3 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:23.028832 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ba1f7c-5d47-48f0-8c18-9590438db2a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:23.049556 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-37ba1f7c-5d47-48f0-8c18-9590438db2a3 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:23.050766 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-37ba1f7c-5d47-48f0-8c18-9590438db2a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:23.096922 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:23.128350 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 102/210] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:27:23.149286 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3b0ec6-add9-42f1-84ed-ea18b9541bf5 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:23.265070 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3b0ec6-add9-42f1-84ed-ea18b9541bf5 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:23.304949 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed4bbf9-73cf-4f99-9674-b8603ad1dd46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:23.305797 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed4bbf9-73cf-4f99-9674-b8603ad1dd46 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:23.306229 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed4bbf9-73cf-4f99-9674-b8603ad1dd46 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:23.306652 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed4bbf9-73cf-4f99-9674-b8603ad1dd46 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:23.308097 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed4bbf9-73cf-4f99-9674-b8603ad1dd46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:23.310380 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed4bbf9-73cf-4f99-9674-b8603ad1dd46 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:23.316642 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 109/211] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 2 21:27:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:23.318332 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ba1f7c-5d47-48f0-8c18-9590438db2a3 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:23.431176 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ba1f7c-5d47-48f0-8c18-9590438db2a3 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:23.464310 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b2acc2-cefe-41b7-a400-02053cee46a2 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:23.465470 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b2acc2-cefe-41b7-a400-02053cee46a2 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:23.465917 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b2acc2-cefe-41b7-a400-02053cee46a2 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:23.467437 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 110/212] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:27:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 21:27:23.469358 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187a52c0-6bbe-4175-93ab-1ec902817d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:23.469995 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187a52c0-6bbe-4175-93ab-1ec902817d7a None admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:23.470280 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187a52c0-6bbe-4175-93ab-1ec902817d7a None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:23.470559 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187a52c0-6bbe-4175-93ab-1ec902817d7a None admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:23.471264 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187a52c0-6bbe-4175-93ab-1ec902817d7a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:23.475468 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187a52c0-6bbe-4175-93ab-1ec902817d7a None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:23.477425 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf1fc6-7425-484a-8789-c2990dec10a2 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:23.477806 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf1fc6-7425-484a-8789-c2990dec10a2 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:23.478178 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf1fc6-7425-484a-8789-c2990dec10a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:23.501569 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 103/213] 10.222.0.70 () {60 vars in 1132 bytes} [Tue Aug 2 21:27:23 2022] POST /identity/v3/users => generated 297 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:27:23.503575 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-b1bf1fc6-7425-484a-8789-c2990dec10a2 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:23.505538 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-b1bf1fc6-7425-484a-8789-c2990dec10a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:23.514427 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827a3132-ee96-4d00-bfb2-75b1c3d0d1d1 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:23.514997 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827a3132-ee96-4d00-bfb2-75b1c3d0d1d1 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:23.515451 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827a3132-ee96-4d00-bfb2-75b1c3d0d1d1 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:23.521906 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 104/214] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:27:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 21:27:23.524035 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3712d8e-4119-4e34-9136-aa70b1ecd73f None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:23.524683 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3712d8e-4119-4e34-9136-aa70b1ecd73f None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:23.525248 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3712d8e-4119-4e34-9136-aa70b1ecd73f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:23.548670 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-a3712d8e-4119-4e34-9136-aa70b1ecd73f None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:23.550383 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-a3712d8e-4119-4e34-9136-aa70b1ecd73f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:23.561571 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:23.585815 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:23.599888 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 111/215] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 21:27:23.623324 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bf1fc6-7425-484a-8789-c2990dec10a2 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:23.643456 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 105/216] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:27:23.668699 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3712d8e-4119-4e34-9136-aa70b1ecd73f None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:23.733513 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bf1fc6-7425-484a-8789-c2990dec10a2 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:23.774729 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c56273-b1e4-4122-8b23-2046e8eabb7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:23.777044 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c56273-b1e4-4122-8b23-2046e8eabb7f None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:23.777044 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c56273-b1e4-4122-8b23-2046e8eabb7f None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:23.777044 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c56273-b1e4-4122-8b23-2046e8eabb7f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:23.792582 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c56273-b1e4-4122-8b23-2046e8eabb7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:27:23.796179 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3712d8e-4119-4e34-9136-aa70b1ecd73f None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:23.798339 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-93c56273-b1e4-4122-8b23-2046e8eabb7f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 21:27:23.798339 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:23.798339 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:23.798339 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:23.798339 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:23.798339 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:23.798339 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:23.798339 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:23.798339 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:23.798339 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:23.798339 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:23.798339 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:23.798339 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:27:23.798339 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:27:23.798339 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:27:23.798339 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:27:23.799251 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:27:23.799251 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:27:23.799251 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:27:23.799251 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:27:23.799251 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:23.799251 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:23.799251 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:23.799251 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:23.799251 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:23.799251 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:23.799251 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:23.799251 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:23.799251 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:23.799251 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:23.799251 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:23.799251 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:23.800080 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:23.800080 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:23.800080 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:23.800080 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:23.800080 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:27:23.800080 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:27:23.800080 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:27:23.800080 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:27:23.800080 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:27:23.800080 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:27:23.800080 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 21:27:23.800080 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:27:23.804766 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 112/217] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 2 21:27:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 21:27:23.809436 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c56273-b1e4-4122-8b23-2046e8eabb7f None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:23.844750 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5055be-75d1-4ebe-b871-c054376ff0c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:23.845658 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5055be-75d1-4ebe-b871-c054376ff0c6 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:23.845943 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5055be-75d1-4ebe-b871-c054376ff0c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:23.846655 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5055be-75d1-4ebe-b871-c054376ff0c6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:23.863072 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5055be-75d1-4ebe-b871-c054376ff0c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:27:23.865165 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:23.868846 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-5a5055be-75d1-4ebe-b871-c054376ff0c6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 21:27:23.868846 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:23.868846 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:23.868846 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:23.868846 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:23.868846 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:23.868846 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:23.868846 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:23.868846 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:23.868846 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:23.868846 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:23.868846 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:23.868846 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:27:23.868846 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:27:23.868846 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:27:23.868846 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:27:23.869749 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:27:23.869749 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:27:23.869749 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:27:23.869749 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:27:23.869749 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:23.869749 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:23.869749 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:23.869749 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:23.869749 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:23.869749 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:23.869749 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:23.869749 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:23.869749 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:23.869749 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:23.869749 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:23.869749 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:23.870803 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:23.870803 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:23.870803 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:23.870803 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:23.870803 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:27:23.870803 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:27:23.870803 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:27:23.870803 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:27:23.870803 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:27:23.870803 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:27:23.870803 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 21:27:23.870803 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:27:23.870803 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 106/218] 10.222.0.70 () {56 vars in 1096 bytes} [Tue Aug 2 21:27:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 21:27:23.876412 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5055be-75d1-4ebe-b871-c054376ff0c6 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:23.908858 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:23.944286 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c56273-b1e4-4122-8b23-2046e8eabb7f None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:23.991807 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9614fee3-5eb6-4dfa-a8f5-1722babeafeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:23.993290 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9614fee3-5eb6-4dfa-a8f5-1722babeafeb None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:23.994068 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9614fee3-5eb6-4dfa-a8f5-1722babeafeb None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:23.994669 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9614fee3-5eb6-4dfa-a8f5-1722babeafeb None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:23.996095 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9614fee3-5eb6-4dfa-a8f5-1722babeafeb None admin] RBAC: Adding query filter params (name=member) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:23.996790 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9614fee3-5eb6-4dfa-a8f5-1722babeafeb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:23.999027 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9614fee3-5eb6-4dfa-a8f5-1722babeafeb None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:24.005000 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5055be-75d1-4ebe-b871-c054376ff0c6 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:24.016711 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 113/219] 10.222.0.70 () {56 vars in 1101 bytes} [Tue Aug 2 21:27:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:27:24.019296 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9614fee3-5eb6-4dfa-a8f5-1722babeafeb None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:24.050355 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219ce976-8bfe-4535-bd05-ea6d2f690ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:24.051058 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219ce976-8bfe-4535-bd05-ea6d2f690ac5 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:24.051361 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219ce976-8bfe-4535-bd05-ea6d2f690ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:24.051749 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219ce976-8bfe-4535-bd05-ea6d2f690ac5 None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:24.052512 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219ce976-8bfe-4535-bd05-ea6d2f690ac5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:24.052832 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219ce976-8bfe-4535-bd05-ea6d2f690ac5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:24.054717 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219ce976-8bfe-4535-bd05-ea6d2f690ac5 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:24.067100 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 107/220] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 2 21:27:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:24.077307 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219ce976-8bfe-4535-bd05-ea6d2f690ac5 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:24.138269 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:24.142510 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9614fee3-5eb6-4dfa-a8f5-1722babeafeb None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:24.189484 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862a4d19-45c0-4fe7-bf98-21be930677c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:24.190717 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862a4d19-45c0-4fe7-bf98-21be930677c1 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:24.191352 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862a4d19-45c0-4fe7-bf98-21be930677c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:24.191726 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862a4d19-45c0-4fe7-bf98-21be930677c1 None admin] PATH_INFO: `/v3/users/15cd23ed66674d3fb2a4b39f350a74f8` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:24.209333 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862a4d19-45c0-4fe7-bf98-21be930677c1 None admin] RBAC: Authorizing `identity:get_user(user_id=15cd23ed66674d3fb2a4b39f350a74f8)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:24.211322 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862a4d19-45c0-4fe7-bf98-21be930677c1 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:24.214124 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 114/221] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Aug 2 21:27:24 2022] GET /identity/v3/users/15cd23ed66674d3fb2a4b39f350a74f8 => generated 297 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:24.216591 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dacb25c-5740-451c-9c4b-3d27c02706ee None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:24.216882 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dacb25c-5740-451c-9c4b-3d27c02706ee None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:24.217161 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dacb25c-5740-451c-9c4b-3d27c02706ee None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:24.218583 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 115/222] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:27:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:27:24.219915 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dacb25c-5740-451c-9c4b-3d27c02706ee None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:24.221206 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:24.240851 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219ce976-8bfe-4535-bd05-ea6d2f690ac5 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:24.278407 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b28249d-1921-4786-95fd-9e998a174b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:24.278884 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b28249d-1921-4786-95fd-9e998a174b2d None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:24.279170 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b28249d-1921-4786-95fd-9e998a174b2d None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:24.279447 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b28249d-1921-4786-95fd-9e998a174b2d None admin] PATH_INFO: `/v3/users/deffc34201024488be9585982829564b` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:24.280850 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b28249d-1921-4786-95fd-9e998a174b2d None admin] RBAC: Authorizing `identity:get_user(user_id=deffc34201024488be9585982829564b)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:24.282396 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b28249d-1921-4786-95fd-9e998a174b2d None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:24.284129 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 108/223] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Aug 2 21:27:24 2022] GET /identity/v3/users/deffc34201024488be9585982829564b => generated 283 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:24.285664 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109e997a-4497-4093-99cc-e48687691437 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:24.285957 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109e997a-4497-4093-99cc-e48687691437 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:24.286245 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109e997a-4497-4093-99cc-e48687691437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:24.314228 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-109e997a-4497-4093-99cc-e48687691437 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:24.315457 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-109e997a-4497-4093-99cc-e48687691437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:24.351299 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dacb25c-5740-451c-9c4b-3d27c02706ee None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:24.392457 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 109/224] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:27:24.393362 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109e997a-4497-4093-99cc-e48687691437 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:24.394417 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a857639-7cbc-4e52-97ee-f9285481c11f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:24.395272 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a857639-7cbc-4e52-97ee-f9285481c11f None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:24.395783 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a857639-7cbc-4e52-97ee-f9285481c11f None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:24.396297 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a857639-7cbc-4e52-97ee-f9285481c11f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:24.426800 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:24.484307 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a857639-7cbc-4e52-97ee-f9285481c11f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:24.487596 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a857639-7cbc-4e52-97ee-f9285481c11f None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:24.509964 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:24.527838 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109e997a-4497-4093-99cc-e48687691437 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:24.565496 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ce0e13-d722-44f3-ba8b-496de6604e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:24.566479 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ce0e13-d722-44f3-ba8b-496de6604e2d None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:24.566961 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ce0e13-d722-44f3-ba8b-496de6604e2d None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:24.567472 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ce0e13-d722-44f3-ba8b-496de6604e2d None admin] PATH_INFO: `/v3/projects/73bf4e4564964659b960ebf8920609ff` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:24.569021 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ce0e13-d722-44f3-ba8b-496de6604e2d None admin] RBAC: Authorizing `identity:get_project(project_id=73bf4e4564964659b960ebf8920609ff)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:24.570692 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ce0e13-d722-44f3-ba8b-496de6604e2d None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:24.572926 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 110/225] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Aug 2 21:27:24 2022] GET /identity/v3/projects/73bf4e4564964659b960ebf8920609ff => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:24.573883 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ce0e13-d722-44f3-ba8b-496de6604e2d None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:24.607376 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 116/226] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 2 21:27:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 02 21:27:24.608298 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a857639-7cbc-4e52-97ee-f9285481c11f None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:24.669436 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:24.686318 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ce0e13-d722-44f3-ba8b-496de6604e2d None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:24.718566 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a857639-7cbc-4e52-97ee-f9285481c11f None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:24.726296 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983115cc-e257-472e-854f-0c1d655edc31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:24.727176 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983115cc-e257-472e-854f-0c1d655edc31 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:24.727657 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983115cc-e257-472e-854f-0c1d655edc31 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:24.728329 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983115cc-e257-472e-854f-0c1d655edc31 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:24.739936 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983115cc-e257-472e-854f-0c1d655edc31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:27:24.745377 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-983115cc-e257-472e-854f-0c1d655edc31 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 21:27:24.745377 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:24.745377 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:24.745377 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:24.745377 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:24.745377 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:24.745377 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:24.745377 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:24.745377 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:24.745377 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:24.745377 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:24.745377 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:24.745377 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:27:24.745377 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:27:24.745377 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:27:24.745377 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:27:24.746275 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:27:24.746275 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:27:24.746275 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:27:24.746275 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:27:24.746275 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:24.746275 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:24.746275 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:24.746275 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:24.746275 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:24.746275 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:24.746275 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:24.746275 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:24.746275 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:24.746275 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:24.746275 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:24.746275 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:24.747066 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:24.747066 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:24.747066 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:24.747066 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:24.747066 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:27:24.747066 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:27:24.747066 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:27:24.747066 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:27:24.747066 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:27:24.747066 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:27:24.747066 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 21:27:24.747066 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:27:24.749554 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 111/227] 10.222.0.70 () {56 vars in 1114 bytes} [Tue Aug 2 21:27:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:24.750544 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983115cc-e257-472e-854f-0c1d655edc31 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:24.758919 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2a1daa-31b0-47ba-b52e-95665d3170a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:24.759622 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a1daa-31b0-47ba-b52e-95665d3170a8 None admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:24.760269 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a1daa-31b0-47ba-b52e-95665d3170a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:24.760269 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2a1daa-31b0-47ba-b52e-95665d3170a8 None admin] PATH_INFO: `/v3/projects/73bf4e4564964659b960ebf8920609ff/users/deffc34201024488be9585982829564b/roles/3e32dbf75f9b41f5adb9fe59851267bb` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:24.763007 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2a1daa-31b0-47ba-b52e-95665d3170a8 None admin] RBAC: Authorizing `identity:create_grant(project_id=73bf4e4564964659b960ebf8920609ff, user_id=deffc34201024488be9585982829564b, role_id=3e32dbf75f9b41f5adb9fe59851267bb)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:24.764570 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:24.765439 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2a1daa-31b0-47ba-b52e-95665d3170a8 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:24.781149 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 117/228] 10.222.0.70 () {58 vars in 1439 bytes} [Tue Aug 2 21:27:24 2022] PUT /identity/v3/projects/73bf4e4564964659b960ebf8920609ff/users/deffc34201024488be9585982829564b/roles/3e32dbf75f9b41f5adb9fe59851267bb => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:27:24.789101 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2a1daa-31b0-47ba-b52e-95665d3170a8 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:24.895076 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983115cc-e257-472e-854f-0c1d655edc31 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:24.933693 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761ddf88-2dc4-47f8-b914-50328f2dfbc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:24.934785 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ddf88-2dc4-47f8-b914-50328f2dfbc1 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:24.935250 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ddf88-2dc4-47f8-b914-50328f2dfbc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:24.935698 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761ddf88-2dc4-47f8-b914-50328f2dfbc1 None admin] PATH_INFO: `/v3/projects/73bf4e4564964659b960ebf8920609ff` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:24.937384 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761ddf88-2dc4-47f8-b914-50328f2dfbc1 None admin] RBAC: Authorizing `identity:get_project(project_id=73bf4e4564964659b960ebf8920609ff)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:24.939151 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761ddf88-2dc4-47f8-b914-50328f2dfbc1 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:24.941241 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 112/229] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Aug 2 21:27:24 2022] GET /identity/v3/projects/73bf4e4564964659b960ebf8920609ff => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:24.948583 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761ddf88-2dc4-47f8-b914-50328f2dfbc1 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:25.011942 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2a1daa-31b0-47ba-b52e-95665d3170a8 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:25.040475 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:25.046481 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:25.076306 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761ddf88-2dc4-47f8-b914-50328f2dfbc1 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:25.077674 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bdd0dc-c1e2-4c52-a155-dadc9584a192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:25.078327 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bdd0dc-c1e2-4c52-a155-dadc9584a192 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:25.078614 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bdd0dc-c1e2-4c52-a155-dadc9584a192 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:25.078892 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bdd0dc-c1e2-4c52-a155-dadc9584a192 None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:25.079978 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bdd0dc-c1e2-4c52-a155-dadc9584a192 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:25.080363 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bdd0dc-c1e2-4c52-a155-dadc9584a192 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:25.082943 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8bdd0dc-c1e2-4c52-a155-dadc9584a192 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:25.097355 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 118/230] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Aug 2 21:27:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:25.103026 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bdd0dc-c1e2-4c52-a155-dadc9584a192 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:25.122894 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d083133d-885d-4c1b-852d-c1370e56bc14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:25.123946 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d083133d-885d-4c1b-852d-c1370e56bc14 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:25.124596 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d083133d-885d-4c1b-852d-c1370e56bc14 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:25.125089 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d083133d-885d-4c1b-852d-c1370e56bc14 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:25.126277 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d083133d-885d-4c1b-852d-c1370e56bc14 None admin] RBAC: Adding query filter params (role.id=462e3381a85c42a9959201f9aa122f7c, scope.project.id=73bf4e4564964659b960ebf8920609ff, user.id=15cd23ed66674d3fb2a4b39f350a74f8) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:25.126828 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d083133d-885d-4c1b-852d-c1370e56bc14 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:25.128472 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d083133d-885d-4c1b-852d-c1370e56bc14 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:25.139768 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 113/231] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Aug 2 21:27:24 2022] GET /identity/v3/role_assignments?user.id=15cd23ed66674d3fb2a4b39f350a74f8&scope.project.id=73bf4e4564964659b960ebf8920609ff&role.id=462e3381a85c42a9959201f9aa122f7c => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:25.270862 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bdd0dc-c1e2-4c52-a155-dadc9584a192 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:25.330319 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f9a793-950f-4eee-96af-9ef4cebdd0b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:25.331323 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f9a793-950f-4eee-96af-9ef4cebdd0b5 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:25.331819 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f9a793-950f-4eee-96af-9ef4cebdd0b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:25.332323 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f9a793-950f-4eee-96af-9ef4cebdd0b5 None admin] PATH_INFO: `/v3/users/deffc34201024488be9585982829564b` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:25.333792 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f9a793-950f-4eee-96af-9ef4cebdd0b5 None admin] RBAC: Authorizing `identity:get_user(user_id=deffc34201024488be9585982829564b)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:25.335514 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f9a793-950f-4eee-96af-9ef4cebdd0b5 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:25.337814 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 119/232] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Aug 2 21:27:25 2022] GET /identity/v3/users/deffc34201024488be9585982829564b => generated 283 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:27:25.343597 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d083133d-885d-4c1b-852d-c1370e56bc14 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:25.454467 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d083133d-885d-4c1b-852d-c1370e56bc14 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:25.499872 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73794911-c1d4-45df-b5cb-b058bdac1859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:25.500566 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73794911-c1d4-45df-b5cb-b058bdac1859 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:25.500856 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73794911-c1d4-45df-b5cb-b058bdac1859 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:25.501140 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73794911-c1d4-45df-b5cb-b058bdac1859 None admin] PATH_INFO: `/v3/projects/73bf4e4564964659b960ebf8920609ff` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:25.504944 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73794911-c1d4-45df-b5cb-b058bdac1859 None admin] RBAC: Authorizing `identity:get_project(project_id=73bf4e4564964659b960ebf8920609ff)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:25.506419 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73794911-c1d4-45df-b5cb-b058bdac1859 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:25.508119 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 114/233] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Aug 2 21:27:25 2022] GET /identity/v3/projects/73bf4e4564964659b960ebf8920609ff => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:25.514699 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f9a793-950f-4eee-96af-9ef4cebdd0b5 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:25.585149 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:25.660933 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f9a793-950f-4eee-96af-9ef4cebdd0b5 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:25.709818 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08d8833-c889-40bf-a238-247766a8945d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:25.710513 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d8833-c889-40bf-a238-247766a8945d None admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:25.710801 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d8833-c889-40bf-a238-247766a8945d None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:25.711080 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08d8833-c889-40bf-a238-247766a8945d None admin] PATH_INFO: `/v3/projects/73bf4e4564964659b960ebf8920609ff/users/deffc34201024488be9585982829564b/roles/14ed906e656a4c1cabd17ceae4a1f872` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:25.713342 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08d8833-c889-40bf-a238-247766a8945d None admin] RBAC: Authorizing `identity:create_grant(project_id=73bf4e4564964659b960ebf8920609ff, user_id=deffc34201024488be9585982829564b, role_id=14ed906e656a4c1cabd17ceae4a1f872)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:25.714846 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08d8833-c889-40bf-a238-247766a8945d None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:25.743918 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 120/234] 10.222.0.70 () {58 vars in 1439 bytes} [Tue Aug 2 21:27:25 2022] PUT /identity/v3/projects/73bf4e4564964659b960ebf8920609ff/users/deffc34201024488be9585982829564b/roles/14ed906e656a4c1cabd17ceae4a1f872 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:27:25.903467 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf536e9-e75a-4991-8cf5-48babeb97a9b None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:25.903762 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf536e9-e75a-4991-8cf5-48babeb97a9b None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:25.903957 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf536e9-e75a-4991-8cf5-48babeb97a9b None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:25.905463 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 115/235] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:27:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:27:25.911516 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a75239b-27b8-4048-b188-0f5d51700619 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:25.911943 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a75239b-27b8-4048-b188-0f5d51700619 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:25.912366 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a75239b-27b8-4048-b188-0f5d51700619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:25.934549 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-0a75239b-27b8-4048-b188-0f5d51700619 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:25.935804 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-0a75239b-27b8-4048-b188-0f5d51700619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:26.014747 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 121/236] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:27:26.038297 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf536e9-e75a-4991-8cf5-48babeb97a9b None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:26.058123 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:26.184183 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf536e9-e75a-4991-8cf5-48babeb97a9b None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:26.231413 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6284ffb2-2674-4fa1-aee9-d263ba7e6647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:26.232069 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6284ffb2-2674-4fa1-aee9-d263ba7e6647 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:26.232380 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6284ffb2-2674-4fa1-aee9-d263ba7e6647 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:26.232662 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6284ffb2-2674-4fa1-aee9-d263ba7e6647 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:26.234807 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c3a29f-3503-4ab3-993c-44aa722dda22 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:26.235101 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c3a29f-3503-4ab3-993c-44aa722dda22 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:26.235378 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c3a29f-3503-4ab3-993c-44aa722dda22 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:26.236927 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 122/237] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:27:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 21:27:26.242234 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf82d4e-78a8-4d8e-a9dc-97ca07a084c7 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:26.242522 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf82d4e-78a8-4d8e-a9dc-97ca07a084c7 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:26.242798 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf82d4e-78a8-4d8e-a9dc-97ca07a084c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:26.266995 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6284ffb2-2674-4fa1-aee9-d263ba7e6647 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:27:26.272521 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-6284ffb2-2674-4fa1-aee9-d263ba7e6647 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 21:27:26.272521 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:26.272521 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:26.272521 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:26.272521 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:26.272521 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:26.272521 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:26.272521 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:26.272521 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:26.272521 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:26.272521 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:26.272521 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:26.272521 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:27:26.272521 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:27:26.272521 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:27:26.272521 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:27:26.273405 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:27:26.273405 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:27:26.273405 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:27:26.273405 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:27:26.273405 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:26.273405 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:26.273405 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:26.273405 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:26.273405 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:26.273405 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:26.273405 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:26.273405 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:26.273405 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:26.273405 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:26.273405 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:26.273405 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:26.274183 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:26.274183 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:26.274183 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:26.274183 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:26.274183 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:27:26.274183 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:27:26.274183 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:27:26.274183 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:27:26.274183 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:27:26.274183 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:27:26.274183 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 21:27:26.274183 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:27:26.274780 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-9bf82d4e-78a8-4d8e-a9dc-97ca07a084c7 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:26.276317 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-9bf82d4e-78a8-4d8e-a9dc-97ca07a084c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:26.283158 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 116/238] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 2 21:27:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:26.288621 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6284ffb2-2674-4fa1-aee9-d263ba7e6647 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:26.342854 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:26.389261 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:26.426799 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 123/239] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 21:27:26.436943 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6284ffb2-2674-4fa1-aee9-d263ba7e6647 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:26.462077 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf82d4e-78a8-4d8e-a9dc-97ca07a084c7 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:26.483332 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3713568d-3304-4cc8-80d4-e27bdc851817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:26.483968 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3713568d-3304-4cc8-80d4-e27bdc851817 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:26.484266 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3713568d-3304-4cc8-80d4-e27bdc851817 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:26.484551 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3713568d-3304-4cc8-80d4-e27bdc851817 None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:26.485273 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3713568d-3304-4cc8-80d4-e27bdc851817 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:26.485604 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3713568d-3304-4cc8-80d4-e27bdc851817 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:26.486969 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3713568d-3304-4cc8-80d4-e27bdc851817 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:26.504004 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 117/240] 10.222.0.70 () {56 vars in 1101 bytes} [Tue Aug 2 21:27:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:26.508912 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3713568d-3304-4cc8-80d4-e27bdc851817 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:26.577145 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf82d4e-78a8-4d8e-a9dc-97ca07a084c7 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:26.615448 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975f2cf4-ef67-482c-9f95-6d15733c14a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:26.616544 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f2cf4-ef67-482c-9f95-6d15733c14a4 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:26.617050 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f2cf4-ef67-482c-9f95-6d15733c14a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:26.617522 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f2cf4-ef67-482c-9f95-6d15733c14a4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:26.618883 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975f2cf4-ef67-482c-9f95-6d15733c14a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:26.620625 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975f2cf4-ef67-482c-9f95-6d15733c14a4 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:26.622909 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 124/241] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 2 21:27:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:26.627881 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975f2cf4-ef67-482c-9f95-6d15733c14a4 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:26.667520 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:26.742366 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975f2cf4-ef67-482c-9f95-6d15733c14a4 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:26.751773 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3713568d-3304-4cc8-80d4-e27bdc851817 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:26.781399 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9fe564-55a1-40cc-a6f2-827582af9a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:26.782523 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9fe564-55a1-40cc-a6f2-827582af9a6a None admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:26.783060 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9fe564-55a1-40cc-a6f2-827582af9a6a None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:26.783537 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9fe564-55a1-40cc-a6f2-827582af9a6a None admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:26.784465 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9fe564-55a1-40cc-a6f2-827582af9a6a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:26.786183 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9fe564-55a1-40cc-a6f2-827582af9a6a None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:26.823467 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:26.825983 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 125/242] 10.222.0.70 () {60 vars in 1132 bytes} [Tue Aug 2 21:27:26 2022] POST /identity/v3/users => generated 293 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 21:27:26.830613 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbaa593-1de7-4be1-8536-c5358a395905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:26.831355 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbaa593-1de7-4be1-8536-c5358a395905 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:26.831653 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbaa593-1de7-4be1-8536-c5358a395905 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:26.831989 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbaa593-1de7-4be1-8536-c5358a395905 None admin] PATH_INFO: `/v3/users/557dc406cc8f49deb257415fe7ab25ce` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:26.850164 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbaa593-1de7-4be1-8536-c5358a395905 None admin] RBAC: Authorizing `identity:get_user(user_id=557dc406cc8f49deb257415fe7ab25ce)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:26.851774 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbaa593-1de7-4be1-8536-c5358a395905 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:26.853769 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 118/243] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Aug 2 21:27:26 2022] GET /identity/v3/users/557dc406cc8f49deb257415fe7ab25ce => generated 297 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:27:26.861839 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9fe564-55a1-40cc-a6f2-827582af9a6a None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:26.972807 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:26.986514 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9fe564-55a1-40cc-a6f2-827582af9a6a None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:27.025325 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2e29af-df9d-4bda-ab5f-177612014f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:27.025945 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2e29af-df9d-4bda-ab5f-177612014f2e None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:27.026233 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2e29af-df9d-4bda-ab5f-177612014f2e None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:27.026560 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2e29af-df9d-4bda-ab5f-177612014f2e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:27.101225 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2e29af-df9d-4bda-ab5f-177612014f2e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:27.102856 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed2e29af-df9d-4bda-ab5f-177612014f2e None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:27.198072 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:27.209516 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 126/244] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 2 21:27:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 21:27:27.215190 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbaa593-1de7-4be1-8536-c5358a395905 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:27.320859 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbaa593-1de7-4be1-8536-c5358a395905 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:27.358493 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cbf511-af1a-4035-a148-fa2886b2ecf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:27.359200 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cbf511-af1a-4035-a148-fa2886b2ecf0 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:27.359490 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cbf511-af1a-4035-a148-fa2886b2ecf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:27.359770 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cbf511-af1a-4035-a148-fa2886b2ecf0 None admin] PATH_INFO: `/v3/projects/73bf4e4564964659b960ebf8920609ff` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:27.360977 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cbf511-af1a-4035-a148-fa2886b2ecf0 None admin] RBAC: Authorizing `identity:get_project(project_id=73bf4e4564964659b960ebf8920609ff)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:27.362717 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cbf511-af1a-4035-a148-fa2886b2ecf0 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:27.364732 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 119/245] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Aug 2 21:27:27 2022] GET /identity/v3/projects/73bf4e4564964659b960ebf8920609ff => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:27.370374 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2e29af-df9d-4bda-ab5f-177612014f2e None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:27.478948 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed2e29af-df9d-4bda-ab5f-177612014f2e None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:27.509847 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ffce98-3e69-4ed9-bf35-0c0644c709f4 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:27.510142 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ffce98-3e69-4ed9-bf35-0c0644c709f4 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:27.510397 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ffce98-3e69-4ed9-bf35-0c0644c709f4 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:27.511939 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 120/246] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:27:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:27:27.516480 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5887311c-bfbf-49bc-a538-0c342340417d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:27.517107 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5887311c-bfbf-49bc-a538-0c342340417d None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:27.517458 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5887311c-bfbf-49bc-a538-0c342340417d None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:27.517560 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5f73be-e42b-4f64-81d5-edc4d590e5d6 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:27.517743 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5f73be-e42b-4f64-81d5-edc4d590e5d6 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:27.517837 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5887311c-bfbf-49bc-a538-0c342340417d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:27.518059 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5f73be-e42b-4f64-81d5-edc4d590e5d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:27.518533 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5887311c-bfbf-49bc-a538-0c342340417d None admin] RBAC: Adding query filter params (role.id=acc98d865c4f4f5cab9d993de06dae36, scope.project.id=73bf4e4564964659b960ebf8920609ff, user.id=557dc406cc8f49deb257415fe7ab25ce) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:27.518854 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5887311c-bfbf-49bc-a538-0c342340417d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:27.520391 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5887311c-bfbf-49bc-a538-0c342340417d None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:27.526420 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 127/247] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Aug 2 21:27:27 2022] GET /identity/v3/role_assignments?user.id=557dc406cc8f49deb257415fe7ab25ce&scope.project.id=73bf4e4564964659b960ebf8920609ff&role.id=acc98d865c4f4f5cab9d993de06dae36 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:27.541723 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-dd5f73be-e42b-4f64-81d5-edc4d590e5d6 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:27.543472 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-dd5f73be-e42b-4f64-81d5-edc4d590e5d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:27.607324 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:27.624444 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 121/248] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 21:27:27.651919 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5887311c-bfbf-49bc-a538-0c342340417d None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:27.653878 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e722d7a-e27f-4db3-98a5-0281d2f84217 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:27.654172 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e722d7a-e27f-4db3-98a5-0281d2f84217 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:27.654454 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e722d7a-e27f-4db3-98a5-0281d2f84217 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:27.656407 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 122/249] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:27:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:27:27.667004 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaa1744-5327-4d8e-b312-3f353fbe1d03 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:27.667302 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaa1744-5327-4d8e-b312-3f353fbe1d03 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:27.667565 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaa1744-5327-4d8e-b312-3f353fbe1d03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:27.690934 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-3eaa1744-5327-4d8e-b312-3f353fbe1d03 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:27.692659 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-3eaa1744-5327-4d8e-b312-3f353fbe1d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:27.733965 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:27.784114 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 123/250] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 21:27:27.792586 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5887311c-bfbf-49bc-a538-0c342340417d None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:27.807017 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaa1744-5327-4d8e-b312-3f353fbe1d03 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:27.840259 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfc2523-0996-4eb6-a9df-233ed7f01b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:27.840259 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfc2523-0996-4eb6-a9df-233ed7f01b49 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:27.840259 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfc2523-0996-4eb6-a9df-233ed7f01b49 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:27.840259 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfc2523-0996-4eb6-a9df-233ed7f01b49 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:27.848573 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfc2523-0996-4eb6-a9df-233ed7f01b49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:27:27.855018 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-4dfc2523-0996-4eb6-a9df-233ed7f01b49 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 21:27:27.855018 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:27.855018 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:27.855018 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:27.855018 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:27.855018 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:27.855018 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:27.855018 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:27.855018 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:27.855018 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:27.855018 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:27.855018 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:27.855018 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:27:27.855018 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:27:27.855018 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:27:27.855018 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:27:27.856810 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:27:27.856810 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:27:27.856810 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:27:27.856810 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:27:27.856810 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:27.856810 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:27.856810 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:27.856810 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:27.856810 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:27.856810 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:27.856810 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:27.856810 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:27.856810 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:27.856810 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:27.856810 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:27.856810 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:27.857642 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:27.857642 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:27.857642 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:27.857642 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:27.857642 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:27:27.857642 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:27:27.857642 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:27:27.857642 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:27:27.857642 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:27:27.857642 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:27:27.857642 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 21:27:27.857642 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:27:27.857642 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 128/251] 10.222.0.70 () {56 vars in 1096 bytes} [Tue Aug 2 21:27:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:27.863764 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfc2523-0996-4eb6-a9df-233ed7f01b49 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:27.985056 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfc2523-0996-4eb6-a9df-233ed7f01b49 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:28.001060 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:28.027636 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc6b821-940a-4207-af63-fe760d77d2f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:28.028293 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc6b821-940a-4207-af63-fe760d77d2f6 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:28.028587 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc6b821-940a-4207-af63-fe760d77d2f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:28.028866 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc6b821-940a-4207-af63-fe760d77d2f6 None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:28.029962 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc6b821-940a-4207-af63-fe760d77d2f6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:28.030528 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc6b821-940a-4207-af63-fe760d77d2f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:28.031948 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc6b821-940a-4207-af63-fe760d77d2f6 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:28.033978 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaa1744-5327-4d8e-b312-3f353fbe1d03 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:28.044407 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 129/252] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 2 21:27:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:27:28.052275 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc6b821-940a-4207-af63-fe760d77d2f6 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:28.089449 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:28.131195 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb54064-c2db-4822-a22d-c7bd5d7f0028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:28.131865 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb54064-c2db-4822-a22d-c7bd5d7f0028 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:28.132150 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb54064-c2db-4822-a22d-c7bd5d7f0028 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:28.132470 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb54064-c2db-4822-a22d-c7bd5d7f0028 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:28.157325 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb54064-c2db-4822-a22d-c7bd5d7f0028 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:27:28.162362 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-7eb54064-c2db-4822-a22d-c7bd5d7f0028 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 21:27:28.162362 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:28.162362 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:28.162362 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:28.162362 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:28.162362 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:28.162362 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:28.162362 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:28.162362 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:28.162362 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:28.162362 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:28.162362 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:28.162362 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:27:28.162362 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:27:28.162362 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:27:28.162362 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:27:28.163247 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:27:28.163247 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:27:28.163247 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:27:28.163247 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:27:28.163247 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:28.163247 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:28.163247 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:28.163247 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:28.163247 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:28.163247 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:28.163247 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:28.163247 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:28.163247 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:28.163247 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:28.163247 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:28.163247 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:28.164060 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:28.164060 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:28.164060 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:28.164060 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:28.164060 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:27:28.164060 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:27:28.164060 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:27:28.164060 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:27:28.164060 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:27:28.164060 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:27:28.164060 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 21:27:28.164060 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:27:28.164060 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 124/253] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 2 21:27:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 21:27:28.173239 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb54064-c2db-4822-a22d-c7bd5d7f0028 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:28.246438 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc6b821-940a-4207-af63-fe760d77d2f6 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:28.343313 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b4d8ec-bf7b-4de5-8c4c-d875ddd9d7e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:28.343944 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b4d8ec-bf7b-4de5-8c4c-d875ddd9d7e8 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:28.344249 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b4d8ec-bf7b-4de5-8c4c-d875ddd9d7e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:28.344530 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b4d8ec-bf7b-4de5-8c4c-d875ddd9d7e8 None admin] PATH_INFO: `/v3/users/deffc34201024488be9585982829564b` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:28.346659 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b4d8ec-bf7b-4de5-8c4c-d875ddd9d7e8 None admin] RBAC: Authorizing `identity:get_user(user_id=deffc34201024488be9585982829564b)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:28.348137 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b4d8ec-bf7b-4de5-8c4c-d875ddd9d7e8 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:28.350187 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 130/254] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Aug 2 21:27:28 2022] GET /identity/v3/users/deffc34201024488be9585982829564b => generated 283 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:27:28.357978 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b4d8ec-bf7b-4de5-8c4c-d875ddd9d7e8 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:28.430395 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb54064-c2db-4822-a22d-c7bd5d7f0028 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:28.472605 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:28.511112 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef0a5b2-7b45-4127-b857-f9bd3ba0d04c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:28.512354 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef0a5b2-7b45-4127-b857-f9bd3ba0d04c None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:28.512649 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef0a5b2-7b45-4127-b857-f9bd3ba0d04c None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:28.512931 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef0a5b2-7b45-4127-b857-f9bd3ba0d04c None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:28.513657 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef0a5b2-7b45-4127-b857-f9bd3ba0d04c None admin] RBAC: Adding query filter params (name=member) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:28.513966 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef0a5b2-7b45-4127-b857-f9bd3ba0d04c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:28.515352 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef0a5b2-7b45-4127-b857-f9bd3ba0d04c None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:28.531695 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 125/255] 10.222.0.70 () {56 vars in 1101 bytes} [Tue Aug 2 21:27:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:28.537581 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef0a5b2-7b45-4127-b857-f9bd3ba0d04c None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:28.585229 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b4d8ec-bf7b-4de5-8c4c-d875ddd9d7e8 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:28.616470 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:28.645891 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e90f5b-be3b-4387-b5b8-28c3758a67b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:28.646529 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e90f5b-be3b-4387-b5b8-28c3758a67b2 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:28.646818 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e90f5b-be3b-4387-b5b8-28c3758a67b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:28.647096 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e90f5b-be3b-4387-b5b8-28c3758a67b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:28.696931 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef0a5b2-7b45-4127-b857-f9bd3ba0d04c None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:28.761021 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64758909-00df-4ad1-8378-b0adfa3e4717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:28.762305 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64758909-00df-4ad1-8378-b0adfa3e4717 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:28.762640 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64758909-00df-4ad1-8378-b0adfa3e4717 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:28.762973 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64758909-00df-4ad1-8378-b0adfa3e4717 None admin] PATH_INFO: `/v3/users/15cd23ed66674d3fb2a4b39f350a74f8` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:28.764921 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64758909-00df-4ad1-8378-b0adfa3e4717 None admin] RBAC: Authorizing `identity:get_user(user_id=15cd23ed66674d3fb2a4b39f350a74f8)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:28.766388 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64758909-00df-4ad1-8378-b0adfa3e4717 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:28.769701 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 126/256] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Aug 2 21:27:28 2022] GET /identity/v3/users/15cd23ed66674d3fb2a4b39f350a74f8 => generated 297 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:27:28.770933 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f0b78d-2d74-40de-9a45-df29bf25471c None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:28.771219 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f0b78d-2d74-40de-9a45-df29bf25471c None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:28.771496 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f0b78d-2d74-40de-9a45-df29bf25471c None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:28.776544 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 127/257] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:27:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:27:28.778718 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f0b78d-2d74-40de-9a45-df29bf25471c None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:28.781786 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e90f5b-be3b-4387-b5b8-28c3758a67b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:28.783334 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e90f5b-be3b-4387-b5b8-28c3758a67b2 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:28.862194 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:28.936170 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f0b78d-2d74-40de-9a45-df29bf25471c None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:28.949628 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:28.968367 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 131/258] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 2 21:27:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 611 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 21:27:28.969734 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca88f020-909a-4b52-91c2-315685125ff6 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:28.970032 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca88f020-909a-4b52-91c2-315685125ff6 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:28.970314 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca88f020-909a-4b52-91c2-315685125ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:28.989672 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-ca88f020-909a-4b52-91c2-315685125ff6 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:28.990922 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-ca88f020-909a-4b52-91c2-315685125ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:29.035698 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ef5d81-8f55-41a7-a16b-7b026e57ed25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:29.036445 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ef5d81-8f55-41a7-a16b-7b026e57ed25 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:29.036729 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ef5d81-8f55-41a7-a16b-7b026e57ed25 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:29.037006 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ef5d81-8f55-41a7-a16b-7b026e57ed25 None admin] PATH_INFO: `/v3/projects/73bf4e4564964659b960ebf8920609ff` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:29.038561 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ef5d81-8f55-41a7-a16b-7b026e57ed25 None admin] RBAC: Authorizing `identity:get_project(project_id=73bf4e4564964659b960ebf8920609ff)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:29.040434 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ef5d81-8f55-41a7-a16b-7b026e57ed25 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:29.044755 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 128/259] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Aug 2 21:27:28 2022] GET /identity/v3/projects/73bf4e4564964659b960ebf8920609ff => generated 302 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:29.045570 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ef5d81-8f55-41a7-a16b-7b026e57ed25 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:29.070015 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 132/260] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:27:29.070685 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca88f020-909a-4b52-91c2-315685125ff6 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:29.218628 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:29.241265 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ef5d81-8f55-41a7-a16b-7b026e57ed25 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:29.272090 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca88f020-909a-4b52-91c2-315685125ff6 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:29.309936 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee9a000-01df-41f3-b252-53c03a4cf441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:29.310611 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee9a000-01df-41f3-b252-53c03a4cf441 None admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:29.310892 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee9a000-01df-41f3-b252-53c03a4cf441 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:29.311166 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee9a000-01df-41f3-b252-53c03a4cf441 None admin] PATH_INFO: `/v3/projects/73bf4e4564964659b960ebf8920609ff/users/15cd23ed66674d3fb2a4b39f350a74f8/roles/462e3381a85c42a9959201f9aa122f7c` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:29.313141 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee9a000-01df-41f3-b252-53c03a4cf441 None admin] RBAC: Authorizing `identity:create_grant(project_id=73bf4e4564964659b960ebf8920609ff, user_id=15cd23ed66674d3fb2a4b39f350a74f8, role_id=462e3381a85c42a9959201f9aa122f7c)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:29.314586 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee9a000-01df-41f3-b252-53c03a4cf441 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:29.330112 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 133/261] 10.222.0.70 () {58 vars in 1439 bytes} [Tue Aug 2 21:27:29 2022] PUT /identity/v3/projects/73bf4e4564964659b960ebf8920609ff/users/15cd23ed66674d3fb2a4b39f350a74f8/roles/462e3381a85c42a9959201f9aa122f7c => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:27:29.330975 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee9a000-01df-41f3-b252-53c03a4cf441 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:29.373629 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57354ef-c499-49fc-80e3-447ff206c490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:29.374308 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57354ef-c499-49fc-80e3-447ff206c490 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:29.374599 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57354ef-c499-49fc-80e3-447ff206c490 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:29.374889 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57354ef-c499-49fc-80e3-447ff206c490 None admin] PATH_INFO: `/v3/projects/73bf4e4564964659b960ebf8920609ff` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:29.376073 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57354ef-c499-49fc-80e3-447ff206c490 None admin] RBAC: Authorizing `identity:get_project(project_id=73bf4e4564964659b960ebf8920609ff)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:29.377584 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57354ef-c499-49fc-80e3-447ff206c490 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:29.379485 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 129/262] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Aug 2 21:27:29 2022] GET /identity/v3/projects/73bf4e4564964659b960ebf8920609ff => generated 302 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:29.385115 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57354ef-c499-49fc-80e3-447ff206c490 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:29.492204 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee9a000-01df-41f3-b252-53c03a4cf441 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:29.523365 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:29.555500 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f7789f-ae1a-4e60-90c7-075c037a8638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:29.556173 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f7789f-ae1a-4e60-90c7-075c037a8638 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:29.556488 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f7789f-ae1a-4e60-90c7-075c037a8638 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:29.556845 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f7789f-ae1a-4e60-90c7-075c037a8638 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:29.562256 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:29.576564 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f7789f-ae1a-4e60-90c7-075c037a8638 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:27:29.581754 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-a0f7789f-ae1a-4e60-90c7-075c037a8638 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 21:27:29.581754 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:29.581754 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:29.581754 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:29.581754 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:29.581754 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:29.581754 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:29.581754 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:29.581754 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:29.581754 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:29.581754 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:29.581754 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:29.581754 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:27:29.581754 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:27:29.581754 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:27:29.581754 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:27:29.582651 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:27:29.582651 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:27:29.582651 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:27:29.582651 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:27:29.582651 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:29.582651 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:29.582651 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:29.582651 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:29.582651 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:29.582651 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:29.582651 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:29.582651 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:29.582651 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:29.582651 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:29.582651 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:29.582651 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:29.583429 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:29.583429 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:29.583429 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:29.583429 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:29.583429 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:27:29.583429 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:27:29.583429 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:27:29.583429 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:27:29.583429 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:27:29.583429 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:27:29.583429 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 21:27:29.583429 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:27:29.588661 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 134/263] 10.222.0.70 () {56 vars in 1114 bytes} [Tue Aug 2 21:27:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:29.596821 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f7789f-ae1a-4e60-90c7-075c037a8638 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:29.694183 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57354ef-c499-49fc-80e3-447ff206c490 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:29.706391 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f7789f-ae1a-4e60-90c7-075c037a8638 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:29.763747 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9364c847-d862-4125-8c93-fdc1ad062a7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:29.764323 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9364c847-d862-4125-8c93-fdc1ad062a7d None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:29.764603 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9364c847-d862-4125-8c93-fdc1ad062a7d None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:29.764875 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9364c847-d862-4125-8c93-fdc1ad062a7d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:29.765663 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9364c847-d862-4125-8c93-fdc1ad062a7d None admin] RBAC: Adding query filter params (role.id=3e32dbf75f9b41f5adb9fe59851267bb, scope.project.id=73bf4e4564964659b960ebf8920609ff, user.id=deffc34201024488be9585982829564b) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:29.765974 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9364c847-d862-4125-8c93-fdc1ad062a7d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:29.767417 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9364c847-d862-4125-8c93-fdc1ad062a7d None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:29.774170 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5192a10d-b26b-47e2-9e1e-4e3797e32f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:29.774791 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5192a10d-b26b-47e2-9e1e-4e3797e32f0e None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:29.775070 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5192a10d-b26b-47e2-9e1e-4e3797e32f0e None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:29.775343 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5192a10d-b26b-47e2-9e1e-4e3797e32f0e None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:29.776147 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5192a10d-b26b-47e2-9e1e-4e3797e32f0e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:29.776483 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5192a10d-b26b-47e2-9e1e-4e3797e32f0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:29.778421 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5192a10d-b26b-47e2-9e1e-4e3797e32f0e None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:29.784019 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 130/264] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Aug 2 21:27:29 2022] GET /identity/v3/role_assignments?user.id=deffc34201024488be9585982829564b&scope.project.id=73bf4e4564964659b960ebf8920609ff&role.id=3e32dbf75f9b41f5adb9fe59851267bb => generated 608 bytes in 399 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:29.794147 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 135/265] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Aug 2 21:27:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:27:29.808132 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9364c847-d862-4125-8c93-fdc1ad062a7d None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:29.939360 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9364c847-d862-4125-8c93-fdc1ad062a7d None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:29.958900 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:29.996801 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b374ac01-9531-40d1-b82c-886e1eaa995a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:29.997479 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b374ac01-9531-40d1-b82c-886e1eaa995a None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:29.997766 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b374ac01-9531-40d1-b82c-886e1eaa995a None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:29.998050 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b374ac01-9531-40d1-b82c-886e1eaa995a None admin] PATH_INFO: `/v3/users/deffc34201024488be9585982829564b` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:29.999307 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b374ac01-9531-40d1-b82c-886e1eaa995a None admin] RBAC: Authorizing `identity:get_user(user_id=deffc34201024488be9585982829564b)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:30.000856 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b374ac01-9531-40d1-b82c-886e1eaa995a None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:30.002899 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 131/266] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Aug 2 21:27:29 2022] GET /identity/v3/users/deffc34201024488be9585982829564b => generated 283 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:30.008440 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5192a10d-b26b-47e2-9e1e-4e3797e32f0e None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:30.090349 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:30.111874 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71492d6-ae05-4a0c-835a-e6736ee36ff7 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:30.112172 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71492d6-ae05-4a0c-835a-e6736ee36ff7 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:30.112735 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71492d6-ae05-4a0c-835a-e6736ee36ff7 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:30.114389 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 132/267] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:27:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 21:27:30.119269 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70d1805-b768-405f-bae0-dfb2ee624c3b None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:30.119560 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70d1805-b768-405f-bae0-dfb2ee624c3b None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:30.119846 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70d1805-b768-405f-bae0-dfb2ee624c3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:30.138614 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5192a10d-b26b-47e2-9e1e-4e3797e32f0e None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:30.161889 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-a70d1805-b768-405f-bae0-dfb2ee624c3b None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:30.163104 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-a70d1805-b768-405f-bae0-dfb2ee624c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:30.175769 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5145a49a-bc2d-4523-b624-2fc5a043f1dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:30.176493 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5145a49a-bc2d-4523-b624-2fc5a043f1dd None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:30.176776 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5145a49a-bc2d-4523-b624-2fc5a043f1dd None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:30.177098 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5145a49a-bc2d-4523-b624-2fc5a043f1dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:30.288518 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 133/268] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 21:27:30.292344 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c9232-65d5-44bc-afd5-4fb68a0b9a8f None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:30.292660 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c9232-65d5-44bc-afd5-4fb68a0b9a8f None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:30.292936 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8c9232-65d5-44bc-afd5-4fb68a0b9a8f None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:30.300257 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 134/269] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:27:30 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:27:30.300396 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5145a49a-bc2d-4523-b624-2fc5a043f1dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:30.300927 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5145a49a-bc2d-4523-b624-2fc5a043f1dd None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:30.303301 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e5ed3-f50f-4f5e-a33a-0e5d157de0d3 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:30.303591 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e5ed3-f50f-4f5e-a33a-0e5d157de0d3 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:30.303862 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83e5ed3-f50f-4f5e-a33a-0e5d157de0d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:30.327642 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-f83e5ed3-f50f-4f5e-a33a-0e5d157de0d3 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:30.328852 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-f83e5ed3-f50f-4f5e-a33a-0e5d157de0d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:30.372332 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:30.420257 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 135/270] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:27:30.420257 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83e5ed3-f50f-4f5e-a33a-0e5d157de0d3 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:30.444364 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 136/271] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 2 21:27:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 21:27:30.449835 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5145a49a-bc2d-4523-b624-2fc5a043f1dd None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:30.466168 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:30.538557 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83e5ed3-f50f-4f5e-a33a-0e5d157de0d3 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:30.564860 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5145a49a-bc2d-4523-b624-2fc5a043f1dd None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:30.579141 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dce6551-adae-4f98-aa05-97538a12679e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:30.579793 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dce6551-adae-4f98-aa05-97538a12679e None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:30.580074 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dce6551-adae-4f98-aa05-97538a12679e None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:30.580382 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dce6551-adae-4f98-aa05-97538a12679e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:30.591613 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dce6551-adae-4f98-aa05-97538a12679e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:27:30.596511 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-3dce6551-adae-4f98-aa05-97538a12679e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 21:27:30.596511 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:30.596511 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:30.596511 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:30.596511 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:30.596511 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:30.596511 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:30.596511 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:30.596511 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:30.596511 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:30.596511 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:30.596511 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:30.596511 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:27:30.596511 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:27:30.596511 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:27:30.596511 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:27:30.597566 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:27:30.597566 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:27:30.597566 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:27:30.597566 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:27:30.597566 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:30.597566 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:30.597566 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:30.597566 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:30.597566 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:30.597566 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:30.597566 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:30.597566 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:30.597566 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:30.597566 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:30.597566 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:30.597566 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:30.598471 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:30.598471 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:30.598471 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:30.598471 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:30.598471 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:27:30.598471 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:27:30.598471 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:27:30.598471 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:27:30.598471 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:27:30.598471 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:27:30.598471 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 21:27:30.598471 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:27:30.598471 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 136/272] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 2 21:27:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:30.601059 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dce6551-adae-4f98-aa05-97538a12679e None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:30.606927 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7f03d4-55d2-4278-9c71-74a8ca575fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:30.607571 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7f03d4-55d2-4278-9c71-74a8ca575fdd None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:30.607853 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7f03d4-55d2-4278-9c71-74a8ca575fdd None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:30.608130 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7f03d4-55d2-4278-9c71-74a8ca575fdd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:30.609305 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7f03d4-55d2-4278-9c71-74a8ca575fdd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:30.610773 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7f03d4-55d2-4278-9c71-74a8ca575fdd None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:30.612771 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 137/273] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 2 21:27:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:30.618097 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad1dd83-7c32-432e-82ed-693a8727b24d None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:30.618673 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad1dd83-7c32-432e-82ed-693a8727b24d None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:30.618673 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad1dd83-7c32-432e-82ed-693a8727b24d None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:30.620131 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 138/274] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:27:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:27:30.621494 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad1dd83-7c32-432e-82ed-693a8727b24d None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:30.648663 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:30.711446 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:30.718698 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dce6551-adae-4f98-aa05-97538a12679e None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:30.727721 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad1dd83-7c32-432e-82ed-693a8727b24d None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:30.757099 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5494532-7fbd-4f21-90e2-1ce8e7ea2862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:30.757749 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5494532-7fbd-4f21-90e2-1ce8e7ea2862 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:30.758121 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5494532-7fbd-4f21-90e2-1ce8e7ea2862 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:30.758406 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5494532-7fbd-4f21-90e2-1ce8e7ea2862 None admin] PATH_INFO: `/v3/projects/73bf4e4564964659b960ebf8920609ff` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:30.759560 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5494532-7fbd-4f21-90e2-1ce8e7ea2862 None admin] RBAC: Authorizing `identity:get_project(project_id=73bf4e4564964659b960ebf8920609ff)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:30.761036 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5494532-7fbd-4f21-90e2-1ce8e7ea2862 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:30.762905 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 137/275] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Aug 2 21:27:30 2022] GET /identity/v3/projects/73bf4e4564964659b960ebf8920609ff => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:30.763488 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5494532-7fbd-4f21-90e2-1ce8e7ea2862 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:30.767803 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c1c092-4937-4ae3-b59f-ceb39feb9142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:30.768454 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c1c092-4937-4ae3-b59f-ceb39feb9142 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:30.768760 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c1c092-4937-4ae3-b59f-ceb39feb9142 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:30.769052 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c1c092-4937-4ae3-b59f-ceb39feb9142 None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:30.769734 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c1c092-4937-4ae3-b59f-ceb39feb9142 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:30.770038 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c1c092-4937-4ae3-b59f-ceb39feb9142 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:30.771403 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c1c092-4937-4ae3-b59f-ceb39feb9142 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:30.780434 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 139/276] 10.222.0.70 () {56 vars in 1101 bytes} [Tue Aug 2 21:27:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:30.781442 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f428e0f3-d39d-44bf-97cd-06405bcfe8d0 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:30.781727 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f428e0f3-d39d-44bf-97cd-06405bcfe8d0 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:30.781999 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f428e0f3-d39d-44bf-97cd-06405bcfe8d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:30.800171 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-f428e0f3-d39d-44bf-97cd-06405bcfe8d0 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:30.801420 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-f428e0f3-d39d-44bf-97cd-06405bcfe8d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:30.872872 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 140/277] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:27:30.873725 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f428e0f3-d39d-44bf-97cd-06405bcfe8d0 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:30.874081 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5494532-7fbd-4f21-90e2-1ce8e7ea2862 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:30.902582 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:30.915828 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e9947a-1f41-41bd-8898-3fa576d8c585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:30.916544 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e9947a-1f41-41bd-8898-3fa576d8c585 None admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:30.916817 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e9947a-1f41-41bd-8898-3fa576d8c585 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:30.917093 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e9947a-1f41-41bd-8898-3fa576d8c585 None admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:30.918354 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e9947a-1f41-41bd-8898-3fa576d8c585 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:30.919862 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e9947a-1f41-41bd-8898-3fa576d8c585 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:30.942513 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 138/278] 10.222.0.70 () {60 vars in 1132 bytes} [Tue Aug 2 21:27:30 2022] POST /identity/v3/users => generated 293 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:27:30.943618 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e9947a-1f41-41bd-8898-3fa576d8c585 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:30.971819 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:31.025059 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f428e0f3-d39d-44bf-97cd-06405bcfe8d0 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:31.063445 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd1fb54-7c12-4cb9-ab53-6b60c1b8e65a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:31.063827 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd1fb54-7c12-4cb9-ab53-6b60c1b8e65a None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:31.064119 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd1fb54-7c12-4cb9-ab53-6b60c1b8e65a None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:31.064479 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd1fb54-7c12-4cb9-ab53-6b60c1b8e65a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:31.065403 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd1fb54-7c12-4cb9-ab53-6b60c1b8e65a None admin] RBAC: Adding query filter params (role.id=14ed906e656a4c1cabd17ceae4a1f872, scope.project.id=73bf4e4564964659b960ebf8920609ff, user.id=deffc34201024488be9585982829564b) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:31.065842 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd1fb54-7c12-4cb9-ab53-6b60c1b8e65a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:31.067218 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd1fb54-7c12-4cb9-ab53-6b60c1b8e65a None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:31.078467 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 141/279] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Aug 2 21:27:30 2022] GET /identity/v3/role_assignments?user.id=deffc34201024488be9585982829564b&scope.project.id=73bf4e4564964659b960ebf8920609ff&role.id=14ed906e656a4c1cabd17ceae4a1f872 => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:31.078467 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd1fb54-7c12-4cb9-ab53-6b60c1b8e65a None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:31.084806 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e9947a-1f41-41bd-8898-3fa576d8c585 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:31.140805 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5658f9b2-a057-45ff-8977-a271b31a9634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:31.141471 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5658f9b2-a057-45ff-8977-a271b31a9634 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:31.141761 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5658f9b2-a057-45ff-8977-a271b31a9634 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:31.142045 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5658f9b2-a057-45ff-8977-a271b31a9634 None admin] PATH_INFO: `/v3/users/557dc406cc8f49deb257415fe7ab25ce` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:31.144182 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5658f9b2-a057-45ff-8977-a271b31a9634 None admin] RBAC: Authorizing `identity:get_user(user_id=557dc406cc8f49deb257415fe7ab25ce)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:31.145866 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5658f9b2-a057-45ff-8977-a271b31a9634 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:31.148018 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 139/280] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Aug 2 21:27:30 2022] GET /identity/v3/users/557dc406cc8f49deb257415fe7ab25ce => generated 297 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:31.157226 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5658f9b2-a057-45ff-8977-a271b31a9634 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:31.195427 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:31.219493 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd1fb54-7c12-4cb9-ab53-6b60c1b8e65a None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:31.263075 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa5d2c6-d42d-4d36-8e44-0b12b06f9fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:31.264058 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa5d2c6-d42d-4d36-8e44-0b12b06f9fbb None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:31.264509 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa5d2c6-d42d-4d36-8e44-0b12b06f9fbb None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:31.264977 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa5d2c6-d42d-4d36-8e44-0b12b06f9fbb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:31.274330 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:31.276855 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa5d2c6-d42d-4d36-8e44-0b12b06f9fbb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:27:31.283456 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-9aa5d2c6-d42d-4d36-8e44-0b12b06f9fbb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 21:27:31.283456 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:31.283456 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:31.283456 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:31.283456 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:31.283456 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:31.283456 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:31.283456 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:31.283456 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:31.283456 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:31.283456 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:31.283456 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:31.283456 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:27:31.283456 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:27:31.283456 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:27:31.283456 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:27:31.285619 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:27:31.285619 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:27:31.285619 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:27:31.285619 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:27:31.285619 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:31.285619 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:31.285619 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:31.285619 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:31.285619 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:31.285619 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:31.285619 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:31.285619 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:31.285619 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:31.285619 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:31.285619 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:31.285619 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:31.286615 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:31.286615 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:31.286615 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:31.286615 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:31.286615 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:27:31.286615 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:27:31.286615 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:27:31.286615 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:27:31.286615 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:27:31.286615 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:27:31.286615 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 21:27:31.286615 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:27:31.288834 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 142/281] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 2 21:27:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:31.292556 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5658f9b2-a057-45ff-8977-a271b31a9634 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:31.294857 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa5d2c6-d42d-4d36-8e44-0b12b06f9fbb None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:31.330290 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640f6177-6560-472a-b79f-d3ef0346dcb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:31.331314 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f6177-6560-472a-b79f-d3ef0346dcb0 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:31.331812 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f6177-6560-472a-b79f-d3ef0346dcb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:31.332310 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f6177-6560-472a-b79f-d3ef0346dcb0 None admin] PATH_INFO: `/v3/projects/73bf4e4564964659b960ebf8920609ff` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:31.333757 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640f6177-6560-472a-b79f-d3ef0346dcb0 None admin] RBAC: Authorizing `identity:get_project(project_id=73bf4e4564964659b960ebf8920609ff)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:31.335542 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640f6177-6560-472a-b79f-d3ef0346dcb0 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:31.337900 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 140/282] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Aug 2 21:27:31 2022] GET /identity/v3/projects/73bf4e4564964659b960ebf8920609ff => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:31.344278 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640f6177-6560-472a-b79f-d3ef0346dcb0 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:31.431125 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa5d2c6-d42d-4d36-8e44-0b12b06f9fbb None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:31.461600 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640f6177-6560-472a-b79f-d3ef0346dcb0 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:31.478438 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f67508-8403-4529-9e6a-29bf2800c732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:31.479078 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f67508-8403-4529-9e6a-29bf2800c732 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:31.479364 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f67508-8403-4529-9e6a-29bf2800c732 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:31.479644 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f67508-8403-4529-9e6a-29bf2800c732 None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:31.480477 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f67508-8403-4529-9e6a-29bf2800c732 None admin] RBAC: Adding query filter params (name=member) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:31.480788 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f67508-8403-4529-9e6a-29bf2800c732 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:31.482180 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f67508-8403-4529-9e6a-29bf2800c732 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:31.493278 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 143/283] 10.222.0.70 () {56 vars in 1101 bytes} [Tue Aug 2 21:27:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:31.499374 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f67508-8403-4529-9e6a-29bf2800c732 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:31.503150 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:31.504636 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb9eea2-ac89-4935-bd3b-0a16152ce008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:31.505503 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb9eea2-ac89-4935-bd3b-0a16152ce008 None admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:31.505790 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb9eea2-ac89-4935-bd3b-0a16152ce008 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:31.506143 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb9eea2-ac89-4935-bd3b-0a16152ce008 None admin] PATH_INFO: `/v3/projects/73bf4e4564964659b960ebf8920609ff/users/557dc406cc8f49deb257415fe7ab25ce/roles/acc98d865c4f4f5cab9d993de06dae36` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:31.508857 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb9eea2-ac89-4935-bd3b-0a16152ce008 None admin] RBAC: Authorizing `identity:create_grant(project_id=73bf4e4564964659b960ebf8920609ff, user_id=557dc406cc8f49deb257415fe7ab25ce, role_id=acc98d865c4f4f5cab9d993de06dae36)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:31.510316 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb9eea2-ac89-4935-bd3b-0a16152ce008 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:31.526886 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 141/284] 10.222.0.70 () {58 vars in 1439 bytes} [Tue Aug 2 21:27:31 2022] PUT /identity/v3/projects/73bf4e4564964659b960ebf8920609ff/users/557dc406cc8f49deb257415fe7ab25ce/roles/acc98d865c4f4f5cab9d993de06dae36 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:27:31.631886 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f67508-8403-4529-9e6a-29bf2800c732 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:31.685201 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3e1360-0b25-45eb-b75e-3475be4c59f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:31.685801 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3e1360-0b25-45eb-b75e-3475be4c59f7 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:31.686088 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3e1360-0b25-45eb-b75e-3475be4c59f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:31.686368 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3e1360-0b25-45eb-b75e-3475be4c59f7 None admin] PATH_INFO: `/v3/users/b80b5c1211324784ad8b2f25293a8515` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:31.707568 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3e1360-0b25-45eb-b75e-3475be4c59f7 None admin] RBAC: Authorizing `identity:get_user(user_id=b80b5c1211324784ad8b2f25293a8515)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:31.709379 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3e1360-0b25-45eb-b75e-3475be4c59f7 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:31.711294 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 144/285] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Aug 2 21:27:31 2022] GET /identity/v3/users/b80b5c1211324784ad8b2f25293a8515 => generated 293 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:27:31.720131 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb9eea2-ac89-4935-bd3b-0a16152ce008 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:31.742426 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:31.843990 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb9eea2-ac89-4935-bd3b-0a16152ce008 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:31.881592 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1231a73d-05da-4601-946d-9232d618117f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:31.882224 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1231a73d-05da-4601-946d-9232d618117f None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:31.882508 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1231a73d-05da-4601-946d-9232d618117f None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:31.882789 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1231a73d-05da-4601-946d-9232d618117f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:31.883591 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1231a73d-05da-4601-946d-9232d618117f None admin] RBAC: Adding query filter params (role.id=462e3381a85c42a9959201f9aa122f7c, user.id=b80b5c1211324784ad8b2f25293a8515, scope.system=all) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:31.883903 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1231a73d-05da-4601-946d-9232d618117f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:31.884767 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fdc789-9528-4a75-a066-a03e5f63ba4f None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:31.885062 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fdc789-9528-4a75-a066-a03e5f63ba4f None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:31.885345 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fdc789-9528-4a75-a066-a03e5f63ba4f None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:31.885441 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1231a73d-05da-4601-946d-9232d618117f None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:31.888058 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 145/286] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:27:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:27:31.891305 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 142/287] 10.222.0.70 () {56 vars in 1308 bytes} [Tue Aug 2 21:27:31 2022] GET /identity/v3/role_assignments?user.id=b80b5c1211324784ad8b2f25293a8515&scope.system=all&role.id=462e3381a85c42a9959201f9aa122f7c => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:31.892333 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb5c24-f6cc-4d13-9603-dda62d46f4e1 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:31.892630 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb5c24-f6cc-4d13-9603-dda62d46f4e1 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:31.892904 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb5c24-f6cc-4d13-9603-dda62d46f4e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:31.916835 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-f5fb5c24-f6cc-4d13-9603-dda62d46f4e1 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:31.918658 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-f5fb5c24-f6cc-4d13-9603-dda62d46f4e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:31.981481 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:31.994406 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 146/288] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 21:27:32.034573 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1231a73d-05da-4601-946d-9232d618117f None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:32.137633 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:32.158380 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1231a73d-05da-4601-946d-9232d618117f None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:32.193111 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d85281b-9be6-4336-a52a-a9fde5011773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:32.194032 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d85281b-9be6-4336-a52a-a9fde5011773 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:32.194459 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d85281b-9be6-4336-a52a-a9fde5011773 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:32.194880 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d85281b-9be6-4336-a52a-a9fde5011773 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:32.207998 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d85281b-9be6-4336-a52a-a9fde5011773 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:27:32.213658 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-8d85281b-9be6-4336-a52a-a9fde5011773 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 21:27:32.213658 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:32.213658 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:32.213658 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:32.213658 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:32.213658 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:32.213658 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:32.213658 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:32.213658 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:32.213658 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:32.213658 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:32.213658 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:32.213658 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:27:32.213658 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:27:32.213658 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:27:32.213658 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:27:32.215120 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:27:32.215120 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:27:32.215120 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:27:32.215120 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:27:32.215120 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:32.215120 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:32.215120 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:32.215120 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:32.215120 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:32.215120 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:32.215120 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:32.215120 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:32.215120 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:32.215120 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:32.215120 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:32.215120 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:32.216075 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:32.216075 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:32.216075 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:32.216075 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:32.216075 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:27:32.216075 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:27:32.216075 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:27:32.216075 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:27:32.216075 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:27:32.216075 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:27:32.216075 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 21:27:32.216075 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:27:32.218467 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 143/289] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 2 21:27:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:32.224177 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fb5c24-f6cc-4d13-9603-dda62d46f4e1 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:32.384550 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fb5c24-f6cc-4d13-9603-dda62d46f4e1 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:32.430124 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0351ae-ef14-4509-a627-af2462d0e0ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:32.430754 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0351ae-ef14-4509-a627-af2462d0e0ed None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:32.431037 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0351ae-ef14-4509-a627-af2462d0e0ed None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:32.431315 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0351ae-ef14-4509-a627-af2462d0e0ed None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:32.432040 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0351ae-ef14-4509-a627-af2462d0e0ed None admin] RBAC: Adding query filter params (name=member) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:32.432367 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0351ae-ef14-4509-a627-af2462d0e0ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:32.434285 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0351ae-ef14-4509-a627-af2462d0e0ed None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:32.447818 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 147/290] 10.222.0.70 () {56 vars in 1101 bytes} [Tue Aug 2 21:27:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:32.453710 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d85281b-9be6-4336-a52a-a9fde5011773 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:32.596486 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d85281b-9be6-4336-a52a-a9fde5011773 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:32.631822 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d0ea4f-0055-48fd-9697-2fee815ec1ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:32.632536 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d0ea4f-0055-48fd-9697-2fee815ec1ad None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:32.632973 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d0ea4f-0055-48fd-9697-2fee815ec1ad None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:32.633264 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d0ea4f-0055-48fd-9697-2fee815ec1ad None admin] PATH_INFO: `/v3/users/15cd23ed66674d3fb2a4b39f350a74f8` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:32.634431 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d0ea4f-0055-48fd-9697-2fee815ec1ad None admin] RBAC: Authorizing `identity:get_user(user_id=15cd23ed66674d3fb2a4b39f350a74f8)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:32.635895 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d0ea4f-0055-48fd-9697-2fee815ec1ad None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:32.638412 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 144/291] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Aug 2 21:27:32 2022] GET /identity/v3/users/15cd23ed66674d3fb2a4b39f350a74f8 => generated 297 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:32.643775 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0351ae-ef14-4509-a627-af2462d0e0ed None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:32.718263 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:32.781597 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0351ae-ef14-4509-a627-af2462d0e0ed None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:32.816453 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55a0d94-8c8a-4d40-9ddf-11db429c813c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:32.817129 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55a0d94-8c8a-4d40-9ddf-11db429c813c None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:32.817419 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55a0d94-8c8a-4d40-9ddf-11db429c813c None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:32.817698 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55a0d94-8c8a-4d40-9ddf-11db429c813c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:32.915746 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55a0d94-8c8a-4d40-9ddf-11db429c813c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:32.917158 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55a0d94-8c8a-4d40-9ddf-11db429c813c None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:32.986168 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:33.039495 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 148/292] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 2 21:27:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 21:27:33.044929 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d0ea4f-0055-48fd-9697-2fee815ec1ad None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:33.080630 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:33.162305 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d0ea4f-0055-48fd-9697-2fee815ec1ad None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:33.208966 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b09d64-6bcb-4f47-9a86-27296c5ffcf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:33.209618 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b09d64-6bcb-4f47-9a86-27296c5ffcf4 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:33.209902 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b09d64-6bcb-4f47-9a86-27296c5ffcf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:33.210182 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b09d64-6bcb-4f47-9a86-27296c5ffcf4 None admin] PATH_INFO: `/v3/projects/73bf4e4564964659b960ebf8920609ff` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:33.211338 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b09d64-6bcb-4f47-9a86-27296c5ffcf4 None admin] RBAC: Authorizing `identity:get_project(project_id=73bf4e4564964659b960ebf8920609ff)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:33.212834 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b09d64-6bcb-4f47-9a86-27296c5ffcf4 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:33.221434 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55a0d94-8c8a-4d40-9ddf-11db429c813c None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:33.233000 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 145/293] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Aug 2 21:27:33 2022] GET /identity/v3/projects/73bf4e4564964659b960ebf8920609ff => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:33.382953 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55a0d94-8c8a-4d40-9ddf-11db429c813c None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:33.418976 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8471c55a-a81d-4cbf-bbda-82a1f264c054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:33.419591 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471c55a-a81d-4cbf-bbda-82a1f264c054 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:33.419870 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471c55a-a81d-4cbf-bbda-82a1f264c054 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:33.420141 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8471c55a-a81d-4cbf-bbda-82a1f264c054 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:33.420952 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8471c55a-a81d-4cbf-bbda-82a1f264c054 None admin] RBAC: Adding query filter params (role.id=462e3381a85c42a9959201f9aa122f7c, scope.project.id=73bf4e4564964659b960ebf8920609ff, user.id=15cd23ed66674d3fb2a4b39f350a74f8) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:33.421263 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8471c55a-a81d-4cbf-bbda-82a1f264c054 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:33.422703 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8471c55a-a81d-4cbf-bbda-82a1f264c054 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:33.432346 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 149/294] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Aug 2 21:27:33 2022] GET /identity/v3/role_assignments?user.id=15cd23ed66674d3fb2a4b39f350a74f8&scope.project.id=73bf4e4564964659b960ebf8920609ff&role.id=462e3381a85c42a9959201f9aa122f7c => generated 608 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:33.767477 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aef4e8-9da7-44eb-b868-221c8473492e None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:33.767867 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aef4e8-9da7-44eb-b868-221c8473492e None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:33.768042 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aef4e8-9da7-44eb-b868-221c8473492e None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:33.769702 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 146/295] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:27:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:27:33.775017 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2f042e-b66c-43b2-aa9b-cd7655b1fb1f None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:33.775885 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2f042e-b66c-43b2-aa9b-cd7655b1fb1f None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:33.776424 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2f042e-b66c-43b2-aa9b-cd7655b1fb1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:33.795526 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-6d2f042e-b66c-43b2-aa9b-cd7655b1fb1f None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:33.797093 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-6d2f042e-b66c-43b2-aa9b-cd7655b1fb1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:33.811421 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:33.884749 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 150/296] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:27:33.910441 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aef4e8-9da7-44eb-b868-221c8473492e None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:33.924329 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bc41be-734c-4e4d-9d1d-630f042fc1f6 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:33.924663 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bc41be-734c-4e4d-9d1d-630f042fc1f6 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:33.924905 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bc41be-734c-4e4d-9d1d-630f042fc1f6 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:33.926551 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 151/297] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:27:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:27:33.931733 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e543ad31-5af7-412d-ba2c-d142d0141a72 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:33.932024 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e543ad31-5af7-412d-ba2c-d142d0141a72 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:33.932348 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e543ad31-5af7-412d-ba2c-d142d0141a72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:33.952508 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-e543ad31-5af7-412d-ba2c-d142d0141a72 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:33.954815 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-e543ad31-5af7-412d-ba2c-d142d0141a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:34.020783 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:34.053871 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aef4e8-9da7-44eb-b868-221c8473492e None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:34.056531 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 152/298] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 21:27:34.073091 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e543ad31-5af7-412d-ba2c-d142d0141a72 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:34.097996 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65584ef6-0021-42ec-95db-f089370ced26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:34.099295 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65584ef6-0021-42ec-95db-f089370ced26 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:34.099800 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65584ef6-0021-42ec-95db-f089370ced26 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:34.100680 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65584ef6-0021-42ec-95db-f089370ced26 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:34.116753 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65584ef6-0021-42ec-95db-f089370ced26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:27:34.124449 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-65584ef6-0021-42ec-95db-f089370ced26 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 21:27:34.124449 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:34.124449 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:34.124449 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:34.124449 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:34.124449 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:34.124449 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:34.124449 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:34.124449 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:34.124449 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:34.124449 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:34.124449 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:34.124449 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:27:34.124449 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:27:34.124449 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:27:34.124449 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:27:34.125335 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:27:34.125335 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:27:34.125335 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:27:34.125335 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:27:34.125335 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:34.125335 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:34.125335 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:34.125335 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:34.125335 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:34.125335 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:34.125335 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:34.125335 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:34.125335 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:34.125335 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:34.125335 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:34.125335 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:34.126158 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:34.126158 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:34.126158 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:34.126158 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:34.126158 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:27:34.126158 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:27:34.126158 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:27:34.126158 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:27:34.126158 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:27:34.126158 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:27:34.126158 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 21:27:34.126158 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:27:34.129121 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 147/299] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 2 21:27:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:34.134905 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65584ef6-0021-42ec-95db-f089370ced26 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:34.177325 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:34.205960 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e543ad31-5af7-412d-ba2c-d142d0141a72 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:34.243900 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9a855e-9c97-4757-b537-40f005e39386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:34.244566 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9a855e-9c97-4757-b537-40f005e39386 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:34.244884 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9a855e-9c97-4757-b537-40f005e39386 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:34.245171 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9a855e-9c97-4757-b537-40f005e39386 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:34.246349 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9a855e-9c97-4757-b537-40f005e39386 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:34.247810 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9a855e-9c97-4757-b537-40f005e39386 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:34.249449 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 153/300] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 2 21:27:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:27:34.253775 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f1ff7b-fc15-4cfa-a281-6b2ff4c4977b None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:34.254134 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f1ff7b-fc15-4cfa-a281-6b2ff4c4977b None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:34.254488 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f1ff7b-fc15-4cfa-a281-6b2ff4c4977b None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:34.255867 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 154/301] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:27:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:27:34.260517 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f1ff7b-fc15-4cfa-a281-6b2ff4c4977b None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:34.263162 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65584ef6-0021-42ec-95db-f089370ced26 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:34.308044 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f45083-b3bb-4022-8cec-5becbcde0bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:34.308734 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f45083-b3bb-4022-8cec-5becbcde0bd4 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:34.309026 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f45083-b3bb-4022-8cec-5becbcde0bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:34.309462 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f45083-b3bb-4022-8cec-5becbcde0bd4 None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:34.310195 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f45083-b3bb-4022-8cec-5becbcde0bd4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:34.310508 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f45083-b3bb-4022-8cec-5becbcde0bd4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:34.312412 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f45083-b3bb-4022-8cec-5becbcde0bd4 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:34.315524 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:34.325088 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 148/302] 10.222.0.70 () {56 vars in 1101 bytes} [Tue Aug 2 21:27:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:27:34.326265 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90c20ee-ec5b-45a1-8870-682ca7455125 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:34.326556 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90c20ee-ec5b-45a1-8870-682ca7455125 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:34.326830 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90c20ee-ec5b-45a1-8870-682ca7455125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:34.345711 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-d90c20ee-ec5b-45a1-8870-682ca7455125 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:34.346901 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-d90c20ee-ec5b-45a1-8870-682ca7455125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:34.390005 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f1ff7b-fc15-4cfa-a281-6b2ff4c4977b None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:34.416691 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 149/303] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:27:34.416691 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90c20ee-ec5b-45a1-8870-682ca7455125 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:34.431714 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b0d5c8-7969-4c33-ab3d-2a46514620d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:34.432446 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b0d5c8-7969-4c33-ab3d-2a46514620d8 None admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:34.432799 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b0d5c8-7969-4c33-ab3d-2a46514620d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:34.433173 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b0d5c8-7969-4c33-ab3d-2a46514620d8 None admin] PATH_INFO: `/v3/groups` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:34.433911 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b0d5c8-7969-4c33-ab3d-2a46514620d8 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:34.435432 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b0d5c8-7969-4c33-ab3d-2a46514620d8 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:34.452254 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 155/304] 10.222.0.70 () {60 vars in 1134 bytes} [Tue Aug 2 21:27:34 2022] POST /identity/v3/groups => generated 229 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:27:34.457754 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54cdb61-17d1-4d0b-9006-117fc6a05696 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:34.458052 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54cdb61-17d1-4d0b-9006-117fc6a05696 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:34.458335 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54cdb61-17d1-4d0b-9006-117fc6a05696 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:34.459746 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 156/305] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:27:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:27:34.460547 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54cdb61-17d1-4d0b-9006-117fc6a05696 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:34.466877 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:34.535874 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90c20ee-ec5b-45a1-8870-682ca7455125 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:34.565486 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:34.574710 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5526c6f6-2e64-451b-aaea-65c59c881498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:34.575377 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5526c6f6-2e64-451b-aaea-65c59c881498 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:34.575656 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5526c6f6-2e64-451b-aaea-65c59c881498 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:34.575930 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5526c6f6-2e64-451b-aaea-65c59c881498 None admin] PATH_INFO: `/v3/users/d38d65fb74674e6dabdc23190ae9aa90` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:34.589975 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54cdb61-17d1-4d0b-9006-117fc6a05696 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:34.591310 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5526c6f6-2e64-451b-aaea-65c59c881498 None admin] RBAC: Authorizing `identity:get_user(user_id=d38d65fb74674e6dabdc23190ae9aa90)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:34.592836 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5526c6f6-2e64-451b-aaea-65c59c881498 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:34.594552 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 150/306] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Aug 2 21:27:34 2022] GET /identity/v3/users/d38d65fb74674e6dabdc23190ae9aa90 => generated 293 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:34.595820 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3361de-312f-4d81-8894-00425391b769 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:34.596104 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3361de-312f-4d81-8894-00425391b769 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:34.596395 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3361de-312f-4d81-8894-00425391b769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:34.617920 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-cc3361de-312f-4d81-8894-00425391b769 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:34.619118 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-cc3361de-312f-4d81-8894-00425391b769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:34.639399 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0f168f-7e93-4fa3-a7ec-4c632b0c8271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:34.640048 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0f168f-7e93-4fa3-a7ec-4c632b0c8271 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:34.640373 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0f168f-7e93-4fa3-a7ec-4c632b0c8271 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:34.640652 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0f168f-7e93-4fa3-a7ec-4c632b0c8271 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:34.651396 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0f168f-7e93-4fa3-a7ec-4c632b0c8271 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:27:34.657468 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-6a0f168f-7e93-4fa3-a7ec-4c632b0c8271 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 21:27:34.657468 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:34.657468 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:34.657468 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:34.657468 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:34.657468 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:34.657468 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:34.657468 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:34.657468 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:34.657468 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:34.657468 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:34.657468 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:34.657468 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:27:34.657468 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:27:34.657468 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:27:34.657468 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:27:34.658444 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:27:34.658444 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:27:34.658444 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:27:34.658444 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:27:34.658444 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:34.658444 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:34.658444 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:34.658444 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:34.658444 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:34.658444 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:34.658444 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:34.658444 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:34.658444 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:34.658444 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:34.658444 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:34.658444 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:34.659246 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:34.659246 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:34.659246 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:34.659246 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:34.659246 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:27:34.659246 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:27:34.659246 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:27:34.659246 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:27:34.659246 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:27:34.659246 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:27:34.659246 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 21:27:34.659246 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:27:34.659246 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 157/307] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 2 21:27:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:34.659891 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0f168f-7e93-4fa3-a7ec-4c632b0c8271 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:34.699733 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 151/308] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:27:34.700834 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3361de-312f-4d81-8894-00425391b769 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:34.741304 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:34.790294 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0f168f-7e93-4fa3-a7ec-4c632b0c8271 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:34.814722 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3361de-312f-4d81-8894-00425391b769 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:34.826464 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c96518-f4d4-407f-8d84-57f6421462b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:34.827277 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c96518-f4d4-407f-8d84-57f6421462b4 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:34.827698 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c96518-f4d4-407f-8d84-57f6421462b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:34.828124 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c96518-f4d4-407f-8d84-57f6421462b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:34.829079 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c96518-f4d4-407f-8d84-57f6421462b4 None admin] RBAC: Adding query filter params (role.id=acc98d865c4f4f5cab9d993de06dae36, user.id=d38d65fb74674e6dabdc23190ae9aa90, scope.system=all) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:34.829544 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c96518-f4d4-407f-8d84-57f6421462b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:34.830994 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c96518-f4d4-407f-8d84-57f6421462b4 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:34.832210 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:34.836888 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 158/309] 10.222.0.70 () {56 vars in 1308 bytes} [Tue Aug 2 21:27:34 2022] GET /identity/v3/role_assignments?user.id=d38d65fb74674e6dabdc23190ae9aa90&scope.system=all&role.id=acc98d865c4f4f5cab9d993de06dae36 => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:34.837617 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c96518-f4d4-407f-8d84-57f6421462b4 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:34.861859 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83af4af8-9ee3-458e-bddc-2cf72d163099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:34.862811 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83af4af8-9ee3-458e-bddc-2cf72d163099 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:34.863100 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83af4af8-9ee3-458e-bddc-2cf72d163099 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:34.863446 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83af4af8-9ee3-458e-bddc-2cf72d163099 None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:34.864147 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83af4af8-9ee3-458e-bddc-2cf72d163099 None admin] RBAC: Adding query filter params (name=member) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:34.864487 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83af4af8-9ee3-458e-bddc-2cf72d163099 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:34.865991 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83af4af8-9ee3-458e-bddc-2cf72d163099 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:34.880280 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 152/310] 10.222.0.70 () {56 vars in 1101 bytes} [Tue Aug 2 21:27:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:34.882082 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83af4af8-9ee3-458e-bddc-2cf72d163099 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:34.978756 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c96518-f4d4-407f-8d84-57f6421462b4 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:35.019722 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:35.029624 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a22646-40fc-45dc-936f-5e2c615b7bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:35.030521 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a22646-40fc-45dc-936f-5e2c615b7bae None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:35.031065 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83af4af8-9ee3-458e-bddc-2cf72d163099 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:35.031297 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a22646-40fc-45dc-936f-5e2c615b7bae None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:35.031831 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a22646-40fc-45dc-936f-5e2c615b7bae None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:35.046682 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a22646-40fc-45dc-936f-5e2c615b7bae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:27:35.054057 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-80a22646-40fc-45dc-936f-5e2c615b7bae None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 21:27:35.054057 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:35.054057 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:35.054057 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:35.054057 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:35.054057 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:35.054057 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:35.054057 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:35.054057 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:35.054057 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:35.054057 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:35.054057 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:35.054057 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:27:35.054057 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:27:35.054057 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:27:35.054057 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:27:35.055615 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:27:35.055615 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:27:35.055615 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:27:35.055615 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:27:35.055615 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:35.055615 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:35.055615 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:35.055615 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:35.055615 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:35.055615 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:35.055615 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:35.055615 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:35.055615 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:35.055615 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:35.055615 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:35.055615 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:35.056555 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:35.056555 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:35.056555 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:35.056555 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:35.056555 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:27:35.056555 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:27:35.056555 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:27:35.056555 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:27:35.056555 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:27:35.056555 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:27:35.056555 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 21:27:35.056555 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:27:35.058868 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 159/311] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 2 21:27:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:35.064656 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a22646-40fc-45dc-936f-5e2c615b7bae None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:35.071360 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e59e1c-5688-448a-a7a2-58c841c431a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:35.072011 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e59e1c-5688-448a-a7a2-58c841c431a1 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:35.072335 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e59e1c-5688-448a-a7a2-58c841c431a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:35.072617 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e59e1c-5688-448a-a7a2-58c841c431a1 None admin] PATH_INFO: `/v3/users/b80b5c1211324784ad8b2f25293a8515` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:35.074327 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e59e1c-5688-448a-a7a2-58c841c431a1 None admin] RBAC: Authorizing `identity:get_user(user_id=b80b5c1211324784ad8b2f25293a8515)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:35.075890 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e59e1c-5688-448a-a7a2-58c841c431a1 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:35.077898 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 153/312] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Aug 2 21:27:34 2022] GET /identity/v3/users/b80b5c1211324784ad8b2f25293a8515 => generated 293 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:35.082820 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e59e1c-5688-448a-a7a2-58c841c431a1 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:35.137084 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:35.181455 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a22646-40fc-45dc-936f-5e2c615b7bae None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:35.193985 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e59e1c-5688-448a-a7a2-58c841c431a1 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:35.217728 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173013fa-5241-4df8-a373-ce84426f4039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:35.218351 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173013fa-5241-4df8-a373-ce84426f4039 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:35.218634 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173013fa-5241-4df8-a373-ce84426f4039 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:35.218909 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173013fa-5241-4df8-a373-ce84426f4039 None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:35.219637 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173013fa-5241-4df8-a373-ce84426f4039 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:35.219918 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173013fa-5241-4df8-a373-ce84426f4039 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:35.221409 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173013fa-5241-4df8-a373-ce84426f4039 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:35.232879 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 160/313] 10.222.0.70 () {56 vars in 1101 bytes} [Tue Aug 2 21:27:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:27:35.236719 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaf769b-a040-40f4-9f66-f7f1192531d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:35.236987 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173013fa-5241-4df8-a373-ce84426f4039 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:35.238076 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaf769b-a040-40f4-9f66-f7f1192531d3 None admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:35.238500 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaf769b-a040-40f4-9f66-f7f1192531d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:35.238939 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaf769b-a040-40f4-9f66-f7f1192531d3 None admin] PATH_INFO: `/v3/system/users/b80b5c1211324784ad8b2f25293a8515/roles/462e3381a85c42a9959201f9aa122f7c` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:35.240596 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaf769b-a040-40f4-9f66-f7f1192531d3 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=b80b5c1211324784ad8b2f25293a8515, role_id=462e3381a85c42a9959201f9aa122f7c)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:35.242121 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaf769b-a040-40f4-9f66-f7f1192531d3 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:35.255123 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 154/314] 10.222.0.70 () {58 vars in 1334 bytes} [Tue Aug 2 21:27:35 2022] PUT /identity/v3/system/users/b80b5c1211324784ad8b2f25293a8515/roles/462e3381a85c42a9959201f9aa122f7c => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:27:35.310665 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:35.364246 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173013fa-5241-4df8-a373-ce84426f4039 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:35.401665 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ccf404-c084-4aef-b618-6ab1e3bb898d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:35.402532 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ccf404-c084-4aef-b618-6ab1e3bb898d None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:35.402932 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ccf404-c084-4aef-b618-6ab1e3bb898d None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:35.403306 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ccf404-c084-4aef-b618-6ab1e3bb898d None admin] PATH_INFO: `/v3/users/557dc406cc8f49deb257415fe7ab25ce` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:35.404643 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ccf404-c084-4aef-b618-6ab1e3bb898d None admin] RBAC: Authorizing `identity:get_user(user_id=557dc406cc8f49deb257415fe7ab25ce)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:35.406227 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ccf404-c084-4aef-b618-6ab1e3bb898d None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:35.408297 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 161/315] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Aug 2 21:27:35 2022] GET /identity/v3/users/557dc406cc8f49deb257415fe7ab25ce => generated 297 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:27:35.413796 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaf769b-a040-40f4-9f66-f7f1192531d3 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:35.527286 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaf769b-a040-40f4-9f66-f7f1192531d3 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:35.538352 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:35.563219 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c65ae0-d5dc-425d-aebf-99dcbdb1a092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:35.563936 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c65ae0-d5dc-425d-aebf-99dcbdb1a092 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:35.564598 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c65ae0-d5dc-425d-aebf-99dcbdb1a092 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:35.565002 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c65ae0-d5dc-425d-aebf-99dcbdb1a092 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:35.639357 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c65ae0-d5dc-425d-aebf-99dcbdb1a092 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:35.640929 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c65ae0-d5dc-425d-aebf-99dcbdb1a092 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:35.744625 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 155/316] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 2 21:27:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 21:27:35.750887 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ccf404-c084-4aef-b618-6ab1e3bb898d None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:35.850037 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ccf404-c084-4aef-b618-6ab1e3bb898d None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:35.868015 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:35.885616 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e09f8aa-e178-4368-ab62-a85f961c1db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:35.886279 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e09f8aa-e178-4368-ab62-a85f961c1db2 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:35.886565 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e09f8aa-e178-4368-ab62-a85f961c1db2 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:35.886836 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e09f8aa-e178-4368-ab62-a85f961c1db2 None admin] PATH_INFO: `/v3/projects/73bf4e4564964659b960ebf8920609ff` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:35.887985 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e09f8aa-e178-4368-ab62-a85f961c1db2 None admin] RBAC: Authorizing `identity:get_project(project_id=73bf4e4564964659b960ebf8920609ff)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:35.889502 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e09f8aa-e178-4368-ab62-a85f961c1db2 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:35.891401 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 162/317] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Aug 2 21:27:35 2022] GET /identity/v3/projects/73bf4e4564964659b960ebf8920609ff => generated 302 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:35.896987 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c65ae0-d5dc-425d-aebf-99dcbdb1a092 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:35.928617 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:36.009654 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c65ae0-d5dc-425d-aebf-99dcbdb1a092 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:36.045896 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73b600a-ec40-41c7-b1b2-80b21847a0fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:36.046564 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73b600a-ec40-41c7-b1b2-80b21847a0fc None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:36.046856 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73b600a-ec40-41c7-b1b2-80b21847a0fc None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:36.047134 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73b600a-ec40-41c7-b1b2-80b21847a0fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:36.047986 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73b600a-ec40-41c7-b1b2-80b21847a0fc None admin] RBAC: Adding query filter params (role.id=acc98d865c4f4f5cab9d993de06dae36, scope.project.id=73bf4e4564964659b960ebf8920609ff, user.id=557dc406cc8f49deb257415fe7ab25ce) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:36.048335 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73b600a-ec40-41c7-b1b2-80b21847a0fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:36.049829 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73b600a-ec40-41c7-b1b2-80b21847a0fc None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:36.056562 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 156/318] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Aug 2 21:27:35 2022] GET /identity/v3/role_assignments?user.id=557dc406cc8f49deb257415fe7ab25ce&scope.project.id=73bf4e4564964659b960ebf8920609ff&role.id=acc98d865c4f4f5cab9d993de06dae36 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:36.565112 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcbd35f-17b3-416e-9e1b-312971d34d91 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:36.565461 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcbd35f-17b3-416e-9e1b-312971d34d91 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:36.565648 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcbd35f-17b3-416e-9e1b-312971d34d91 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:36.567045 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 163/319] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:27:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:27:36.571945 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a46d9d-9f8c-43d4-8ec2-46a7fd239c9d None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:36.572502 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a46d9d-9f8c-43d4-8ec2-46a7fd239c9d None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:36.572502 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a46d9d-9f8c-43d4-8ec2-46a7fd239c9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:36.591884 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-e9a46d9d-9f8c-43d4-8ec2-46a7fd239c9d None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:36.593135 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-e9a46d9d-9f8c-43d4-8ec2-46a7fd239c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:36.663102 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 157/320] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:27:36.685346 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcbd35f-17b3-416e-9e1b-312971d34d91 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:36.790190 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcbd35f-17b3-416e-9e1b-312971d34d91 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:36.824804 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbd1564-2598-4295-aafb-8530abaf40bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:36.825371 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbd1564-2598-4295-aafb-8530abaf40bd None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:36.825652 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbd1564-2598-4295-aafb-8530abaf40bd None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:36.825924 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbd1564-2598-4295-aafb-8530abaf40bd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:36.827103 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbd1564-2598-4295-aafb-8530abaf40bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:36.828560 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbd1564-2598-4295-aafb-8530abaf40bd None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:36.830302 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 164/321] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 2 21:27:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:27:36.835614 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a46d9d-9f8c-43d4-8ec2-46a7fd239c9d None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:36.838961 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:36.900766 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc08a727-bbf5-4c84-bbfd-5f5a9701fb98 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:36.901271 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc08a727-bbf5-4c84-bbfd-5f5a9701fb98 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:36.901344 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc08a727-bbf5-4c84-bbfd-5f5a9701fb98 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:36.902833 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 165/322] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:27:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 21:27:36.907565 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86729404-eefb-47d1-b0e4-32f36fa67806 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:36.907863 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86729404-eefb-47d1-b0e4-32f36fa67806 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:36.908146 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86729404-eefb-47d1-b0e4-32f36fa67806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:36.926252 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-86729404-eefb-47d1-b0e4-32f36fa67806 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:36.927456 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-86729404-eefb-47d1-b0e4-32f36fa67806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:36.941064 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a46d9d-9f8c-43d4-8ec2-46a7fd239c9d None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:36.981217 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120beb24-3a34-4de4-822b-a030b67f92a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:36.981466 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:36.981841 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120beb24-3a34-4de4-822b-a030b67f92a7 None admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:36.982124 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120beb24-3a34-4de4-822b-a030b67f92a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:36.982404 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120beb24-3a34-4de4-822b-a030b67f92a7 None admin] PATH_INFO: `/v3/groups` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:36.983082 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120beb24-3a34-4de4-822b-a030b67f92a7 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:36.984662 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120beb24-3a34-4de4-822b-a030b67f92a7 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:37.003802 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 158/323] 10.222.0.70 () {60 vars in 1134 bytes} [Tue Aug 2 21:27:36 2022] POST /identity/v3/groups => generated 226 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:27:37.004951 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 166/324] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 21:27:37.027690 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120beb24-3a34-4de4-822b-a030b67f92a7 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:37.098572 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:37.144854 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120beb24-3a34-4de4-822b-a030b67f92a7 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:37.183084 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df58be74-7509-4dd8-a822-efdce3c54352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:37.184336 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df58be74-7509-4dd8-a822-efdce3c54352 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:37.184630 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df58be74-7509-4dd8-a822-efdce3c54352 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:37.184911 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df58be74-7509-4dd8-a822-efdce3c54352 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:37.195571 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df58be74-7509-4dd8-a822-efdce3c54352 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:27:37.201012 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-df58be74-7509-4dd8-a822-efdce3c54352 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 21:27:37.201012 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:37.201012 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:37.201012 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:37.201012 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:37.201012 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:37.201012 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:37.201012 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:37.201012 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:37.201012 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:37.201012 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:37.201012 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:37.201012 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:27:37.201012 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:27:37.201012 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:27:37.201012 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:27:37.201876 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:27:37.201876 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:27:37.201876 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:27:37.201876 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:27:37.201876 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:37.201876 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:37.201876 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:37.201876 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:37.201876 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:37.201876 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:37.201876 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:37.201876 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:37.201876 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:37.201876 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:37.201876 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:37.201876 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:37.202855 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:37.202855 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:37.202855 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:37.202855 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:37.202855 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:27:37.202855 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:27:37.202855 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:27:37.202855 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:27:37.202855 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:27:37.202855 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:27:37.202855 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 21:27:37.202855 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:27:37.202855 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 159/325] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 2 21:27:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:37.207913 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86729404-eefb-47d1-b0e4-32f36fa67806 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:37.307119 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073e84a3-f62c-4c10-ba8d-6e7a4954c31c None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:37.307990 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073e84a3-f62c-4c10-ba8d-6e7a4954c31c None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:37.309059 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073e84a3-f62c-4c10-ba8d-6e7a4954c31c None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:37.310560 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 160/326] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:27:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 21:27:37.315708 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b0a5c4-349f-4c96-a5ec-2ad3c6eceabf None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:37.315996 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b0a5c4-349f-4c96-a5ec-2ad3c6eceabf None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:37.316307 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b0a5c4-349f-4c96-a5ec-2ad3c6eceabf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:37.327757 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86729404-eefb-47d1-b0e4-32f36fa67806 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:37.340150 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-57b0a5c4-349f-4c96-a5ec-2ad3c6eceabf None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:37.341377 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-57b0a5c4-349f-4c96-a5ec-2ad3c6eceabf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:37.377849 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a9b6ff-f574-42c5-96d9-847893bfc054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:37.378829 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a9b6ff-f574-42c5-96d9-847893bfc054 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:37.378829 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a9b6ff-f574-42c5-96d9-847893bfc054 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:37.378993 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a9b6ff-f574-42c5-96d9-847893bfc054 None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:37.379677 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a9b6ff-f574-42c5-96d9-847893bfc054 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:37.379985 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a9b6ff-f574-42c5-96d9-847893bfc054 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:37.381609 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a9b6ff-f574-42c5-96d9-847893bfc054 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:37.390947 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 167/327] 10.222.0.70 () {56 vars in 1101 bytes} [Tue Aug 2 21:27:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:27:37.396473 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a9b6ff-f574-42c5-96d9-847893bfc054 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:37.431138 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 161/328] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 21:27:37.460382 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:37.465096 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b0a5c4-349f-4c96-a5ec-2ad3c6eceabf None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:37.534169 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a9b6ff-f574-42c5-96d9-847893bfc054 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:37.540570 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:37.580425 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b0a5c4-349f-4c96-a5ec-2ad3c6eceabf None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:37.582406 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cded37-7bae-47d5-a587-df9c7ebd4c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:37.583892 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cded37-7bae-47d5-a587-df9c7ebd4c50 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:37.584186 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cded37-7bae-47d5-a587-df9c7ebd4c50 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:37.584519 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cded37-7bae-47d5-a587-df9c7ebd4c50 None admin] PATH_INFO: `/v3/users/d38d65fb74674e6dabdc23190ae9aa90` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:37.585740 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cded37-7bae-47d5-a587-df9c7ebd4c50 None admin] RBAC: Authorizing `identity:get_user(user_id=d38d65fb74674e6dabdc23190ae9aa90)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:37.587265 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cded37-7bae-47d5-a587-df9c7ebd4c50 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:37.590311 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 168/329] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Aug 2 21:27:37 2022] GET /identity/v3/users/d38d65fb74674e6dabdc23190ae9aa90 => generated 293 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:37.595713 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cded37-7bae-47d5-a587-df9c7ebd4c50 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:37.622851 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eed7c31-49da-4567-bf08-9b0c5e1a7065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:37.623509 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eed7c31-49da-4567-bf08-9b0c5e1a7065 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:37.623792 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eed7c31-49da-4567-bf08-9b0c5e1a7065 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:37.624066 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eed7c31-49da-4567-bf08-9b0c5e1a7065 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:37.636599 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eed7c31-49da-4567-bf08-9b0c5e1a7065 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:27:37.642411 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-2eed7c31-49da-4567-bf08-9b0c5e1a7065 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 21:27:37.642411 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:37.642411 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:37.642411 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:37.642411 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:37.642411 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:37.642411 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:37.642411 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:37.642411 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:37.642411 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:37.642411 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:37.642411 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:37.642411 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:27:37.642411 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:27:37.642411 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:27:37.642411 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:27:37.643296 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:27:37.643296 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:27:37.643296 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:27:37.643296 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:27:37.643296 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:37.643296 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:37.643296 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:37.643296 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:37.643296 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:37.643296 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:37.643296 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:37.643296 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:37.643296 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:37.643296 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:37.643296 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:37.643296 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:37.644066 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:37.644066 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:37.644066 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:37.644066 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:37.644066 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:27:37.644066 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:27:37.644066 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:27:37.644066 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:27:37.644066 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:27:37.644066 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:27:37.644066 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 21:27:37.644066 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:27:37.644066 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 162/330] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 2 21:27:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 21:27:37.649377 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eed7c31-49da-4567-bf08-9b0c5e1a7065 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:37.725169 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cded37-7bae-47d5-a587-df9c7ebd4c50 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:37.743061 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:37.767285 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b10214c-1ba4-47a0-9809-43f070fac66f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:37.767960 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b10214c-1ba4-47a0-9809-43f070fac66f None admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:37.768267 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b10214c-1ba4-47a0-9809-43f070fac66f None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:37.768596 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b10214c-1ba4-47a0-9809-43f070fac66f None admin] PATH_INFO: `/v3/system/users/d38d65fb74674e6dabdc23190ae9aa90/roles/acc98d865c4f4f5cab9d993de06dae36` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:37.771802 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b10214c-1ba4-47a0-9809-43f070fac66f None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=d38d65fb74674e6dabdc23190ae9aa90, role_id=acc98d865c4f4f5cab9d993de06dae36)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:37.773244 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b10214c-1ba4-47a0-9809-43f070fac66f None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:37.785466 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eed7c31-49da-4567-bf08-9b0c5e1a7065 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:37.790747 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 169/331] 10.222.0.70 () {58 vars in 1334 bytes} [Tue Aug 2 21:27:37 2022] PUT /identity/v3/system/users/d38d65fb74674e6dabdc23190ae9aa90/roles/acc98d865c4f4f5cab9d993de06dae36 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:27:37.803588 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:37.834198 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c195ed-a84a-4ae1-8a6b-86eb0675a3d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:37.834835 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c195ed-a84a-4ae1-8a6b-86eb0675a3d7 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:37.835173 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c195ed-a84a-4ae1-8a6b-86eb0675a3d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:37.835454 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c195ed-a84a-4ae1-8a6b-86eb0675a3d7 None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:37.836193 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c195ed-a84a-4ae1-8a6b-86eb0675a3d7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:37.836530 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c195ed-a84a-4ae1-8a6b-86eb0675a3d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:37.837978 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c195ed-a84a-4ae1-8a6b-86eb0675a3d7 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:37.848632 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 163/332] 10.222.0.70 () {56 vars in 1101 bytes} [Tue Aug 2 21:27:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:27:37.854561 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b10214c-1ba4-47a0-9809-43f070fac66f None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:37.983907 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b10214c-1ba4-47a0-9809-43f070fac66f None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:38.020134 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523e10a4-edb6-4e15-8814-72c83829f59e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:38.020906 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523e10a4-edb6-4e15-8814-72c83829f59e None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:38.021290 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523e10a4-edb6-4e15-8814-72c83829f59e None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:38.021570 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523e10a4-edb6-4e15-8814-72c83829f59e None admin] PATH_INFO: `/v3/users/b80b5c1211324784ad8b2f25293a8515` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:38.023093 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523e10a4-edb6-4e15-8814-72c83829f59e None admin] RBAC: Authorizing `identity:get_user(user_id=b80b5c1211324784ad8b2f25293a8515)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:38.024650 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523e10a4-edb6-4e15-8814-72c83829f59e None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:38.026609 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 170/333] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Aug 2 21:27:37 2022] GET /identity/v3/users/b80b5c1211324784ad8b2f25293a8515 => generated 293 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:38.032415 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c195ed-a84a-4ae1-8a6b-86eb0675a3d7 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:38.149678 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c195ed-a84a-4ae1-8a6b-86eb0675a3d7 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:38.188268 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aea3cbf-7fcc-4001-9183-ecda89948fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:38.188956 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aea3cbf-7fcc-4001-9183-ecda89948fe9 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:38.189309 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aea3cbf-7fcc-4001-9183-ecda89948fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:38.189592 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aea3cbf-7fcc-4001-9183-ecda89948fe9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:38.190386 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aea3cbf-7fcc-4001-9183-ecda89948fe9 None admin] RBAC: Adding query filter params (role.id=462e3381a85c42a9959201f9aa122f7c, user.id=b80b5c1211324784ad8b2f25293a8515, scope.system=all) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:38.190697 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aea3cbf-7fcc-4001-9183-ecda89948fe9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:38.192140 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aea3cbf-7fcc-4001-9183-ecda89948fe9 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:38.205480 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 164/334] 10.222.0.70 () {56 vars in 1308 bytes} [Tue Aug 2 21:27:38 2022] GET /identity/v3/role_assignments?user.id=b80b5c1211324784ad8b2f25293a8515&scope.system=all&role.id=462e3381a85c42a9959201f9aa122f7c => generated 510 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:39.523369 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c386fe-db80-45af-952e-404b099ba1e4 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:39.524065 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c386fe-db80-45af-952e-404b099ba1e4 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:39.524065 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c386fe-db80-45af-952e-404b099ba1e4 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:39.525541 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 171/335] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:27:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:27:39.546338 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675d135c-a0e9-45a9-9902-34da100dbf60 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:39.547003 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675d135c-a0e9-45a9-9902-34da100dbf60 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:39.547003 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675d135c-a0e9-45a9-9902-34da100dbf60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:39.569215 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-675d135c-a0e9-45a9-9902-34da100dbf60 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:39.570424 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-675d135c-a0e9-45a9-9902-34da100dbf60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:39.605799 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:39.657829 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 165/336] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:27:39.693143 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c386fe-db80-45af-952e-404b099ba1e4 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:39.760760 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:39.830437 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c386fe-db80-45af-952e-404b099ba1e4 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:39.869121 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fa2bed-a63e-4f5d-a8cc-da1cb0f400f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:39.869778 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fa2bed-a63e-4f5d-a8cc-da1cb0f400f5 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:39.870064 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fa2bed-a63e-4f5d-a8cc-da1cb0f400f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:39.870342 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fa2bed-a63e-4f5d-a8cc-da1cb0f400f5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:39.881261 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fa2bed-a63e-4f5d-a8cc-da1cb0f400f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:27:39.886813 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-a0fa2bed-a63e-4f5d-a8cc-da1cb0f400f5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 21:27:39.886813 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:39.886813 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:39.886813 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:39.886813 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:39.886813 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:39.886813 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:39.886813 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:39.886813 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:39.886813 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:39.886813 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:39.886813 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:39.886813 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:27:39.886813 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:27:39.886813 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:27:39.886813 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:27:39.888947 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:27:39.888947 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:27:39.888947 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:27:39.888947 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:27:39.888947 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:39.888947 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:39.888947 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:39.888947 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:39.888947 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:39.888947 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:39.888947 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:39.888947 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:39.888947 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:39.888947 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:39.888947 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:39.888947 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:39.890812 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:39.890812 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:39.890812 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:39.890812 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:39.890812 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:27:39.890812 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:27:39.890812 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:27:39.890812 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:27:39.890812 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:27:39.890812 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:27:39.890812 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 21:27:39.890812 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:27:39.890812 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 172/337] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 2 21:27:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:39.896272 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675d135c-a0e9-45a9-9902-34da100dbf60 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:40.016332 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e22ae-a998-4d63-a6de-c6e652968d87 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:40.016652 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e22ae-a998-4d63-a6de-c6e652968d87 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:40.016951 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e22ae-a998-4d63-a6de-c6e652968d87 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:40.018564 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 173/338] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:27:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:27:40.024520 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675d135c-a0e9-45a9-9902-34da100dbf60 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:40.027917 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4346968e-0131-4df2-9dfe-9f0be7eb037d None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:40.028202 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4346968e-0131-4df2-9dfe-9f0be7eb037d None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:40.028512 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4346968e-0131-4df2-9dfe-9f0be7eb037d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:40.061331 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-4346968e-0131-4df2-9dfe-9f0be7eb037d None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:40.063212 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-4346968e-0131-4df2-9dfe-9f0be7eb037d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:40.091814 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff6802c-188f-4f2c-9fff-849a35976084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:40.092401 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff6802c-188f-4f2c-9fff-849a35976084 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:40.092688 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff6802c-188f-4f2c-9fff-849a35976084 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:40.092969 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff6802c-188f-4f2c-9fff-849a35976084 None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:40.093698 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff6802c-188f-4f2c-9fff-849a35976084 None admin] RBAC: Adding query filter params (name=member) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:40.094011 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff6802c-188f-4f2c-9fff-849a35976084 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:40.096042 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff6802c-188f-4f2c-9fff-849a35976084 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:40.111926 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 166/339] 10.222.0.70 () {56 vars in 1101 bytes} [Tue Aug 2 21:27:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:40.118056 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff6802c-188f-4f2c-9fff-849a35976084 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:40.167339 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:40.184258 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 174/340] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:27:40.260073 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff6802c-188f-4f2c-9fff-849a35976084 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:40.302945 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4346968e-0131-4df2-9dfe-9f0be7eb037d None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:40.304711 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5a62c1-ee76-4e29-a757-83e27d2dcedd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:40.305345 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5a62c1-ee76-4e29-a757-83e27d2dcedd None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:40.305630 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5a62c1-ee76-4e29-a757-83e27d2dcedd None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:40.305906 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5a62c1-ee76-4e29-a757-83e27d2dcedd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:40.360908 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:40.469101 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4346968e-0131-4df2-9dfe-9f0be7eb037d None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:40.488259 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5a62c1-ee76-4e29-a757-83e27d2dcedd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:40.488259 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5a62c1-ee76-4e29-a757-83e27d2dcedd None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:40.529967 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23907e4-79f4-4240-8ecf-15480ddac608 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:40.531229 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23907e4-79f4-4240-8ecf-15480ddac608 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:40.531703 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23907e4-79f4-4240-8ecf-15480ddac608 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:40.532119 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23907e4-79f4-4240-8ecf-15480ddac608 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:40.550032 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23907e4-79f4-4240-8ecf-15480ddac608 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:27:40.555796 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-b23907e4-79f4-4240-8ecf-15480ddac608 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 21:27:40.555796 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:40.555796 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:40.555796 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:40.555796 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:40.555796 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:40.555796 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:40.555796 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:40.555796 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:40.555796 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:40.555796 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:40.555796 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:40.555796 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:27:40.555796 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:27:40.555796 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:27:40.555796 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:27:40.556850 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:27:40.556850 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:27:40.556850 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:27:40.556850 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:27:40.556850 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:40.556850 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:40.556850 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:40.556850 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:40.556850 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:40.556850 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:40.556850 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:40.556850 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:40.556850 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:40.556850 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:40.556850 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:40.556850 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:40.557861 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:40.557861 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:40.557861 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:40.557861 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:40.557861 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:27:40.557861 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:27:40.557861 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:27:40.557861 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:27:40.557861 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:27:40.557861 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:27:40.557861 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 21:27:40.557861 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:27:40.559930 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:40.566299 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 175/341] 10.222.0.70 () {56 vars in 1114 bytes} [Tue Aug 2 21:27:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:40.572216 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23907e4-79f4-4240-8ecf-15480ddac608 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:40.690080 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:40.700892 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23907e4-79f4-4240-8ecf-15480ddac608 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:40.733859 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 167/342] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 2 21:27:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 616 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 21:27:40.743511 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c5cdc9-e65f-405d-9243-afe5805cd744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:40.744385 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c5cdc9-e65f-405d-9243-afe5805cd744 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:40.744833 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c5cdc9-e65f-405d-9243-afe5805cd744 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:40.745252 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c5cdc9-e65f-405d-9243-afe5805cd744 None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:40.746680 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c5cdc9-e65f-405d-9243-afe5805cd744 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:40.747129 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c5cdc9-e65f-405d-9243-afe5805cd744 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:40.748684 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c5cdc9-e65f-405d-9243-afe5805cd744 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:40.758138 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 176/343] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Aug 2 21:27:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:40.761068 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5a62c1-ee76-4e29-a757-83e27d2dcedd None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:40.764572 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c5cdc9-e65f-405d-9243-afe5805cd744 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:40.887355 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c5cdc9-e65f-405d-9243-afe5805cd744 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:40.927034 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287c0507-c18b-4141-a346-df69554626f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:40.928071 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287c0507-c18b-4141-a346-df69554626f9 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:40.928557 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287c0507-c18b-4141-a346-df69554626f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:40.929042 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287c0507-c18b-4141-a346-df69554626f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:40.960969 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:40.974514 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5a62c1-ee76-4e29-a757-83e27d2dcedd None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:41.010053 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287c0507-c18b-4141-a346-df69554626f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:41.011881 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287c0507-c18b-4141-a346-df69554626f9 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:41.037824 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:41.068987 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0534d3b2-dd87-47aa-8dc6-74a6abdf1647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:41.069682 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0534d3b2-dd87-47aa-8dc6-74a6abdf1647 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:41.070033 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0534d3b2-dd87-47aa-8dc6-74a6abdf1647 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:41.070375 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0534d3b2-dd87-47aa-8dc6-74a6abdf1647 None admin] PATH_INFO: `/v3/projects/66ccc6e8e7254f0795008b4785dcdaa7` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:41.071642 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0534d3b2-dd87-47aa-8dc6-74a6abdf1647 None admin] RBAC: Authorizing `identity:get_project(project_id=66ccc6e8e7254f0795008b4785dcdaa7)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:41.073402 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0534d3b2-dd87-47aa-8dc6-74a6abdf1647 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:41.075476 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 168/344] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Aug 2 21:27:40 2022] GET /identity/v3/projects/66ccc6e8e7254f0795008b4785dcdaa7 => generated 298 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:41.080266 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4466759-974d-457e-91ed-ea0fe9dd81c3 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:41.080266 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4466759-974d-457e-91ed-ea0fe9dd81c3 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:41.080266 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4466759-974d-457e-91ed-ea0fe9dd81c3 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:41.084591 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 169/345] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:27:41 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:27:41.085774 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b958f7-3c49-4469-827a-43cc351aa884 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:41.086058 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b958f7-3c49-4469-827a-43cc351aa884 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:41.086335 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b958f7-3c49-4469-827a-43cc351aa884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:41.124913 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-55b958f7-3c49-4469-827a-43cc351aa884 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:41.126120 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-55b958f7-3c49-4469-827a-43cc351aa884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:41.134018 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 177/346] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 2 21:27:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 21:27:41.135219 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287c0507-c18b-4141-a346-df69554626f9 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:41.200011 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:41.248480 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287c0507-c18b-4141-a346-df69554626f9 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:41.260824 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 170/347] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:27:41.261518 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b958f7-3c49-4469-827a-43cc351aa884 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:41.299141 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53becc48-ad8c-4fac-9720-a938d33f9d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:41.300119 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53becc48-ad8c-4fac-9720-a938d33f9d56 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:41.300706 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53becc48-ad8c-4fac-9720-a938d33f9d56 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:41.301202 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53becc48-ad8c-4fac-9720-a938d33f9d56 None admin] PATH_INFO: `/v3/groups/1d031df6a7ea4d80867c1a81b69d75b6` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:41.308752 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53becc48-ad8c-4fac-9720-a938d33f9d56 None admin] RBAC: Authorizing `identity:get_group(group_id=1d031df6a7ea4d80867c1a81b69d75b6)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:41.310693 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53becc48-ad8c-4fac-9720-a938d33f9d56 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:41.312890 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 178/348] 10.222.0.70 () {56 vars in 1180 bytes} [Tue Aug 2 21:27:41 2022] GET /identity/v3/groups/1d031df6a7ea4d80867c1a81b69d75b6 => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:41.318806 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53becc48-ad8c-4fac-9720-a938d33f9d56 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:41.394648 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b958f7-3c49-4469-827a-43cc351aa884 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:41.422553 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:41.438566 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53becc48-ad8c-4fac-9720-a938d33f9d56 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:41.438874 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c93c98-8683-4742-9f62-e35c486beb4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:41.439531 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c93c98-8683-4742-9f62-e35c486beb4d None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:41.439822 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c93c98-8683-4742-9f62-e35c486beb4d None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:41.440268 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c93c98-8683-4742-9f62-e35c486beb4d None admin] PATH_INFO: `/v3/projects/66ccc6e8e7254f0795008b4785dcdaa7` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:41.441522 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c93c98-8683-4742-9f62-e35c486beb4d None admin] RBAC: Authorizing `identity:get_project(project_id=66ccc6e8e7254f0795008b4785dcdaa7)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:41.442984 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c93c98-8683-4742-9f62-e35c486beb4d None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:41.447820 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 171/349] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Aug 2 21:27:41 2022] GET /identity/v3/projects/66ccc6e8e7254f0795008b4785dcdaa7 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:41.449040 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c93c98-8683-4742-9f62-e35c486beb4d None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:41.470642 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:41.487794 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6ff430-b70a-4f9f-8ddb-fceba93abc34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:41.488707 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6ff430-b70a-4f9f-8ddb-fceba93abc34 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:41.489139 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6ff430-b70a-4f9f-8ddb-fceba93abc34 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:41.489563 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6ff430-b70a-4f9f-8ddb-fceba93abc34 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:41.490561 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6ff430-b70a-4f9f-8ddb-fceba93abc34 None admin] RBAC: Adding query filter params (group.id=1d031df6a7ea4d80867c1a81b69d75b6, role.id=462e3381a85c42a9959201f9aa122f7c, scope.project.id=66ccc6e8e7254f0795008b4785dcdaa7) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:41.491067 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6ff430-b70a-4f9f-8ddb-fceba93abc34 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:41.492831 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6ff430-b70a-4f9f-8ddb-fceba93abc34 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:41.500161 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 179/350] 10.222.0.70 () {56 vars in 1376 bytes} [Tue Aug 2 21:27:41 2022] GET /identity/v3/role_assignments?group.id=1d031df6a7ea4d80867c1a81b69d75b6&scope.project.id=66ccc6e8e7254f0795008b4785dcdaa7&role.id=462e3381a85c42a9959201f9aa122f7c => generated 260 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:41.501540 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069f7eef-42ee-410d-ae54-3387170f048b None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:41.501912 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069f7eef-42ee-410d-ae54-3387170f048b None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:41.502194 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069f7eef-42ee-410d-ae54-3387170f048b None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:41.503533 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 180/351] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:27:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:27:41.506207 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb4e20-2056-4ecc-84f0-64abbf15c9c3 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:41.506496 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb4e20-2056-4ecc-84f0-64abbf15c9c3 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:41.506779 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb4e20-2056-4ecc-84f0-64abbf15c9c3 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:41.508517 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 181/352] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:27:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:27:41.513330 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bb4e20-2056-4ecc-84f0-64abbf15c9c3 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:41.594823 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c93c98-8683-4742-9f62-e35c486beb4d None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:41.644819 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55d1cb7-7835-4700-a186-0f2d19f4282e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:41.645752 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55d1cb7-7835-4700-a186-0f2d19f4282e None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:41.646182 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55d1cb7-7835-4700-a186-0f2d19f4282e None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:41.646601 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55d1cb7-7835-4700-a186-0f2d19f4282e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:41.659537 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55d1cb7-7835-4700-a186-0f2d19f4282e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:27:41.661163 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bb4e20-2056-4ecc-84f0-64abbf15c9c3 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:41.665960 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-f55d1cb7-7835-4700-a186-0f2d19f4282e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 21:27:41.665960 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:41.665960 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:41.665960 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:41.665960 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:41.665960 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:41.665960 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:41.665960 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:41.665960 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:41.665960 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:41.665960 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:41.665960 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:41.665960 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:27:41.665960 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:27:41.665960 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:27:41.665960 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:27:41.666926 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:27:41.666926 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:27:41.666926 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:27:41.666926 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:27:41.666926 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:41.666926 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:41.666926 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:41.666926 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:41.666926 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:41.666926 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:41.666926 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:41.666926 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:41.666926 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:41.666926 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:41.666926 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:41.666926 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:41.669042 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:41.669042 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:41.669042 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:41.669042 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:41.669042 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:27:41.669042 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:27:41.669042 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:27:41.669042 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:27:41.669042 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:27:41.669042 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:27:41.669042 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 21:27:41.669042 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:27:41.671273 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 172/353] 10.222.0.70 () {56 vars in 1114 bytes} [Tue Aug 2 21:27:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:41.672735 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe78683-74f3-4925-bd10-528e222db00f None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:41.673288 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe78683-74f3-4925-bd10-528e222db00f None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:41.673707 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe78683-74f3-4925-bd10-528e222db00f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:41.694205 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-3fe78683-74f3-4925-bd10-528e222db00f None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:41.695674 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-3fe78683-74f3-4925-bd10-528e222db00f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:41.703770 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72743b7e-624e-43fa-bc82-55b78fbda082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:41.704512 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72743b7e-624e-43fa-bc82-55b78fbda082 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:41.704801 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72743b7e-624e-43fa-bc82-55b78fbda082 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:41.705461 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72743b7e-624e-43fa-bc82-55b78fbda082 None admin] PATH_INFO: `/v3/groups/1d031df6a7ea4d80867c1a81b69d75b6` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:41.706303 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72743b7e-624e-43fa-bc82-55b78fbda082 None admin] RBAC: Authorizing `identity:get_group(group_id=1d031df6a7ea4d80867c1a81b69d75b6)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:41.707808 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72743b7e-624e-43fa-bc82-55b78fbda082 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:41.714408 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 182/354] 10.222.0.70 () {56 vars in 1180 bytes} [Tue Aug 2 21:27:41 2022] GET /identity/v3/groups/1d031df6a7ea4d80867c1a81b69d75b6 => generated 226 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:41.715962 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb2141-ff9b-4486-b0aa-fe0ec7acf202 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:41.716262 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb2141-ff9b-4486-b0aa-fe0ec7acf202 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:41.716552 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacb2141-ff9b-4486-b0aa-fe0ec7acf202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:41.735515 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-aacb2141-ff9b-4486-b0aa-fe0ec7acf202 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:41.736779 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-aacb2141-ff9b-4486-b0aa-fe0ec7acf202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:41.771321 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:41.798758 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:41.802405 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 173/355] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:27:41.804114 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe78683-74f3-4925-bd10-528e222db00f None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:41.843813 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 183/356] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:27:41.843813 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacb2141-ff9b-4486-b0aa-fe0ec7acf202 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:41.958324 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe78683-74f3-4925-bd10-528e222db00f None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:41.986562 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacb2141-ff9b-4486-b0aa-fe0ec7acf202 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:41.994911 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee91cab-7db8-4758-8a0a-b95895eba865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:41.995617 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee91cab-7db8-4758-8a0a-b95895eba865 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:41.996441 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee91cab-7db8-4758-8a0a-b95895eba865 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:41.996724 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee91cab-7db8-4758-8a0a-b95895eba865 None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:41.997451 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee91cab-7db8-4758-8a0a-b95895eba865 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:41.997760 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee91cab-7db8-4758-8a0a-b95895eba865 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:41.999151 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee91cab-7db8-4758-8a0a-b95895eba865 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:42.008209 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 174/357] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Aug 2 21:27:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:42.009080 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee91cab-7db8-4758-8a0a-b95895eba865 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:42.029652 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843d3e97-d642-41e9-b7cc-9f6826e1683c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:42.030253 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843d3e97-d642-41e9-b7cc-9f6826e1683c None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:42.030541 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843d3e97-d642-41e9-b7cc-9f6826e1683c None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:42.030818 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843d3e97-d642-41e9-b7cc-9f6826e1683c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:42.031625 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843d3e97-d642-41e9-b7cc-9f6826e1683c None admin] RBAC: Adding query filter params (group.id=1d031df6a7ea4d80867c1a81b69d75b6, role.id=14ed906e656a4c1cabd17ceae4a1f872, scope.project.id=66ccc6e8e7254f0795008b4785dcdaa7) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:42.031938 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843d3e97-d642-41e9-b7cc-9f6826e1683c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:42.033512 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843d3e97-d642-41e9-b7cc-9f6826e1683c None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:42.039899 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 184/358] 10.222.0.70 () {56 vars in 1376 bytes} [Tue Aug 2 21:27:41 2022] GET /identity/v3/role_assignments?group.id=1d031df6a7ea4d80867c1a81b69d75b6&scope.project.id=66ccc6e8e7254f0795008b4785dcdaa7&role.id=14ed906e656a4c1cabd17ceae4a1f872 => generated 260 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:42.040760 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843d3e97-d642-41e9-b7cc-9f6826e1683c None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:42.067667 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:42.124608 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:42.143861 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee91cab-7db8-4758-8a0a-b95895eba865 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:42.198626 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9975e238-05aa-4c6e-9e53-2b4575d4e656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:42.199559 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9975e238-05aa-4c6e-9e53-2b4575d4e656 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:42.200304 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9975e238-05aa-4c6e-9e53-2b4575d4e656 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:42.200602 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9975e238-05aa-4c6e-9e53-2b4575d4e656 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:42.203141 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843d3e97-d642-41e9-b7cc-9f6826e1683c None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:42.215789 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9975e238-05aa-4c6e-9e53-2b4575d4e656 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:27:42.222088 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-9975e238-05aa-4c6e-9e53-2b4575d4e656 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 21:27:42.222088 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:42.222088 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:42.222088 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:42.222088 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:42.222088 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:42.222088 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:42.222088 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:42.222088 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:42.222088 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:42.222088 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:42.222088 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:42.222088 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:27:42.222088 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:27:42.222088 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:27:42.222088 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:27:42.223019 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:27:42.223019 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:27:42.223019 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:27:42.223019 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:27:42.223019 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:42.223019 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:42.223019 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:42.223019 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:42.223019 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:42.223019 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:42.223019 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:42.223019 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:42.223019 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:42.223019 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:42.223019 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:42.223019 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:42.223809 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:42.223809 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:42.223809 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:42.223809 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:42.223809 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:27:42.223809 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:27:42.223809 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:27:42.223809 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:27:42.223809 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:27:42.223809 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:27:42.223809 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 21:27:42.223809 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:27:42.228377 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 175/359] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 2 21:27:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:42.230596 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548b9a8d-66b8-4249-84f4-0b02facf52af None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:42.231031 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548b9a8d-66b8-4249-84f4-0b02facf52af None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:42.231134 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548b9a8d-66b8-4249-84f4-0b02facf52af None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:42.232507 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 176/360] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:27:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:27:42.233210 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548b9a8d-66b8-4249-84f4-0b02facf52af None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:42.264877 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca7623c-2615-4a6a-b0d1-542ebf17886c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:42.265540 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca7623c-2615-4a6a-b0d1-542ebf17886c None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:42.265830 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca7623c-2615-4a6a-b0d1-542ebf17886c None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:42.266109 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca7623c-2615-4a6a-b0d1-542ebf17886c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:42.280725 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca7623c-2615-4a6a-b0d1-542ebf17886c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:27:42.289180 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-4ca7623c-2615-4a6a-b0d1-542ebf17886c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 21:27:42.289180 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:42.289180 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:42.289180 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:42.289180 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:42.289180 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:42.289180 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:42.289180 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:42.289180 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:42.289180 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:42.289180 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:42.289180 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:42.289180 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:27:42.289180 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:27:42.289180 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:27:42.289180 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:27:42.290114 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:27:42.290114 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:27:42.290114 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:27:42.290114 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:27:42.290114 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:42.290114 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:42.290114 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:42.290114 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:42.290114 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:42.290114 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:42.290114 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:42.290114 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:42.290114 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:42.290114 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:42.290114 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:42.290114 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:42.290951 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:42.290951 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:42.290951 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:42.290951 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:42.290951 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:27:42.290951 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:27:42.290951 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:27:42.290951 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:27:42.290951 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:27:42.290951 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:27:42.290951 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 02 21:27:42.290951 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:27:42.290951 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 185/361] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 2 21:27:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:42.291638 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca7623c-2615-4a6a-b0d1-542ebf17886c None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:42.380139 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548b9a8d-66b8-4249-84f4-0b02facf52af None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:42.383778 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:42.416993 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca7623c-2615-4a6a-b0d1-542ebf17886c None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:42.424291 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b8943d-31ee-42b5-9fee-aa5e25f92815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:42.424982 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b8943d-31ee-42b5-9fee-aa5e25f92815 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:42.425328 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b8943d-31ee-42b5-9fee-aa5e25f92815 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:42.425656 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b8943d-31ee-42b5-9fee-aa5e25f92815 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:42.428941 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:42.459545 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f73edb8-ccc1-4946-8605-1ab75ccd319c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:42.460164 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f73edb8-ccc1-4946-8605-1ab75ccd319c None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:42.460631 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f73edb8-ccc1-4946-8605-1ab75ccd319c None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:42.461011 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f73edb8-ccc1-4946-8605-1ab75ccd319c None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:42.461816 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f73edb8-ccc1-4946-8605-1ab75ccd319c None admin] RBAC: Adding query filter params (name=member) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:42.462174 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f73edb8-ccc1-4946-8605-1ab75ccd319c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:42.463829 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f73edb8-ccc1-4946-8605-1ab75ccd319c None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:42.474771 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 186/362] 10.222.0.70 () {56 vars in 1101 bytes} [Tue Aug 2 21:27:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:42.476076 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c6c467-68cb-44e4-933a-e9021026ecb9 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:42.481333 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c6c467-68cb-44e4-933a-e9021026ecb9 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:42.481333 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c6c467-68cb-44e4-933a-e9021026ecb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:42.501837 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-69c6c467-68cb-44e4-933a-e9021026ecb9 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:42.503907 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-69c6c467-68cb-44e4-933a-e9021026ecb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:42.524305 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b8943d-31ee-42b5-9fee-aa5e25f92815 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:42.526186 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b8943d-31ee-42b5-9fee-aa5e25f92815 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:42.612223 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 187/363] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:27:42.613748 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c6c467-68cb-44e4-933a-e9021026ecb9 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:42.703344 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 177/364] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 2 21:27:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 21:27:42.704209 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b8943d-31ee-42b5-9fee-aa5e25f92815 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:42.713586 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:42.742375 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:42.748638 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c6c467-68cb-44e4-933a-e9021026ecb9 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:42.801131 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd32d91-aec5-4de4-b854-bf03e8939773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:42.802688 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd32d91-aec5-4de4-b854-bf03e8939773 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:42.803202 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd32d91-aec5-4de4-b854-bf03e8939773 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:42.803670 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd32d91-aec5-4de4-b854-bf03e8939773 None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:42.804653 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd32d91-aec5-4de4-b854-bf03e8939773 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:42.805173 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd32d91-aec5-4de4-b854-bf03e8939773 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:42.806791 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd32d91-aec5-4de4-b854-bf03e8939773 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:42.817924 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 188/365] 10.222.0.70 () {56 vars in 1101 bytes} [Tue Aug 2 21:27:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:42.819058 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd32d91-aec5-4de4-b854-bf03e8939773 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:42.855828 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b8943d-31ee-42b5-9fee-aa5e25f92815 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:42.901676 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0393a813-0ffd-4893-aa06-f61da5dd8ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:42.903172 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0393a813-0ffd-4893-aa06-f61da5dd8ddd None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:42.903672 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0393a813-0ffd-4893-aa06-f61da5dd8ddd None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:42.904147 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0393a813-0ffd-4893-aa06-f61da5dd8ddd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:42.965479 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd32d91-aec5-4de4-b854-bf03e8939773 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:43.001433 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0393a813-0ffd-4893-aa06-f61da5dd8ddd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:43.003877 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0393a813-0ffd-4893-aa06-f61da5dd8ddd None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:43.006832 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:43.009272 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82cd26a-98f6-4d8f-a3ac-97a60dd84b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:43.010722 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82cd26a-98f6-4d8f-a3ac-97a60dd84b25 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:43.011857 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82cd26a-98f6-4d8f-a3ac-97a60dd84b25 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:43.012375 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82cd26a-98f6-4d8f-a3ac-97a60dd84b25 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:43.025724 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82cd26a-98f6-4d8f-a3ac-97a60dd84b25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:27:43.031711 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-d82cd26a-98f6-4d8f-a3ac-97a60dd84b25 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 21:27:43.031711 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:43.031711 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:43.031711 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:43.031711 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:43.031711 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:43.031711 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:43.031711 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:43.031711 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:43.031711 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:43.031711 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:43.031711 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:43.031711 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:27:43.031711 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:27:43.031711 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:27:43.031711 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:27:43.032660 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:27:43.032660 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:27:43.032660 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:27:43.032660 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:27:43.032660 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:43.032660 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:43.032660 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:43.032660 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:43.032660 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:43.032660 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:43.032660 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:43.032660 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:43.032660 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:43.032660 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:43.032660 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:43.032660 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:43.033458 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:43.033458 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:43.033458 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:43.033458 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:43.033458 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:27:43.033458 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:27:43.033458 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:27:43.033458 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:27:43.033458 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:27:43.033458 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:27:43.033458 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 21:27:43.033458 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:27:43.035996 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 189/366] 10.222.0.70 () {56 vars in 1096 bytes} [Tue Aug 2 21:27:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:43.037195 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82cd26a-98f6-4d8f-a3ac-97a60dd84b25 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:43.067360 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:43.133864 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 178/367] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 2 21:27:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 21:27:43.135196 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0393a813-0ffd-4893-aa06-f61da5dd8ddd None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:43.172850 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82cd26a-98f6-4d8f-a3ac-97a60dd84b25 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:43.216398 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8921567-e86f-40e9-914b-59ba074ce2af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:43.217052 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8921567-e86f-40e9-914b-59ba074ce2af None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:43.217357 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8921567-e86f-40e9-914b-59ba074ce2af None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:43.217659 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8921567-e86f-40e9-914b-59ba074ce2af None admin] PATH_INFO: `/v3/projects/73bf4e4564964659b960ebf8920609ff` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:43.219228 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8921567-e86f-40e9-914b-59ba074ce2af None admin] RBAC: Authorizing `identity:get_project(project_id=73bf4e4564964659b960ebf8920609ff)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:43.220266 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8921567-e86f-40e9-914b-59ba074ce2af None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:43.222352 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 190/368] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Aug 2 21:27:43 2022] GET /identity/v3/projects/73bf4e4564964659b960ebf8920609ff => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:43.223076 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8921567-e86f-40e9-914b-59ba074ce2af None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:43.258237 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0393a813-0ffd-4893-aa06-f61da5dd8ddd None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:43.276605 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:43.296765 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ca4a19-181e-40ef-9c4e-64984dfb5860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:43.298476 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ca4a19-181e-40ef-9c4e-64984dfb5860 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:43.298997 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ca4a19-181e-40ef-9c4e-64984dfb5860 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:43.299487 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ca4a19-181e-40ef-9c4e-64984dfb5860 None admin] PATH_INFO: `/v3/users/d38d65fb74674e6dabdc23190ae9aa90` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:43.300916 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ca4a19-181e-40ef-9c4e-64984dfb5860 None admin] RBAC: Authorizing `identity:get_user(user_id=d38d65fb74674e6dabdc23190ae9aa90)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:43.302669 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ca4a19-181e-40ef-9c4e-64984dfb5860 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:43.305628 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 179/369] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Aug 2 21:27:43 2022] GET /identity/v3/users/d38d65fb74674e6dabdc23190ae9aa90 => generated 293 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:43.306773 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ca4a19-181e-40ef-9c4e-64984dfb5860 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:43.336130 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:43.347985 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8921567-e86f-40e9-914b-59ba074ce2af None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:43.387454 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9446e7ae-89a5-492d-8e7b-a7673cec9f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:43.388103 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9446e7ae-89a5-492d-8e7b-a7673cec9f76 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:43.388422 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9446e7ae-89a5-492d-8e7b-a7673cec9f76 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:43.388702 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9446e7ae-89a5-492d-8e7b-a7673cec9f76 None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:43.389984 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9446e7ae-89a5-492d-8e7b-a7673cec9f76 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:43.389984 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9446e7ae-89a5-492d-8e7b-a7673cec9f76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:43.391130 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9446e7ae-89a5-492d-8e7b-a7673cec9f76 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:43.401386 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 191/370] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 2 21:27:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:43.402313 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9446e7ae-89a5-492d-8e7b-a7673cec9f76 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:43.429909 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ca4a19-181e-40ef-9c4e-64984dfb5860 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:43.469766 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed497167-45b2-4eeb-89cf-68a6f43e3de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:43.470932 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed497167-45b2-4eeb-89cf-68a6f43e3de1 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:43.471539 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed497167-45b2-4eeb-89cf-68a6f43e3de1 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:43.472028 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed497167-45b2-4eeb-89cf-68a6f43e3de1 None admin] PATH_INFO: `/v3/projects/73bf4e4564964659b960ebf8920609ff` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:43.473460 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed497167-45b2-4eeb-89cf-68a6f43e3de1 None admin] RBAC: Authorizing `identity:get_project(project_id=73bf4e4564964659b960ebf8920609ff)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:43.475198 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed497167-45b2-4eeb-89cf-68a6f43e3de1 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:43.477190 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 180/371] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Aug 2 21:27:43 2022] GET /identity/v3/projects/73bf4e4564964659b960ebf8920609ff => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:43.478245 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed497167-45b2-4eeb-89cf-68a6f43e3de1 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:43.523075 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9446e7ae-89a5-492d-8e7b-a7673cec9f76 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:43.538623 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:43.572492 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7030d9-b5af-4a8d-b95d-b6546807ac57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:43.574451 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7030d9-b5af-4a8d-b95d-b6546807ac57 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:43.575051 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7030d9-b5af-4a8d-b95d-b6546807ac57 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:43.575537 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7030d9-b5af-4a8d-b95d-b6546807ac57 None admin] PATH_INFO: `/v3/groups/1d031df6a7ea4d80867c1a81b69d75b6` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:43.577028 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7030d9-b5af-4a8d-b95d-b6546807ac57 None admin] RBAC: Authorizing `identity:get_group(group_id=1d031df6a7ea4d80867c1a81b69d75b6)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:43.579174 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7030d9-b5af-4a8d-b95d-b6546807ac57 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:43.582337 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 192/372] 10.222.0.70 () {56 vars in 1180 bytes} [Tue Aug 2 21:27:43 2022] GET /identity/v3/groups/1d031df6a7ea4d80867c1a81b69d75b6 => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:43.583770 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7030d9-b5af-4a8d-b95d-b6546807ac57 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:43.612224 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed497167-45b2-4eeb-89cf-68a6f43e3de1 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:43.614313 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:43.663202 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6955875-7531-4c58-8862-b262ddb8c1d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:43.663837 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6955875-7531-4c58-8862-b262ddb8c1d1 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:43.664124 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6955875-7531-4c58-8862-b262ddb8c1d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:43.664909 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6955875-7531-4c58-8862-b262ddb8c1d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:43.665725 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6955875-7531-4c58-8862-b262ddb8c1d1 None admin] RBAC: Adding query filter params (role.id=acc98d865c4f4f5cab9d993de06dae36, user.id=d38d65fb74674e6dabdc23190ae9aa90, scope.system=all) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:43.666038 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6955875-7531-4c58-8862-b262ddb8c1d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:43.668501 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6955875-7531-4c58-8862-b262ddb8c1d1 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:43.686598 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 181/373] 10.222.0.70 () {56 vars in 1308 bytes} [Tue Aug 2 21:27:43 2022] GET /identity/v3/role_assignments?user.id=d38d65fb74674e6dabdc23190ae9aa90&scope.system=all&role.id=acc98d865c4f4f5cab9d993de06dae36 => generated 510 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:43.687361 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6955875-7531-4c58-8862-b262ddb8c1d1 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:43.763967 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7030d9-b5af-4a8d-b95d-b6546807ac57 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:43.821415 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d92bd6d-729c-4a7f-a580-f805e90e9769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:43.822559 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d92bd6d-729c-4a7f-a580-f805e90e9769 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:43.823643 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d92bd6d-729c-4a7f-a580-f805e90e9769 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:43.824200 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d92bd6d-729c-4a7f-a580-f805e90e9769 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:43.881542 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6955875-7531-4c58-8862-b262ddb8c1d1 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:43.884045 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:43.934934 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194f16a0-6494-4eea-9177-2d1b30563aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:43.936193 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194f16a0-6494-4eea-9177-2d1b30563aae None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:43.936700 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194f16a0-6494-4eea-9177-2d1b30563aae None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:43.936931 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194f16a0-6494-4eea-9177-2d1b30563aae None admin] PATH_INFO: `/v3/groups/1d031df6a7ea4d80867c1a81b69d75b6` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:43.938725 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194f16a0-6494-4eea-9177-2d1b30563aae None admin] RBAC: Authorizing `identity:get_group(group_id=1d031df6a7ea4d80867c1a81b69d75b6)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:43.940521 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194f16a0-6494-4eea-9177-2d1b30563aae None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:43.944824 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 182/374] 10.222.0.70 () {56 vars in 1180 bytes} [Tue Aug 2 21:27:43 2022] GET /identity/v3/groups/1d031df6a7ea4d80867c1a81b69d75b6 => generated 226 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:43.945654 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194f16a0-6494-4eea-9177-2d1b30563aae None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:43.951451 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d92bd6d-729c-4a7f-a580-f805e90e9769 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:43.953041 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d92bd6d-729c-4a7f-a580-f805e90e9769 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:43.980715 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:44.076847 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194f16a0-6494-4eea-9177-2d1b30563aae None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:44.084199 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 193/375] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 2 21:27:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 501 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 21:27:44.084922 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d92bd6d-729c-4a7f-a580-f805e90e9769 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:44.124570 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70b7205-5e90-4f6d-b943-be1b06b52e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:44.125204 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b7205-5e90-4f6d-b943-be1b06b52e8a None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:44.125490 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b7205-5e90-4f6d-b943-be1b06b52e8a None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:44.125767 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70b7205-5e90-4f6d-b943-be1b06b52e8a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:44.126560 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70b7205-5e90-4f6d-b943-be1b06b52e8a None admin] RBAC: Adding query filter params (group.id=1d031df6a7ea4d80867c1a81b69d75b6, role.id=14ed906e656a4c1cabd17ceae4a1f872, scope.project.id=73bf4e4564964659b960ebf8920609ff) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:44.126874 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70b7205-5e90-4f6d-b943-be1b06b52e8a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:44.129219 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70b7205-5e90-4f6d-b943-be1b06b52e8a None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:44.134693 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 183/376] 10.222.0.70 () {56 vars in 1376 bytes} [Tue Aug 2 21:27:43 2022] GET /identity/v3/role_assignments?group.id=1d031df6a7ea4d80867c1a81b69d75b6&scope.project.id=73bf4e4564964659b960ebf8920609ff&role.id=14ed906e656a4c1cabd17ceae4a1f872 => generated 260 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:44.135870 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfa6478-f7f5-4f46-91f2-242c452070da None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:44.137282 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfa6478-f7f5-4f46-91f2-242c452070da None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:44.137282 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfa6478-f7f5-4f46-91f2-242c452070da None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:44.138208 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 184/377] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:27:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:27:44.138924 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfa6478-f7f5-4f46-91f2-242c452070da None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:44.188958 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:44.239134 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d92bd6d-729c-4a7f-a580-f805e90e9769 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:44.261996 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:44.279106 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18387959-fb66-4d25-864c-207a9d1a7527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:44.279742 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18387959-fb66-4d25-864c-207a9d1a7527 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:44.280027 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18387959-fb66-4d25-864c-207a9d1a7527 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:44.280353 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18387959-fb66-4d25-864c-207a9d1a7527 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:44.281168 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18387959-fb66-4d25-864c-207a9d1a7527 None admin] RBAC: Adding query filter params (group.id=1d031df6a7ea4d80867c1a81b69d75b6, role.id=462e3381a85c42a9959201f9aa122f7c, scope.project.id=73bf4e4564964659b960ebf8920609ff) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:44.281576 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18387959-fb66-4d25-864c-207a9d1a7527 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:44.282943 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18387959-fb66-4d25-864c-207a9d1a7527 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:44.287193 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfa6478-f7f5-4f46-91f2-242c452070da None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:44.289230 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 194/378] 10.222.0.70 () {56 vars in 1376 bytes} [Tue Aug 2 21:27:44 2022] GET /identity/v3/role_assignments?group.id=1d031df6a7ea4d80867c1a81b69d75b6&scope.project.id=73bf4e4564964659b960ebf8920609ff&role.id=462e3381a85c42a9959201f9aa122f7c => generated 260 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:44.296977 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecc89b0-5bc7-40cd-bde5-fcad1ff81b7e None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:44.297213 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecc89b0-5bc7-40cd-bde5-fcad1ff81b7e None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:44.297468 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecc89b0-5bc7-40cd-bde5-fcad1ff81b7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:44.333739 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7c5f50-6fdf-4454-9039-e9158fe7eea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:44.334913 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7c5f50-6fdf-4454-9039-e9158fe7eea8 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:44.335440 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7c5f50-6fdf-4454-9039-e9158fe7eea8 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:44.336006 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7c5f50-6fdf-4454-9039-e9158fe7eea8 None admin] PATH_INFO: `/v3/projects/9e62ec835a2f4472a37ccfe5a26c44f7` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:44.336652 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-0ecc89b0-5bc7-40cd-bde5-fcad1ff81b7e None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:44.337889 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-0ecc89b0-5bc7-40cd-bde5-fcad1ff81b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:44.338622 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7c5f50-6fdf-4454-9039-e9158fe7eea8 None admin] RBAC: Authorizing `identity:get_project(project_id=9e62ec835a2f4472a37ccfe5a26c44f7)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:44.340603 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7c5f50-6fdf-4454-9039-e9158fe7eea8 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:44.342663 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 185/379] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Aug 2 21:27:44 2022] GET /identity/v3/projects/9e62ec835a2f4472a37ccfe5a26c44f7 => generated 344 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:44.348938 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7c5f50-6fdf-4454-9039-e9158fe7eea8 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:44.430520 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 195/380] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:27:44.458262 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecc89b0-5bc7-40cd-bde5-fcad1ff81b7e None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:44.518087 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:44.531822 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7c5f50-6fdf-4454-9039-e9158fe7eea8 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:44.578372 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c188bc-bc27-4a91-ae98-338a36711b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:44.579035 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c188bc-bc27-4a91-ae98-338a36711b9f None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:44.579320 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c188bc-bc27-4a91-ae98-338a36711b9f None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:44.579597 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c188bc-bc27-4a91-ae98-338a36711b9f None admin] PATH_INFO: `/v3/groups/2b230c0386804131b8a3d902dab3ded5` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:44.589091 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c188bc-bc27-4a91-ae98-338a36711b9f None admin] RBAC: Authorizing `identity:get_group(group_id=2b230c0386804131b8a3d902dab3ded5)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:44.591280 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c188bc-bc27-4a91-ae98-338a36711b9f None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:44.593619 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 186/381] 10.222.0.70 () {56 vars in 1180 bytes} [Tue Aug 2 21:27:44 2022] GET /identity/v3/groups/2b230c0386804131b8a3d902dab3ded5 => generated 229 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:27:44.595312 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49584de2-e34a-4e4c-9479-94d2d70a22d2 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:44.595609 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49584de2-e34a-4e4c-9479-94d2d70a22d2 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:44.595892 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49584de2-e34a-4e4c-9479-94d2d70a22d2 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:44.597821 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 187/382] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:27:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:27:44.601083 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49584de2-e34a-4e4c-9479-94d2d70a22d2 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:44.612746 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecc89b0-5bc7-40cd-bde5-fcad1ff81b7e None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:44.631754 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:44.656729 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d739e5df-e9b0-46d8-9518-f253ceb05124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:44.657431 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d739e5df-e9b0-46d8-9518-f253ceb05124 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:44.657863 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d739e5df-e9b0-46d8-9518-f253ceb05124 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:44.658268 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d739e5df-e9b0-46d8-9518-f253ceb05124 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:44.672096 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d739e5df-e9b0-46d8-9518-f253ceb05124 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:27:44.680102 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-d739e5df-e9b0-46d8-9518-f253ceb05124 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 21:27:44.680102 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:44.680102 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:44.680102 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:44.680102 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:44.680102 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:44.680102 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:44.680102 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:44.680102 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:44.680102 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:44.680102 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:44.680102 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:44.680102 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:27:44.680102 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:27:44.680102 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:27:44.680102 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:27:44.681114 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:27:44.681114 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:27:44.681114 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:27:44.681114 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:27:44.681114 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:44.681114 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:44.681114 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:44.681114 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:44.681114 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:44.681114 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:44.681114 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:44.681114 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:44.681114 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:44.681114 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:44.681114 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:44.681114 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:44.683422 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:44.683422 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:44.683422 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:44.683422 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:44.683422 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:27:44.683422 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:27:44.683422 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:27:44.683422 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:27:44.683422 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:27:44.683422 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:27:44.683422 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 21:27:44.683422 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:27:44.683422 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 196/383] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 2 21:27:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 21:27:44.683422 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a343625e-df65-4a57-b94d-3b6cabe17189 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:44.685434 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a343625e-df65-4a57-b94d-3b6cabe17189 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:44.685434 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a343625e-df65-4a57-b94d-3b6cabe17189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:44.714156 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-a343625e-df65-4a57-b94d-3b6cabe17189 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:44.716925 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-a343625e-df65-4a57-b94d-3b6cabe17189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:44.724684 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49584de2-e34a-4e4c-9479-94d2d70a22d2 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:44.771102 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a8187d-cdb5-461a-9c2c-f36455a6668c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:44.771732 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a8187d-cdb5-461a-9c2c-f36455a6668c None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:44.772015 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a8187d-cdb5-461a-9c2c-f36455a6668c None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:44.772319 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a8187d-cdb5-461a-9c2c-f36455a6668c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:44.773648 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a8187d-cdb5-461a-9c2c-f36455a6668c None admin] RBAC: Adding query filter params (group.id=2b230c0386804131b8a3d902dab3ded5, role.id=3e32dbf75f9b41f5adb9fe59851267bb, scope.project.id=9e62ec835a2f4472a37ccfe5a26c44f7) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:44.773965 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a8187d-cdb5-461a-9c2c-f36455a6668c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:44.775954 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a8187d-cdb5-461a-9c2c-f36455a6668c None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:44.785627 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 188/384] 10.222.0.70 () {56 vars in 1376 bytes} [Tue Aug 2 21:27:44 2022] GET /identity/v3/role_assignments?group.id=2b230c0386804131b8a3d902dab3ded5&scope.project.id=9e62ec835a2f4472a37ccfe5a26c44f7&role.id=3e32dbf75f9b41f5adb9fe59851267bb => generated 260 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:44.786745 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a8187d-cdb5-461a-9c2c-f36455a6668c None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:44.824488 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:44.829984 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 197/385] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:27:44.871463 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a343625e-df65-4a57-b94d-3b6cabe17189 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:44.917158 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a8187d-cdb5-461a-9c2c-f36455a6668c None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:44.960836 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea05e54c-c0a3-400b-aa8d-eb37adf5fdcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:44.961473 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea05e54c-c0a3-400b-aa8d-eb37adf5fdcc None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:44.961756 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea05e54c-c0a3-400b-aa8d-eb37adf5fdcc None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:44.962037 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea05e54c-c0a3-400b-aa8d-eb37adf5fdcc None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:44.962838 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea05e54c-c0a3-400b-aa8d-eb37adf5fdcc None admin] RBAC: Adding query filter params (name=member) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:44.963146 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea05e54c-c0a3-400b-aa8d-eb37adf5fdcc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:44.967742 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea05e54c-c0a3-400b-aa8d-eb37adf5fdcc None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:44.979180 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 189/386] 10.222.0.70 () {56 vars in 1101 bytes} [Tue Aug 2 21:27:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:44.984919 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea05e54c-c0a3-400b-aa8d-eb37adf5fdcc None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:45.062232 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a343625e-df65-4a57-b94d-3b6cabe17189 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:45.069278 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:45.134765 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eefd0d-f896-4ced-a226-f8dbd7566a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:45.135427 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eefd0d-f896-4ced-a226-f8dbd7566a8d None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:45.135708 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eefd0d-f896-4ced-a226-f8dbd7566a8d None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:45.135982 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eefd0d-f896-4ced-a226-f8dbd7566a8d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:45.154132 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:45.159139 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99eefd0d-f896-4ced-a226-f8dbd7566a8d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:27:45.165479 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-99eefd0d-f896-4ced-a226-f8dbd7566a8d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 21:27:45.165479 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:45.165479 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:45.165479 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:45.165479 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:45.165479 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:45.165479 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:45.165479 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:45.165479 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:45.165479 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:45.165479 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:45.165479 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:45.165479 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:27:45.165479 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:27:45.165479 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:27:45.165479 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:27:45.166427 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:27:45.166427 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:27:45.166427 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:27:45.166427 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:27:45.166427 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:45.166427 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:45.166427 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:45.166427 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:45.166427 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:45.166427 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:45.166427 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:45.166427 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:45.166427 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:45.166427 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:45.166427 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:45.166427 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:45.167220 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:45.167220 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:45.167220 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:45.167220 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:45.167220 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:27:45.167220 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:27:45.167220 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:27:45.167220 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:27:45.167220 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:27:45.167220 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:27:45.167220 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 21:27:45.167220 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:27:45.168091 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 198/387] 10.222.0.70 () {56 vars in 1114 bytes} [Tue Aug 2 21:27:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:45.177272 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eefd0d-f896-4ced-a226-f8dbd7566a8d None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:45.182297 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea05e54c-c0a3-400b-aa8d-eb37adf5fdcc None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:45.223119 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f60e04-52d7-423e-bc4a-fb5cd55bd3f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:45.224199 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f60e04-52d7-423e-bc4a-fb5cd55bd3f4 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:45.224662 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f60e04-52d7-423e-bc4a-fb5cd55bd3f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:45.224948 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f60e04-52d7-423e-bc4a-fb5cd55bd3f4 None admin] PATH_INFO: `/v3/groups/1d031df6a7ea4d80867c1a81b69d75b6` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:45.226128 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f60e04-52d7-423e-bc4a-fb5cd55bd3f4 None admin] RBAC: Authorizing `identity:get_group(group_id=1d031df6a7ea4d80867c1a81b69d75b6)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:45.227576 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f60e04-52d7-423e-bc4a-fb5cd55bd3f4 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:45.230317 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 190/388] 10.222.0.70 () {56 vars in 1180 bytes} [Tue Aug 2 21:27:44 2022] GET /identity/v3/groups/1d031df6a7ea4d80867c1a81b69d75b6 => generated 226 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:27:45.235730 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f60e04-52d7-423e-bc4a-fb5cd55bd3f4 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:45.356753 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f60e04-52d7-423e-bc4a-fb5cd55bd3f4 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:45.395304 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eff1a2-1cf1-4481-a812-6e8250d11a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:45.396003 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eff1a2-1cf1-4481-a812-6e8250d11a43 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:45.396318 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eff1a2-1cf1-4481-a812-6e8250d11a43 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:45.396602 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eff1a2-1cf1-4481-a812-6e8250d11a43 None admin] PATH_INFO: `/v3/projects/66ccc6e8e7254f0795008b4785dcdaa7` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:45.398094 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eff1a2-1cf1-4481-a812-6e8250d11a43 None admin] RBAC: Authorizing `identity:get_project(project_id=66ccc6e8e7254f0795008b4785dcdaa7)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:45.399604 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6eff1a2-1cf1-4481-a812-6e8250d11a43 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:45.402830 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 191/389] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Aug 2 21:27:45 2022] GET /identity/v3/projects/66ccc6e8e7254f0795008b4785dcdaa7 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:45.408711 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eff1a2-1cf1-4481-a812-6e8250d11a43 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:45.438404 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:45.443359 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eefd0d-f896-4ced-a226-f8dbd7566a8d None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:45.524848 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eff1a2-1cf1-4481-a812-6e8250d11a43 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:45.549556 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f8c401-5f86-416c-be5b-cc66188f65f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:45.550197 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f8c401-5f86-416c-be5b-cc66188f65f4 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:45.550487 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f8c401-5f86-416c-be5b-cc66188f65f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:45.550765 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f8c401-5f86-416c-be5b-cc66188f65f4 None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:45.551497 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f8c401-5f86-416c-be5b-cc66188f65f4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:45.551811 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f8c401-5f86-416c-be5b-cc66188f65f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:45.553224 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f8c401-5f86-416c-be5b-cc66188f65f4 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:45.562963 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f26c35-d883-4b17-a95a-c0563fe865e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:45.563649 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f26c35-d883-4b17-a95a-c0563fe865e0 None admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:45.563934 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f26c35-d883-4b17-a95a-c0563fe865e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:45.564214 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f26c35-d883-4b17-a95a-c0563fe865e0 None admin] PATH_INFO: `/v3/projects/66ccc6e8e7254f0795008b4785dcdaa7/groups/1d031df6a7ea4d80867c1a81b69d75b6/roles/462e3381a85c42a9959201f9aa122f7c` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:45.566293 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f26c35-d883-4b17-a95a-c0563fe865e0 None admin] RBAC: Authorizing `identity:create_grant(project_id=66ccc6e8e7254f0795008b4785dcdaa7, group_id=1d031df6a7ea4d80867c1a81b69d75b6, role_id=462e3381a85c42a9959201f9aa122f7c)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:45.567778 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f26c35-d883-4b17-a95a-c0563fe865e0 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:45.571312 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 199/390] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Aug 2 21:27:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 394 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:45.578164 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f8c401-5f86-416c-be5b-cc66188f65f4 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:45.587343 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 192/391] 10.222.0.70 () {58 vars in 1442 bytes} [Tue Aug 2 21:27:45 2022] PUT /identity/v3/projects/66ccc6e8e7254f0795008b4785dcdaa7/groups/1d031df6a7ea4d80867c1a81b69d75b6/roles/462e3381a85c42a9959201f9aa122f7c => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:27:45.630624 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:45.741787 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f8c401-5f86-416c-be5b-cc66188f65f4 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:45.794743 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180c9dca-9ff7-4a61-9616-bd5fd190c692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:45.795321 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180c9dca-9ff7-4a61-9616-bd5fd190c692 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:45.795610 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180c9dca-9ff7-4a61-9616-bd5fd190c692 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:45.795888 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180c9dca-9ff7-4a61-9616-bd5fd190c692 None admin] PATH_INFO: `/v3/groups/1d031df6a7ea4d80867c1a81b69d75b6` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:45.797085 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180c9dca-9ff7-4a61-9616-bd5fd190c692 None admin] RBAC: Authorizing `identity:get_group(group_id=1d031df6a7ea4d80867c1a81b69d75b6)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:45.798526 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180c9dca-9ff7-4a61-9616-bd5fd190c692 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:45.800453 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 200/392] 10.222.0.70 () {56 vars in 1180 bytes} [Tue Aug 2 21:27:45 2022] GET /identity/v3/groups/1d031df6a7ea4d80867c1a81b69d75b6 => generated 226 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:27:45.805951 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f26c35-d883-4b17-a95a-c0563fe865e0 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:45.910982 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:45.929950 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f26c35-d883-4b17-a95a-c0563fe865e0 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:45.971251 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07092da-ad33-4452-afc1-7fa2e1e517be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:45.972223 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07092da-ad33-4452-afc1-7fa2e1e517be None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:45.972711 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07092da-ad33-4452-afc1-7fa2e1e517be None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:45.973165 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07092da-ad33-4452-afc1-7fa2e1e517be None admin] PATH_INFO: `/v3/projects/66ccc6e8e7254f0795008b4785dcdaa7` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:45.974554 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07092da-ad33-4452-afc1-7fa2e1e517be None admin] RBAC: Authorizing `identity:get_project(project_id=66ccc6e8e7254f0795008b4785dcdaa7)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:45.976191 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07092da-ad33-4452-afc1-7fa2e1e517be None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:45.978360 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 193/393] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Aug 2 21:27:45 2022] GET /identity/v3/projects/66ccc6e8e7254f0795008b4785dcdaa7 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:45.984941 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180c9dca-9ff7-4a61-9616-bd5fd190c692 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:46.094801 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:46.103990 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180c9dca-9ff7-4a61-9616-bd5fd190c692 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:46.145637 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf76176-76ad-4c0c-b438-b7c8a94ecd82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:46.146631 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf76176-76ad-4c0c-b438-b7c8a94ecd82 None admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:46.147095 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf76176-76ad-4c0c-b438-b7c8a94ecd82 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:46.147567 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf76176-76ad-4c0c-b438-b7c8a94ecd82 None admin] PATH_INFO: `/v3/projects/66ccc6e8e7254f0795008b4785dcdaa7/groups/1d031df6a7ea4d80867c1a81b69d75b6/roles/14ed906e656a4c1cabd17ceae4a1f872` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:46.150065 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf76176-76ad-4c0c-b438-b7c8a94ecd82 None admin] RBAC: Authorizing `identity:create_grant(project_id=66ccc6e8e7254f0795008b4785dcdaa7, group_id=1d031df6a7ea4d80867c1a81b69d75b6, role_id=14ed906e656a4c1cabd17ceae4a1f872)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:46.152437 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf76176-76ad-4c0c-b438-b7c8a94ecd82 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:46.171529 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 201/394] 10.222.0.70 () {58 vars in 1442 bytes} [Tue Aug 2 21:27:45 2022] PUT /identity/v3/projects/66ccc6e8e7254f0795008b4785dcdaa7/groups/1d031df6a7ea4d80867c1a81b69d75b6/roles/14ed906e656a4c1cabd17ceae4a1f872 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:27:46.979795 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71be3877-98ff-4c56-a134-f0f27eb96708 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:46.980759 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71be3877-98ff-4c56-a134-f0f27eb96708 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:46.981278 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71be3877-98ff-4c56-a134-f0f27eb96708 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:46.983137 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 194/395] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:27:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:27:46.988365 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ccc19c-7add-4ce2-86c7-0d8c91a48dc0 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:46.989168 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ccc19c-7add-4ce2-86c7-0d8c91a48dc0 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:46.989633 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ccc19c-7add-4ce2-86c7-0d8c91a48dc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:46.998681 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04501f9f-4eab-430d-89d5-88c98ce0f22a None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:46.999225 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04501f9f-4eab-430d-89d5-88c98ce0f22a None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:46.999682 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04501f9f-4eab-430d-89d5-88c98ce0f22a None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:47.001604 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 195/396] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:27:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 21:27:47.006348 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f600e5f-e091-4db8-a777-c1dc4d6dcd64 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:47.006827 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f600e5f-e091-4db8-a777-c1dc4d6dcd64 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:47.007297 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f600e5f-e091-4db8-a777-c1dc4d6dcd64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:47.030283 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-22ccc19c-7add-4ce2-86c7-0d8c91a48dc0 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:47.033064 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-22ccc19c-7add-4ce2-86c7-0d8c91a48dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:47.038995 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-3f600e5f-e091-4db8-a777-c1dc4d6dcd64 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:47.040382 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-3f600e5f-e091-4db8-a777-c1dc4d6dcd64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:47.164136 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 202/397] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:27:47.168909 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 196/398] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 21:27:47.184612 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ccc19c-7add-4ce2-86c7-0d8c91a48dc0 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:47.209801 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f600e5f-e091-4db8-a777-c1dc4d6dcd64 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:47.291809 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:47.304734 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:47.310425 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ccc19c-7add-4ce2-86c7-0d8c91a48dc0 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:47.324461 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f600e5f-e091-4db8-a777-c1dc4d6dcd64 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:47.351235 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca0b8bc-7e12-4347-90df-202bcb6cc197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:47.352159 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca0b8bc-7e12-4347-90df-202bcb6cc197 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:47.352750 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca0b8bc-7e12-4347-90df-202bcb6cc197 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:47.353224 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca0b8bc-7e12-4347-90df-202bcb6cc197 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:47.361887 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d494daf5-713b-4ad2-a643-ead80a6a73ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:47.363069 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d494daf5-713b-4ad2-a643-ead80a6a73ac None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:47.363187 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d494daf5-713b-4ad2-a643-ead80a6a73ac None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:47.363518 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d494daf5-713b-4ad2-a643-ead80a6a73ac None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:47.366460 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca0b8bc-7e12-4347-90df-202bcb6cc197 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:27:47.371994 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-4ca0b8bc-7e12-4347-90df-202bcb6cc197 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 21:27:47.371994 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:47.371994 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:47.371994 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:47.371994 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:47.371994 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:47.371994 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:47.371994 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:47.371994 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:47.371994 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:47.371994 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:47.371994 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:47.371994 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:27:47.371994 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:27:47.371994 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:27:47.371994 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:27:47.372886 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:27:47.372886 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:27:47.372886 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:27:47.372886 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:27:47.372886 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:47.372886 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:47.372886 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:47.372886 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:47.372886 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:47.372886 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:47.372886 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:47.372886 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:47.372886 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:47.372886 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:47.372886 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:47.372886 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:47.373737 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:47.373737 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:47.373737 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:47.373737 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:47.373737 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:27:47.373737 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:27:47.373737 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:27:47.373737 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:27:47.373737 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:27:47.373737 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:27:47.373737 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 21:27:47.373737 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:27:47.374338 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d494daf5-713b-4ad2-a643-ead80a6a73ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:27:47.376510 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 203/399] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 2 21:27:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:47.377911 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8749768-adc2-4614-a479-c45d1a107a00 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:47.378377 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8749768-adc2-4614-a479-c45d1a107a00 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:47.378830 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8749768-adc2-4614-a479-c45d1a107a00 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:47.380156 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-d494daf5-713b-4ad2-a643-ead80a6a73ac None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 21:27:47.380156 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:47.380156 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:47.380156 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:47.380156 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:47.380156 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:47.380156 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:47.380156 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:47.380156 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:47.380156 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:47.380156 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:47.380156 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:47.380156 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:27:47.380156 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:27:47.380156 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:27:47.380156 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:27:47.381070 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:27:47.381070 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:27:47.381070 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:27:47.381070 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:27:47.381070 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:47.381070 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:47.381070 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:47.381070 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:47.381070 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:47.381070 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:47.381070 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:47.381070 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:47.381070 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:47.381070 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:47.381070 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:47.381070 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:47.381857 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:47.381857 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:47.381857 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:47.381857 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:47.381857 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:27:47.381857 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:27:47.381857 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:27:47.381857 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:27:47.381857 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:27:47.381857 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:27:47.381857 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 21:27:47.381857 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:27:47.381857 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 197/400] 10.222.0.70 () {56 vars in 1114 bytes} [Tue Aug 2 21:27:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 21:27:47.382532 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d494daf5-713b-4ad2-a643-ead80a6a73ac None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:47.388847 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 204/401] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:27:47 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:27:47.389684 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8749768-adc2-4614-a479-c45d1a107a00 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:47.502633 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d494daf5-713b-4ad2-a643-ead80a6a73ac None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:47.523209 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8749768-adc2-4614-a479-c45d1a107a00 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:47.537482 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a581a06-5c74-4143-8bfa-ceea239b3336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:47.538116 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a581a06-5c74-4143-8bfa-ceea239b3336 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:47.538400 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a581a06-5c74-4143-8bfa-ceea239b3336 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:47.538681 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a581a06-5c74-4143-8bfa-ceea239b3336 None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:47.539399 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a581a06-5c74-4143-8bfa-ceea239b3336 None admin] RBAC: Adding query filter params (name=member) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:47.539709 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a581a06-5c74-4143-8bfa-ceea239b3336 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:47.541350 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a581a06-5c74-4143-8bfa-ceea239b3336 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:47.550820 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 198/402] 10.222.0.70 () {56 vars in 1101 bytes} [Tue Aug 2 21:27:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:47.552832 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415baf27-2dfc-4464-a8a8-e3a4fade173e None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:47.553128 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415baf27-2dfc-4464-a8a8-e3a4fade173e None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:47.553409 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415baf27-2dfc-4464-a8a8-e3a4fade173e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:47.563713 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:47.567621 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deef88d3-b077-4bf1-87cf-a90f4bfd003e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:47.568575 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deef88d3-b077-4bf1-87cf-a90f4bfd003e None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:47.569062 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deef88d3-b077-4bf1-87cf-a90f4bfd003e None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:47.569546 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deef88d3-b077-4bf1-87cf-a90f4bfd003e None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:47.571285 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deef88d3-b077-4bf1-87cf-a90f4bfd003e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:47.571796 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deef88d3-b077-4bf1-87cf-a90f4bfd003e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:47.573655 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deef88d3-b077-4bf1-87cf-a90f4bfd003e None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:47.575984 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-415baf27-2dfc-4464-a8a8-e3a4fade173e None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:47.577277 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-415baf27-2dfc-4464-a8a8-e3a4fade173e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:47.588218 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 205/403] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Aug 2 21:27:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:47.590336 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deef88d3-b077-4bf1-87cf-a90f4bfd003e None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:47.600696 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:47.656471 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 199/404] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:27:47.657546 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415baf27-2dfc-4464-a8a8-e3a4fade173e None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:47.709281 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deef88d3-b077-4bf1-87cf-a90f4bfd003e None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:47.750126 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e8e450-eb12-463a-907f-ebc9adf32a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:47.751140 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e8e450-eb12-463a-907f-ebc9adf32a96 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:47.751628 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e8e450-eb12-463a-907f-ebc9adf32a96 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:47.752103 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e8e450-eb12-463a-907f-ebc9adf32a96 None admin] PATH_INFO: `/v3/groups/1d031df6a7ea4d80867c1a81b69d75b6` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:47.753536 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e8e450-eb12-463a-907f-ebc9adf32a96 None admin] RBAC: Authorizing `identity:get_group(group_id=1d031df6a7ea4d80867c1a81b69d75b6)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:47.755383 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e8e450-eb12-463a-907f-ebc9adf32a96 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:47.757452 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 206/405] 10.222.0.70 () {56 vars in 1180 bytes} [Tue Aug 2 21:27:47 2022] GET /identity/v3/groups/1d031df6a7ea4d80867c1a81b69d75b6 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:47.758430 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e8e450-eb12-463a-907f-ebc9adf32a96 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:47.780785 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415baf27-2dfc-4464-a8a8-e3a4fade173e None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:47.815141 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddaf569-c9c8-412e-9b92-e0c4395e6a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:47.815726 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddaf569-c9c8-412e-9b92-e0c4395e6a7f None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:47.816014 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddaf569-c9c8-412e-9b92-e0c4395e6a7f None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:47.816314 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddaf569-c9c8-412e-9b92-e0c4395e6a7f None admin] PATH_INFO: `/v3/groups/1d031df6a7ea4d80867c1a81b69d75b6` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:47.817482 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddaf569-c9c8-412e-9b92-e0c4395e6a7f None admin] RBAC: Authorizing `identity:get_group(group_id=1d031df6a7ea4d80867c1a81b69d75b6)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:47.818938 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddaf569-c9c8-412e-9b92-e0c4395e6a7f None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:47.825680 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 200/406] 10.222.0.70 () {56 vars in 1180 bytes} [Tue Aug 2 21:27:47 2022] GET /identity/v3/groups/1d031df6a7ea4d80867c1a81b69d75b6 => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:47.825680 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddaf569-c9c8-412e-9b92-e0c4395e6a7f None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:47.826452 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:47.854223 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:47.883953 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e8e450-eb12-463a-907f-ebc9adf32a96 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:47.925319 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865a5048-e8c1-44db-a284-71bb2b3239d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:47.926441 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865a5048-e8c1-44db-a284-71bb2b3239d1 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:47.927023 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865a5048-e8c1-44db-a284-71bb2b3239d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:47.927501 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865a5048-e8c1-44db-a284-71bb2b3239d1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:47.932026 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddaf569-c9c8-412e-9b92-e0c4395e6a7f None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:47.940096 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865a5048-e8c1-44db-a284-71bb2b3239d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:27:47.946178 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-865a5048-e8c1-44db-a284-71bb2b3239d1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 21:27:47.946178 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:47.946178 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:47.946178 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:47.946178 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:47.946178 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:47.946178 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:47.946178 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:47.946178 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:47.946178 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:47.946178 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:47.946178 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:47.946178 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:27:47.946178 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:27:47.946178 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:27:47.946178 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:27:47.947162 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:27:47.947162 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:27:47.947162 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:27:47.947162 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:27:47.947162 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:47.947162 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:47.947162 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:47.947162 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:47.947162 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:47.947162 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:47.947162 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:47.947162 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:47.947162 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:47.947162 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:47.947162 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:47.947162 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:47.947971 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:47.947971 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:47.947971 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:47.947971 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:47.947971 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:27:47.947971 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:27:47.947971 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:27:47.947971 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:27:47.947971 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:27:47.947971 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:27:47.947971 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 21:27:47.947971 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:27:47.951428 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 207/407] 10.222.0.70 () {56 vars in 1096 bytes} [Tue Aug 2 21:27:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:47.952522 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865a5048-e8c1-44db-a284-71bb2b3239d1 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:47.973749 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa69a94-1a66-423c-a749-65966059ab73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:47.974403 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa69a94-1a66-423c-a749-65966059ab73 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:47.974688 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa69a94-1a66-423c-a749-65966059ab73 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:47.974965 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa69a94-1a66-423c-a749-65966059ab73 None admin] PATH_INFO: `/v3/projects/73bf4e4564964659b960ebf8920609ff` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:47.976127 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa69a94-1a66-423c-a749-65966059ab73 None admin] RBAC: Authorizing `identity:get_project(project_id=73bf4e4564964659b960ebf8920609ff)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:47.977784 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa69a94-1a66-423c-a749-65966059ab73 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:47.979850 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 201/408] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Aug 2 21:27:47 2022] GET /identity/v3/projects/73bf4e4564964659b960ebf8920609ff => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:47.980703 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa69a94-1a66-423c-a749-65966059ab73 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:48.053547 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:48.072328 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865a5048-e8c1-44db-a284-71bb2b3239d1 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:48.086579 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa69a94-1a66-423c-a749-65966059ab73 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:48.113191 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d069dd3b-a141-4d53-b438-906edc9a4341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:48.114328 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d069dd3b-a141-4d53-b438-906edc9a4341 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:48.114922 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d069dd3b-a141-4d53-b438-906edc9a4341 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:48.115397 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d069dd3b-a141-4d53-b438-906edc9a4341 None admin] PATH_INFO: `/v3/projects/73bf4e4564964659b960ebf8920609ff` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:48.116802 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d069dd3b-a141-4d53-b438-906edc9a4341 None admin] RBAC: Authorizing `identity:get_project(project_id=73bf4e4564964659b960ebf8920609ff)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:48.118629 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d069dd3b-a141-4d53-b438-906edc9a4341 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:48.125771 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dd5455-e639-4144-8539-fb076b9a688c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:48.125771 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dd5455-e639-4144-8539-fb076b9a688c None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:48.125771 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dd5455-e639-4144-8539-fb076b9a688c None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:48.125771 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dd5455-e639-4144-8539-fb076b9a688c None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:48.126120 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dd5455-e639-4144-8539-fb076b9a688c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:48.126120 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dd5455-e639-4144-8539-fb076b9a688c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:48.126461 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 208/409] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Aug 2 21:27:47 2022] GET /identity/v3/projects/73bf4e4564964659b960ebf8920609ff => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:48.126971 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dd5455-e639-4144-8539-fb076b9a688c None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:48.127677 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d069dd3b-a141-4d53-b438-906edc9a4341 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:48.130886 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:48.140642 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 202/410] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 2 21:27:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:48.141463 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dd5455-e639-4144-8539-fb076b9a688c None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:48.236603 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d069dd3b-a141-4d53-b438-906edc9a4341 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:48.258225 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dd5455-e639-4144-8539-fb076b9a688c None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:48.273050 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc388075-0eeb-47be-8b76-63d3aaa21558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:48.273617 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc388075-0eeb-47be-8b76-63d3aaa21558 None admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:48.274042 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc388075-0eeb-47be-8b76-63d3aaa21558 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:48.274379 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc388075-0eeb-47be-8b76-63d3aaa21558 None admin] PATH_INFO: `/v3/projects/73bf4e4564964659b960ebf8920609ff/groups/1d031df6a7ea4d80867c1a81b69d75b6/roles/462e3381a85c42a9959201f9aa122f7c` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:48.277178 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc388075-0eeb-47be-8b76-63d3aaa21558 None admin] RBAC: Authorizing `identity:create_grant(project_id=73bf4e4564964659b960ebf8920609ff, group_id=1d031df6a7ea4d80867c1a81b69d75b6, role_id=462e3381a85c42a9959201f9aa122f7c)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:48.278650 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc388075-0eeb-47be-8b76-63d3aaa21558 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:48.296427 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 209/411] 10.222.0.70 () {58 vars in 1442 bytes} [Tue Aug 2 21:27:48 2022] PUT /identity/v3/projects/73bf4e4564964659b960ebf8920609ff/groups/1d031df6a7ea4d80867c1a81b69d75b6/roles/462e3381a85c42a9959201f9aa122f7c => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:27:48.297689 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e613b7-b2ec-4a14-b8cc-f3d885a4ee9c None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:48.297984 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e613b7-b2ec-4a14-b8cc-f3d885a4ee9c None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:48.298264 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e613b7-b2ec-4a14-b8cc-f3d885a4ee9c None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:48.298476 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:48.303642 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 210/412] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:27:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:27:48.303642 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e613b7-b2ec-4a14-b8cc-f3d885a4ee9c None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:48.312096 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3861375-1536-4265-939d-df9a9a09e3ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:48.312842 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3861375-1536-4265-939d-df9a9a09e3ad None admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:48.313129 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3861375-1536-4265-939d-df9a9a09e3ad None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:48.313411 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3861375-1536-4265-939d-df9a9a09e3ad None admin] PATH_INFO: `/v3/projects/73bf4e4564964659b960ebf8920609ff/groups/1d031df6a7ea4d80867c1a81b69d75b6/roles/14ed906e656a4c1cabd17ceae4a1f872` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:48.316509 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3861375-1536-4265-939d-df9a9a09e3ad None admin] RBAC: Authorizing `identity:create_grant(project_id=73bf4e4564964659b960ebf8920609ff, group_id=1d031df6a7ea4d80867c1a81b69d75b6, role_id=14ed906e656a4c1cabd17ceae4a1f872)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:48.318010 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3861375-1536-4265-939d-df9a9a09e3ad None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:48.334602 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 203/413] 10.222.0.70 () {58 vars in 1442 bytes} [Tue Aug 2 21:27:48 2022] PUT /identity/v3/projects/73bf4e4564964659b960ebf8920609ff/groups/1d031df6a7ea4d80867c1a81b69d75b6/roles/14ed906e656a4c1cabd17ceae4a1f872 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:27:48.336069 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ef1883-c9da-49cb-8211-2cd2377ceb52 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:48.336755 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ef1883-c9da-49cb-8211-2cd2377ceb52 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:48.336755 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ef1883-c9da-49cb-8211-2cd2377ceb52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:48.360716 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-51ef1883-c9da-49cb-8211-2cd2377ceb52 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:48.361968 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-51ef1883-c9da-49cb-8211-2cd2377ceb52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:48.392810 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:48.459883 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e613b7-b2ec-4a14-b8cc-f3d885a4ee9c None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:48.484733 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 204/414] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:27:48.507240 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582b393a-e7c6-42f8-9d4b-0dc9e0dae7e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:48.507913 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582b393a-e7c6-42f8-9d4b-0dc9e0dae7e3 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:48.508201 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582b393a-e7c6-42f8-9d4b-0dc9e0dae7e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:48.508527 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582b393a-e7c6-42f8-9d4b-0dc9e0dae7e3 None admin] PATH_INFO: `/v3/groups/2b230c0386804131b8a3d902dab3ded5` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:48.509771 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582b393a-e7c6-42f8-9d4b-0dc9e0dae7e3 None admin] RBAC: Authorizing `identity:get_group(group_id=2b230c0386804131b8a3d902dab3ded5)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:48.511760 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582b393a-e7c6-42f8-9d4b-0dc9e0dae7e3 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:48.513707 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 211/415] 10.222.0.70 () {56 vars in 1180 bytes} [Tue Aug 2 21:27:48 2022] GET /identity/v3/groups/2b230c0386804131b8a3d902dab3ded5 => generated 229 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:48.519402 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ef1883-c9da-49cb-8211-2cd2377ceb52 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:48.521312 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582b393a-e7c6-42f8-9d4b-0dc9e0dae7e3 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:48.647827 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ef1883-c9da-49cb-8211-2cd2377ceb52 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:48.658446 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582b393a-e7c6-42f8-9d4b-0dc9e0dae7e3 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:48.672936 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:48.686901 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81efd10c-881f-4a8d-a352-4ab5b136f114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:48.687595 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81efd10c-881f-4a8d-a352-4ab5b136f114 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:48.687933 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81efd10c-881f-4a8d-a352-4ab5b136f114 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:48.688276 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81efd10c-881f-4a8d-a352-4ab5b136f114 None admin] PATH_INFO: `/v3/projects/9e62ec835a2f4472a37ccfe5a26c44f7` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:48.689614 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81efd10c-881f-4a8d-a352-4ab5b136f114 None admin] RBAC: Authorizing `identity:get_project(project_id=9e62ec835a2f4472a37ccfe5a26c44f7)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:48.690881 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81efd10c-881f-4a8d-a352-4ab5b136f114 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:48.692683 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 205/416] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Aug 2 21:27:48 2022] GET /identity/v3/projects/9e62ec835a2f4472a37ccfe5a26c44f7 => generated 344 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:48.695941 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d5f3e-8cf4-4b21-aceb-761125dedef4 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:48.695941 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d5f3e-8cf4-4b21-aceb-761125dedef4 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:48.695941 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430d5f3e-8cf4-4b21-aceb-761125dedef4 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:48.695941 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 206/417] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:27:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:27:48.701730 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53b2144-068c-410d-8c70-0949b54f86d0 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:48.701988 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53b2144-068c-410d-8c70-0949b54f86d0 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:48.702269 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53b2144-068c-410d-8c70-0949b54f86d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:48.705679 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:48.714927 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5e0a3e-66e1-4da3-9619-0f8333928957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:48.715789 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5e0a3e-66e1-4da3-9619-0f8333928957 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:48.716265 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5e0a3e-66e1-4da3-9619-0f8333928957 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:48.716683 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5e0a3e-66e1-4da3-9619-0f8333928957 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:48.723108 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-d53b2144-068c-410d-8c70-0949b54f86d0 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:48.724423 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-d53b2144-068c-410d-8c70-0949b54f86d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:48.730724 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5e0a3e-66e1-4da3-9619-0f8333928957 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:27:48.738574 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-2e5e0a3e-66e1-4da3-9619-0f8333928957 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 21:27:48.738574 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:48.738574 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:48.738574 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:48.738574 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:48.738574 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:48.738574 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:48.738574 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:48.738574 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:48.738574 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:48.738574 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:48.738574 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:48.738574 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:27:48.738574 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:27:48.738574 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:27:48.738574 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:27:48.739674 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:27:48.739674 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:27:48.739674 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:27:48.739674 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:27:48.739674 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:48.739674 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:48.739674 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:48.739674 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:48.739674 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:48.739674 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:48.739674 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:48.739674 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:48.739674 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:48.739674 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:48.739674 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:48.739674 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:48.740694 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:48.740694 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:48.740694 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:48.740694 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:48.740694 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:27:48.740694 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:27:48.740694 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:27:48.740694 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:27:48.740694 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:27:48.740694 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:27:48.740694 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 21:27:48.740694 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:27:48.743426 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 212/418] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 2 21:27:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:48.744777 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5e0a3e-66e1-4da3-9619-0f8333928957 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:48.802302 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 207/419] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 21:27:48.809564 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53b2144-068c-410d-8c70-0949b54f86d0 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:48.875880 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5e0a3e-66e1-4da3-9619-0f8333928957 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:48.918838 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f973de6-49c7-45fd-bca1-3c0482ff3845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:48.919745 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f973de6-49c7-45fd-bca1-3c0482ff3845 None admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:48.920175 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f973de6-49c7-45fd-bca1-3c0482ff3845 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:48.921052 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f973de6-49c7-45fd-bca1-3c0482ff3845 None admin] PATH_INFO: `/v3/projects/9e62ec835a2f4472a37ccfe5a26c44f7/groups/2b230c0386804131b8a3d902dab3ded5/roles/3e32dbf75f9b41f5adb9fe59851267bb` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:48.923782 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f973de6-49c7-45fd-bca1-3c0482ff3845 None admin] RBAC: Authorizing `identity:create_grant(project_id=9e62ec835a2f4472a37ccfe5a26c44f7, group_id=2b230c0386804131b8a3d902dab3ded5, role_id=3e32dbf75f9b41f5adb9fe59851267bb)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:48.925606 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f973de6-49c7-45fd-bca1-3c0482ff3845 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:48.942801 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 213/420] 10.222.0.70 () {58 vars in 1442 bytes} [Tue Aug 2 21:27:48 2022] PUT /identity/v3/projects/9e62ec835a2f4472a37ccfe5a26c44f7/groups/2b230c0386804131b8a3d902dab3ded5/roles/3e32dbf75f9b41f5adb9fe59851267bb => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:27:48.953997 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f973de6-49c7-45fd-bca1-3c0482ff3845 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:49.008262 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53b2144-068c-410d-8c70-0949b54f86d0 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:49.044658 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:49.061373 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:49.075125 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab07795-1c88-476e-b350-d550203f32b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:49.076445 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab07795-1c88-476e-b350-d550203f32b1 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:49.077043 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab07795-1c88-476e-b350-d550203f32b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:49.077688 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab07795-1c88-476e-b350-d550203f32b1 None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:49.080699 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab07795-1c88-476e-b350-d550203f32b1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:49.081377 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab07795-1c88-476e-b350-d550203f32b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:49.084268 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab07795-1c88-476e-b350-d550203f32b1 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:49.107037 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 208/421] 10.222.0.70 () {56 vars in 1101 bytes} [Tue Aug 2 21:27:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:49.115942 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab07795-1c88-476e-b350-d550203f32b1 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:49.176220 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f973de6-49c7-45fd-bca1-3c0482ff3845 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:49.227617 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7521a757-7db1-4c5b-b498-e8c9b6a9ea57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:49.228371 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7521a757-7db1-4c5b-b498-e8c9b6a9ea57 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:49.228670 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7521a757-7db1-4c5b-b498-e8c9b6a9ea57 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:49.228954 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7521a757-7db1-4c5b-b498-e8c9b6a9ea57 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:49.243794 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7521a757-7db1-4c5b-b498-e8c9b6a9ea57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:27:49.251376 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-7521a757-7db1-4c5b-b498-e8c9b6a9ea57 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 21:27:49.251376 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:49.251376 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:49.251376 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:49.251376 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:49.251376 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:49.251376 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:49.251376 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:49.251376 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:49.251376 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:49.251376 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:49.251376 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:49.251376 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:27:49.251376 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:27:49.251376 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:27:49.251376 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:27:49.252339 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:27:49.252339 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:27:49.252339 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:27:49.252339 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:27:49.252339 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:49.252339 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:49.252339 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:49.252339 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:49.252339 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:49.252339 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:49.252339 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:49.252339 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:49.252339 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:49.252339 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:49.252339 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:49.252339 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:49.253119 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:49.253119 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:49.253119 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:49.253119 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:49.253119 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:27:49.253119 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:27:49.253119 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:27:49.253119 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:27:49.253119 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:27:49.253119 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:27:49.253119 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 21:27:49.253119 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:27:49.253119 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 214/422] 10.222.0.70 () {56 vars in 1114 bytes} [Tue Aug 2 21:27:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:49.261234 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7521a757-7db1-4c5b-b498-e8c9b6a9ea57 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:49.270579 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab07795-1c88-476e-b350-d550203f32b1 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:49.343832 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1b66c0-72fe-484e-9d2b-3c45e99f449f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:49.344484 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1b66c0-72fe-484e-9d2b-3c45e99f449f None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:49.344769 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1b66c0-72fe-484e-9d2b-3c45e99f449f None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:49.345048 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1b66c0-72fe-484e-9d2b-3c45e99f449f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:49.429323 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7521a757-7db1-4c5b-b498-e8c9b6a9ea57 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:49.456184 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:49.460573 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:49.494862 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1b66c0-72fe-484e-9d2b-3c45e99f449f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:49.496927 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1b66c0-72fe-484e-9d2b-3c45e99f449f None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:49.509283 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec1513f-fc6b-4a21-b6bb-cf93dc56ae85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:49.509916 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec1513f-fc6b-4a21-b6bb-cf93dc56ae85 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:49.510203 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec1513f-fc6b-4a21-b6bb-cf93dc56ae85 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:49.510480 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec1513f-fc6b-4a21-b6bb-cf93dc56ae85 None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:49.511232 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec1513f-fc6b-4a21-b6bb-cf93dc56ae85 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:49.511541 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec1513f-fc6b-4a21-b6bb-cf93dc56ae85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:49.512957 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec1513f-fc6b-4a21-b6bb-cf93dc56ae85 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:49.529677 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 215/423] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Aug 2 21:27:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:49.541240 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec1513f-fc6b-4a21-b6bb-cf93dc56ae85 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:49.691856 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 209/424] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 2 21:27:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 576 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 02 21:27:49.697954 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1b66c0-72fe-484e-9d2b-3c45e99f449f None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:49.709832 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec1513f-fc6b-4a21-b6bb-cf93dc56ae85 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:49.745573 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dc444c-0ed9-4daf-8eb3-9957242b1083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:49.746464 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc444c-0ed9-4daf-8eb3-9957242b1083 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:49.746884 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc444c-0ed9-4daf-8eb3-9957242b1083 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:49.747297 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98dc444c-0ed9-4daf-8eb3-9957242b1083 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:49.800733 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:49.804739 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:49.827625 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1b66c0-72fe-484e-9d2b-3c45e99f449f None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:49.832833 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dc444c-0ed9-4daf-8eb3-9957242b1083 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:49.834586 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98dc444c-0ed9-4daf-8eb3-9957242b1083 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:49.902155 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8ef685-fb13-4f80-9c5f-a5d4ff6e5d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:49.903259 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8ef685-fb13-4f80-9c5f-a5d4ff6e5d43 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:49.904750 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8ef685-fb13-4f80-9c5f-a5d4ff6e5d43 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:49.905247 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8ef685-fb13-4f80-9c5f-a5d4ff6e5d43 None admin] PATH_INFO: `/v3/projects/66ccc6e8e7254f0795008b4785dcdaa7` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:49.907542 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8ef685-fb13-4f80-9c5f-a5d4ff6e5d43 None admin] RBAC: Authorizing `identity:get_project(project_id=66ccc6e8e7254f0795008b4785dcdaa7)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:49.911745 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8ef685-fb13-4f80-9c5f-a5d4ff6e5d43 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:49.915067 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 210/425] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Aug 2 21:27:49 2022] GET /identity/v3/projects/66ccc6e8e7254f0795008b4785dcdaa7 => generated 298 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:27:49.925190 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8ef685-fb13-4f80-9c5f-a5d4ff6e5d43 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:49.952642 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 216/426] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 2 21:27:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 21:27:49.958369 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dc444c-0ed9-4daf-8eb3-9957242b1083 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:50.040592 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:50.065253 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98dc444c-0ed9-4daf-8eb3-9957242b1083 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:50.103613 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdb67d7-d006-4337-ba7b-48d9256a3f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:50.104689 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdb67d7-d006-4337-ba7b-48d9256a3f78 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:50.105359 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdb67d7-d006-4337-ba7b-48d9256a3f78 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:50.105826 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdb67d7-d006-4337-ba7b-48d9256a3f78 None admin] PATH_INFO: `/v3/projects/66ccc6e8e7254f0795008b4785dcdaa7` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:50.107231 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdb67d7-d006-4337-ba7b-48d9256a3f78 None admin] RBAC: Authorizing `identity:get_project(project_id=66ccc6e8e7254f0795008b4785dcdaa7)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:50.109091 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdb67d7-d006-4337-ba7b-48d9256a3f78 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:50.111231 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 217/427] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Aug 2 21:27:49 2022] GET /identity/v3/projects/66ccc6e8e7254f0795008b4785dcdaa7 => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:50.117570 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdb67d7-d006-4337-ba7b-48d9256a3f78 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:50.221828 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8ef685-fb13-4f80-9c5f-a5d4ff6e5d43 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:50.226441 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdb67d7-d006-4337-ba7b-48d9256a3f78 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:50.263451 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d90c4a-245c-4beb-976b-2292b76246e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:50.264517 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d90c4a-245c-4beb-976b-2292b76246e1 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:50.265007 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d90c4a-245c-4beb-976b-2292b76246e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:50.265466 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d90c4a-245c-4beb-976b-2292b76246e1 None admin] PATH_INFO: `/v3/groups/1d031df6a7ea4d80867c1a81b69d75b6` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:50.266887 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d90c4a-245c-4beb-976b-2292b76246e1 None admin] RBAC: Authorizing `identity:get_group(group_id=1d031df6a7ea4d80867c1a81b69d75b6)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:50.268681 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d90c4a-245c-4beb-976b-2292b76246e1 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:50.270857 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 218/428] 10.222.0.70 () {56 vars in 1180 bytes} [Tue Aug 2 21:27:50 2022] GET /identity/v3/groups/1d031df6a7ea4d80867c1a81b69d75b6 => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:27:50.277545 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d90c4a-245c-4beb-976b-2292b76246e1 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:50.308717 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:50.319067 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dde256-8842-4f87-b47f-fba22c89cdef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:50.320221 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dde256-8842-4f87-b47f-fba22c89cdef None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:50.320221 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dde256-8842-4f87-b47f-fba22c89cdef None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:50.320443 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dde256-8842-4f87-b47f-fba22c89cdef None admin] PATH_INFO: `/v3/groups/1d031df6a7ea4d80867c1a81b69d75b6` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:50.324992 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dde256-8842-4f87-b47f-fba22c89cdef None admin] RBAC: Authorizing `identity:get_group(group_id=1d031df6a7ea4d80867c1a81b69d75b6)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:50.326430 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dde256-8842-4f87-b47f-fba22c89cdef None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:50.328410 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 211/429] 10.222.0.70 () {56 vars in 1180 bytes} [Tue Aug 2 21:27:49 2022] GET /identity/v3/groups/1d031df6a7ea4d80867c1a81b69d75b6 => generated 226 bytes in 403 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:50.333876 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dde256-8842-4f87-b47f-fba22c89cdef None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:50.393683 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:50.411920 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d90c4a-245c-4beb-976b-2292b76246e1 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:50.450039 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678f7b6d-73e8-4984-bd50-374309fff78c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:50.450994 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678f7b6d-73e8-4984-bd50-374309fff78c None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:50.451493 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678f7b6d-73e8-4984-bd50-374309fff78c None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:50.451962 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678f7b6d-73e8-4984-bd50-374309fff78c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:50.452978 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678f7b6d-73e8-4984-bd50-374309fff78c None admin] RBAC: Adding query filter params (group.id=1d031df6a7ea4d80867c1a81b69d75b6, role.id=14ed906e656a4c1cabd17ceae4a1f872, scope.project.id=66ccc6e8e7254f0795008b4785dcdaa7) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:50.454433 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678f7b6d-73e8-4984-bd50-374309fff78c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:50.456433 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678f7b6d-73e8-4984-bd50-374309fff78c None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:50.467148 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 219/430] 10.222.0.70 () {56 vars in 1376 bytes} [Tue Aug 2 21:27:50 2022] GET /identity/v3/role_assignments?group.id=1d031df6a7ea4d80867c1a81b69d75b6&scope.project.id=66ccc6e8e7254f0795008b4785dcdaa7&role.id=14ed906e656a4c1cabd17ceae4a1f872 => generated 611 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:50.595374 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dde256-8842-4f87-b47f-fba22c89cdef None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:50.640950 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a19fa2c-69cc-437b-9fee-1e9c426aa090 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:50.641271 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a19fa2c-69cc-437b-9fee-1e9c426aa090 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:50.641515 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a19fa2c-69cc-437b-9fee-1e9c426aa090 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:50.643129 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 220/431] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:27:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:27:50.648709 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37e115b-64bd-4941-9d68-98e925b3c7cf None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:50.648995 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37e115b-64bd-4941-9d68-98e925b3c7cf None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:50.649270 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37e115b-64bd-4941-9d68-98e925b3c7cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:50.649362 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665f0d4b-62d3-4dea-9ae8-a8c8cc5550ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:50.650995 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665f0d4b-62d3-4dea-9ae8-a8c8cc5550ea None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:50.650995 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665f0d4b-62d3-4dea-9ae8-a8c8cc5550ea None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:50.650995 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665f0d4b-62d3-4dea-9ae8-a8c8cc5550ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:50.651333 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665f0d4b-62d3-4dea-9ae8-a8c8cc5550ea None admin] RBAC: Adding query filter params (group.id=1d031df6a7ea4d80867c1a81b69d75b6, role.id=462e3381a85c42a9959201f9aa122f7c, scope.project.id=66ccc6e8e7254f0795008b4785dcdaa7) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:50.651692 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665f0d4b-62d3-4dea-9ae8-a8c8cc5550ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:50.653583 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665f0d4b-62d3-4dea-9ae8-a8c8cc5550ea None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:50.662991 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 212/432] 10.222.0.70 () {56 vars in 1376 bytes} [Tue Aug 2 21:27:50 2022] GET /identity/v3/role_assignments?group.id=1d031df6a7ea4d80867c1a81b69d75b6&scope.project.id=66ccc6e8e7254f0795008b4785dcdaa7&role.id=462e3381a85c42a9959201f9aa122f7c => generated 611 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:50.673043 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-b37e115b-64bd-4941-9d68-98e925b3c7cf None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:50.674633 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-b37e115b-64bd-4941-9d68-98e925b3c7cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:50.759982 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 221/433] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 21:27:50.783357 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665f0d4b-62d3-4dea-9ae8-a8c8cc5550ea None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:50.883911 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:50.908666 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665f0d4b-62d3-4dea-9ae8-a8c8cc5550ea None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:50.944917 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7c2beb-3f61-4d54-96a8-ab7566eb7c38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:50.945571 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7c2beb-3f61-4d54-96a8-ab7566eb7c38 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:50.945855 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7c2beb-3f61-4d54-96a8-ab7566eb7c38 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:50.946131 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7c2beb-3f61-4d54-96a8-ab7566eb7c38 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:50.958341 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7c2beb-3f61-4d54-96a8-ab7566eb7c38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:27:50.963924 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-7e7c2beb-3f61-4d54-96a8-ab7566eb7c38 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 02 21:27:50.963924 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:50.963924 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:50.963924 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:50.963924 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:50.963924 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:50.963924 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:50.963924 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:50.963924 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:50.963924 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:50.963924 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:50.963924 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:50.963924 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:27:50.963924 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:27:50.963924 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:27:50.963924 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:27:50.965463 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:27:50.965463 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:27:50.965463 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:27:50.965463 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:27:50.965463 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:50.965463 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:50.965463 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:50.965463 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:50.965463 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:50.965463 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:50.965463 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:50.965463 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:50.965463 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:50.965463 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:50.965463 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:50.965463 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:50.966235 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:50.966235 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:50.966235 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:50.966235 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:50.966235 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:27:50.966235 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:27:50.966235 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:27:50.966235 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:27:50.966235 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:27:50.966235 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:27:50.966235 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 02 21:27:50.966235 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:27:50.966235 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 213/434] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 2 21:27:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:50.971809 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37e115b-64bd-4941-9d68-98e925b3c7cf None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:50.974039 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:51.035753 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af5b69c-dac9-4def-9ecb-1d5f408720df None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:51.036076 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af5b69c-dac9-4def-9ecb-1d5f408720df None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:51.036333 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af5b69c-dac9-4def-9ecb-1d5f408720df None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:51.037962 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 214/435] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:27:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:27:51.043519 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2620df-2b04-45b4-af8a-944e59ebf9d1 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:51.043764 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2620df-2b04-45b4-af8a-944e59ebf9d1 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:51.044042 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2620df-2b04-45b4-af8a-944e59ebf9d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:51.070097 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-2d2620df-2b04-45b4-af8a-944e59ebf9d1 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:51.071983 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-2d2620df-2b04-45b4-af8a-944e59ebf9d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:51.094387 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37e115b-64bd-4941-9d68-98e925b3c7cf None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:51.140521 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601851e2-3960-434f-b5c9-924641e03fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:51.140521 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601851e2-3960-434f-b5c9-924641e03fe5 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:51.140763 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601851e2-3960-434f-b5c9-924641e03fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:51.141004 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601851e2-3960-434f-b5c9-924641e03fe5 None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:51.141962 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601851e2-3960-434f-b5c9-924641e03fe5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:51.142270 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601851e2-3960-434f-b5c9-924641e03fe5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:51.144218 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601851e2-3960-434f-b5c9-924641e03fe5 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:51.153395 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 222/436] 10.222.0.70 () {56 vars in 1101 bytes} [Tue Aug 2 21:27:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:51.154185 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 215/437] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 21:27:51.161501 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601851e2-3960-434f-b5c9-924641e03fe5 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:51.180631 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2620df-2b04-45b4-af8a-944e59ebf9d1 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:51.248596 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:51.280373 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:51.303647 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601851e2-3960-434f-b5c9-924641e03fe5 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:51.320079 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2620df-2b04-45b4-af8a-944e59ebf9d1 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:51.343637 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63abb000-3410-45c0-ba06-69fd7697c2c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:51.344446 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63abb000-3410-45c0-ba06-69fd7697c2c8 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:51.344729 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63abb000-3410-45c0-ba06-69fd7697c2c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:51.345001 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63abb000-3410-45c0-ba06-69fd7697c2c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:51.357383 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4af5ca0-f4d8-4602-aa2f-d5d3fd5af1d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:51.358037 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4af5ca0-f4d8-4602-aa2f-d5d3fd5af1d9 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:51.358320 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4af5ca0-f4d8-4602-aa2f-d5d3fd5af1d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:51.358599 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4af5ca0-f4d8-4602-aa2f-d5d3fd5af1d9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:51.369172 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4af5ca0-f4d8-4602-aa2f-d5d3fd5af1d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:27:51.374605 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-c4af5ca0-f4d8-4602-aa2f-d5d3fd5af1d9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 21:27:51.374605 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:51.374605 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:51.374605 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:51.374605 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:51.374605 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:51.374605 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:51.374605 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:51.374605 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:51.374605 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:51.374605 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:51.374605 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:51.374605 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:27:51.374605 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:27:51.374605 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:27:51.374605 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:27:51.375511 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:27:51.375511 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:27:51.375511 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:27:51.375511 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:27:51.375511 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:51.375511 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:51.375511 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:51.375511 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:51.375511 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:51.375511 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:51.375511 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:51.375511 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:51.375511 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:51.375511 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:51.375511 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:51.375511 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:51.376722 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:51.376722 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:51.376722 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:51.376722 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:51.376722 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:27:51.376722 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:27:51.376722 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:27:51.376722 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:27:51.376722 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:27:51.376722 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:27:51.376722 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 21:27:51.376722 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:27:51.376722 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 216/438] 10.222.0.70 () {56 vars in 1114 bytes} [Tue Aug 2 21:27:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 21:27:51.377674 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cd0fed-7a45-4841-9f44-e57ba0857dc5 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:51.377674 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cd0fed-7a45-4841-9f44-e57ba0857dc5 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:51.377674 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cd0fed-7a45-4841-9f44-e57ba0857dc5 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:51.378717 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 217/439] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:27:51 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:27:51.382156 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cd0fed-7a45-4841-9f44-e57ba0857dc5 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:51.418763 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63abb000-3410-45c0-ba06-69fd7697c2c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:51.420178 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63abb000-3410-45c0-ba06-69fd7697c2c8 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:51.479149 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:51.484278 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cd0fed-7a45-4841-9f44-e57ba0857dc5 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:51.513636 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:51.518514 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 223/440] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 2 21:27:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 21:27:51.519132 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7a0ceb-1854-4be4-a9e9-0b68c010ae46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:51.519819 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7a0ceb-1854-4be4-a9e9-0b68c010ae46 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:51.520108 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7a0ceb-1854-4be4-a9e9-0b68c010ae46 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:51.520418 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7a0ceb-1854-4be4-a9e9-0b68c010ae46 None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:51.521143 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7a0ceb-1854-4be4-a9e9-0b68c010ae46 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:51.521452 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7a0ceb-1854-4be4-a9e9-0b68c010ae46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:51.522926 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7a0ceb-1854-4be4-a9e9-0b68c010ae46 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:51.524262 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fed321-c553-4e69-b012-b6c3e67cf49f None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:51.524547 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fed321-c553-4e69-b012-b6c3e67cf49f None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:51.524817 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fed321-c553-4e69-b012-b6c3e67cf49f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:51.531031 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 218/441] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Aug 2 21:27:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:27:51.531811 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7a0ceb-1854-4be4-a9e9-0b68c010ae46 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:51.543973 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-22fed321-c553-4e69-b012-b6c3e67cf49f None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:51.545213 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-22fed321-c553-4e69-b012-b6c3e67cf49f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:51.610355 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 224/442] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:27:51.611169 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fed321-c553-4e69-b012-b6c3e67cf49f None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:51.643296 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7a0ceb-1854-4be4-a9e9-0b68c010ae46 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:51.677160 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990c9864-e392-4573-b095-31ce1dfb81f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:51.677731 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990c9864-e392-4573-b095-31ce1dfb81f4 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:51.678016 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990c9864-e392-4573-b095-31ce1dfb81f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:51.678294 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990c9864-e392-4573-b095-31ce1dfb81f4 None admin] PATH_INFO: `/v3/projects/73bf4e4564964659b960ebf8920609ff` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:51.679456 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990c9864-e392-4573-b095-31ce1dfb81f4 None admin] RBAC: Authorizing `identity:get_project(project_id=73bf4e4564964659b960ebf8920609ff)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:51.680920 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990c9864-e392-4573-b095-31ce1dfb81f4 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:51.682568 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 219/443] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Aug 2 21:27:51 2022] GET /identity/v3/projects/73bf4e4564964659b960ebf8920609ff => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:51.683861 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990c9864-e392-4573-b095-31ce1dfb81f4 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:51.706088 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:51.712969 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fed321-c553-4e69-b012-b6c3e67cf49f None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:51.744839 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:51.747834 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ac69df-67be-4dfb-a0ec-acd342114d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:51.748435 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ac69df-67be-4dfb-a0ec-acd342114d3f None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:51.748714 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ac69df-67be-4dfb-a0ec-acd342114d3f None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:51.748991 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ac69df-67be-4dfb-a0ec-acd342114d3f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:51.783585 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990c9864-e392-4573-b095-31ce1dfb81f4 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:51.815800 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ac69df-67be-4dfb-a0ec-acd342114d3f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:51.817304 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ac69df-67be-4dfb-a0ec-acd342114d3f None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:51.817430 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d182dd-1ebf-447b-a3ec-f36cf9a2152f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:51.818064 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d182dd-1ebf-447b-a3ec-f36cf9a2152f None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:51.818344 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d182dd-1ebf-447b-a3ec-f36cf9a2152f None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:51.818619 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d182dd-1ebf-447b-a3ec-f36cf9a2152f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:51.828952 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d182dd-1ebf-447b-a3ec-f36cf9a2152f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:27:51.834233 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-a9d182dd-1ebf-447b-a3ec-f36cf9a2152f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 21:27:51.834233 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:51.834233 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:51.834233 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:51.834233 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:51.834233 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:51.834233 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:51.834233 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:51.834233 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:51.834233 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:51.834233 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:51.834233 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:51.834233 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:27:51.834233 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:27:51.834233 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:27:51.834233 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:27:51.835126 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:27:51.835126 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:27:51.835126 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:27:51.835126 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:27:51.835126 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:51.835126 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:51.835126 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:51.835126 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:51.835126 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:51.835126 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:51.835126 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:51.835126 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:51.835126 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:51.835126 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:51.835126 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:51.835126 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:51.835905 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:51.835905 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:51.835905 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:51.835905 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:51.835905 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:27:51.835905 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:27:51.835905 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:27:51.835905 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:27:51.835905 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:27:51.835905 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:27:51.835905 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 21:27:51.835905 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:27:51.835905 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 220/444] 10.222.0.70 () {56 vars in 1096 bytes} [Tue Aug 2 21:27:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:51.836912 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d182dd-1ebf-447b-a3ec-f36cf9a2152f None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:51.912224 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:51.920832 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 225/445] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 2 21:27:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 21:27:51.921645 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ac69df-67be-4dfb-a0ec-acd342114d3f None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:51.939051 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d182dd-1ebf-447b-a3ec-f36cf9a2152f None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:51.961263 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:51.975743 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d864aa7f-dc88-4565-bb41-c48818f53d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:51.976409 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d864aa7f-dc88-4565-bb41-c48818f53d9f None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:51.976698 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d864aa7f-dc88-4565-bb41-c48818f53d9f None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:51.976981 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d864aa7f-dc88-4565-bb41-c48818f53d9f None admin] PATH_INFO: `/v3/groups/1d031df6a7ea4d80867c1a81b69d75b6` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:51.978164 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d864aa7f-dc88-4565-bb41-c48818f53d9f None admin] RBAC: Authorizing `identity:get_group(group_id=1d031df6a7ea4d80867c1a81b69d75b6)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:51.979627 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d864aa7f-dc88-4565-bb41-c48818f53d9f None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:51.981829 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 221/446] 10.222.0.70 () {56 vars in 1180 bytes} [Tue Aug 2 21:27:51 2022] GET /identity/v3/groups/1d031df6a7ea4d80867c1a81b69d75b6 => generated 226 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:51.982586 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d864aa7f-dc88-4565-bb41-c48818f53d9f None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:52.021800 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ac69df-67be-4dfb-a0ec-acd342114d3f None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:52.054503 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8d0080-925b-4715-9f15-b07877581d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:52.055112 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8d0080-925b-4715-9f15-b07877581d5a None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:52.055399 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8d0080-925b-4715-9f15-b07877581d5a None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:52.055675 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8d0080-925b-4715-9f15-b07877581d5a None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:52.056426 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8d0080-925b-4715-9f15-b07877581d5a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:52.056735 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8d0080-925b-4715-9f15-b07877581d5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:52.058712 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8d0080-925b-4715-9f15-b07877581d5a None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:52.066585 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 226/447] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 2 21:27:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:52.067363 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8d0080-925b-4715-9f15-b07877581d5a None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:52.082265 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d864aa7f-dc88-4565-bb41-c48818f53d9f None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:52.115855 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759c0929-f4d7-4d05-a5f0-6acc0b7921dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:52.116516 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759c0929-f4d7-4d05-a5f0-6acc0b7921dd None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:52.116799 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759c0929-f4d7-4d05-a5f0-6acc0b7921dd None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:52.117074 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759c0929-f4d7-4d05-a5f0-6acc0b7921dd None admin] PATH_INFO: `/v3/projects/73bf4e4564964659b960ebf8920609ff` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:52.118220 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759c0929-f4d7-4d05-a5f0-6acc0b7921dd None admin] RBAC: Authorizing `identity:get_project(project_id=73bf4e4564964659b960ebf8920609ff)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:52.119725 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759c0929-f4d7-4d05-a5f0-6acc0b7921dd None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:52.126694 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 222/448] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Aug 2 21:27:51 2022] GET /identity/v3/projects/73bf4e4564964659b960ebf8920609ff => generated 302 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:52.126694 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759c0929-f4d7-4d05-a5f0-6acc0b7921dd None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:52.129504 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:52.174555 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8d0080-925b-4715-9f15-b07877581d5a None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:52.181700 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:52.207716 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaab897-a186-4354-9421-bf759e1163f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:52.208370 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaab897-a186-4354-9421-bf759e1163f9 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:52.208659 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaab897-a186-4354-9421-bf759e1163f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:52.208938 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaab897-a186-4354-9421-bf759e1163f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:52.209732 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaab897-a186-4354-9421-bf759e1163f9 None admin] RBAC: Adding query filter params (group.id=1d031df6a7ea4d80867c1a81b69d75b6, role.id=462e3381a85c42a9959201f9aa122f7c, scope.project.id=73bf4e4564964659b960ebf8920609ff) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:52.210046 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaab897-a186-4354-9421-bf759e1163f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:52.211495 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaab897-a186-4354-9421-bf759e1163f9 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:52.217591 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 227/449] 10.222.0.70 () {56 vars in 1376 bytes} [Tue Aug 2 21:27:52 2022] GET /identity/v3/role_assignments?group.id=1d031df6a7ea4d80867c1a81b69d75b6&scope.project.id=73bf4e4564964659b960ebf8920609ff&role.id=462e3381a85c42a9959201f9aa122f7c => generated 611 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:52.218446 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaab897-a186-4354-9421-bf759e1163f9 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:52.224054 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759c0929-f4d7-4d05-a5f0-6acc0b7921dd None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:52.261687 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3962e79c-9045-44e6-b70a-4d9fceab79a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:52.262435 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3962e79c-9045-44e6-b70a-4d9fceab79a6 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:52.262727 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3962e79c-9045-44e6-b70a-4d9fceab79a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:52.263007 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3962e79c-9045-44e6-b70a-4d9fceab79a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:52.343175 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3962e79c-9045-44e6-b70a-4d9fceab79a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:52.344825 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3962e79c-9045-44e6-b70a-4d9fceab79a6 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:52.353000 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaab897-a186-4354-9421-bf759e1163f9 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:52.375169 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:52.394280 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a18942-2f84-441e-a92f-6a8dbe7ceff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:52.394931 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a18942-2f84-441e-a92f-6a8dbe7ceff9 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:52.395212 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a18942-2f84-441e-a92f-6a8dbe7ceff9 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:52.395526 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a18942-2f84-441e-a92f-6a8dbe7ceff9 None admin] PATH_INFO: `/v3/groups/1d031df6a7ea4d80867c1a81b69d75b6` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:52.397620 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a18942-2f84-441e-a92f-6a8dbe7ceff9 None admin] RBAC: Authorizing `identity:get_group(group_id=1d031df6a7ea4d80867c1a81b69d75b6)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:52.399071 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a18942-2f84-441e-a92f-6a8dbe7ceff9 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:52.400992 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 228/450] 10.222.0.70 () {56 vars in 1180 bytes} [Tue Aug 2 21:27:52 2022] GET /identity/v3/groups/1d031df6a7ea4d80867c1a81b69d75b6 => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:52.407221 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a18942-2f84-441e-a92f-6a8dbe7ceff9 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:52.413524 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:52.467225 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 223/451] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 2 21:27:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 21:27:52.472869 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3962e79c-9045-44e6-b70a-4d9fceab79a6 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:52.529473 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a18942-2f84-441e-a92f-6a8dbe7ceff9 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:52.570704 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123e2b7e-53b1-41fe-897d-9c36077789fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:52.571520 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123e2b7e-53b1-41fe-897d-9c36077789fb None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:52.571627 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123e2b7e-53b1-41fe-897d-9c36077789fb None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:52.571880 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123e2b7e-53b1-41fe-897d-9c36077789fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:52.572717 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123e2b7e-53b1-41fe-897d-9c36077789fb None admin] RBAC: Adding query filter params (group.id=1d031df6a7ea4d80867c1a81b69d75b6, role.id=14ed906e656a4c1cabd17ceae4a1f872, scope.project.id=73bf4e4564964659b960ebf8920609ff) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:52.573035 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123e2b7e-53b1-41fe-897d-9c36077789fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:52.575437 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123e2b7e-53b1-41fe-897d-9c36077789fb None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:52.581155 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 229/452] 10.222.0.70 () {56 vars in 1376 bytes} [Tue Aug 2 21:27:52 2022] GET /identity/v3/role_assignments?group.id=1d031df6a7ea4d80867c1a81b69d75b6&scope.project.id=73bf4e4564964659b960ebf8920609ff&role.id=14ed906e656a4c1cabd17ceae4a1f872 => generated 611 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:27:52.590388 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3962e79c-9045-44e6-b70a-4d9fceab79a6 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:52.627305 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbfa38b-02bf-4019-b192-019aa93f6e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:52.627973 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbfa38b-02bf-4019-b192-019aa93f6e88 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:52.628273 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbfa38b-02bf-4019-b192-019aa93f6e88 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:52.628577 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbfa38b-02bf-4019-b192-019aa93f6e88 None admin] PATH_INFO: `/v3/projects/9e62ec835a2f4472a37ccfe5a26c44f7` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:52.629790 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbfa38b-02bf-4019-b192-019aa93f6e88 None admin] RBAC: Authorizing `identity:get_project(project_id=9e62ec835a2f4472a37ccfe5a26c44f7)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:52.631265 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbfa38b-02bf-4019-b192-019aa93f6e88 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:52.633062 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 224/453] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Aug 2 21:27:52 2022] GET /identity/v3/projects/9e62ec835a2f4472a37ccfe5a26c44f7 => generated 344 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:27:52.639489 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123e2b7e-53b1-41fe-897d-9c36077789fb None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:52.694759 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:52.746831 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123e2b7e-53b1-41fe-897d-9c36077789fb None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:52.781417 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50b9b2c-15f6-44f4-8782-73cd8c5a0b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:52.782068 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50b9b2c-15f6-44f4-8782-73cd8c5a0b4c None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:52.782350 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50b9b2c-15f6-44f4-8782-73cd8c5a0b4c None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:52.782626 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50b9b2c-15f6-44f4-8782-73cd8c5a0b4c None admin] PATH_INFO: `/v3/groups/2b230c0386804131b8a3d902dab3ded5` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:52.783780 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50b9b2c-15f6-44f4-8782-73cd8c5a0b4c None admin] RBAC: Authorizing `identity:get_group(group_id=2b230c0386804131b8a3d902dab3ded5)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:52.785337 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50b9b2c-15f6-44f4-8782-73cd8c5a0b4c None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:52.786929 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 230/454] 10.222.0.70 () {56 vars in 1180 bytes} [Tue Aug 2 21:27:52 2022] GET /identity/v3/groups/2b230c0386804131b8a3d902dab3ded5 => generated 229 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:52.792819 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbfa38b-02bf-4019-b192-019aa93f6e88 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:52.821109 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:52.896269 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbfa38b-02bf-4019-b192-019aa93f6e88 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:52.930961 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2342804-8bd2-4271-8763-63f3b01ee5fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:52.931583 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2342804-8bd2-4271-8763-63f3b01ee5fe None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:52.931869 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2342804-8bd2-4271-8763-63f3b01ee5fe None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:52.932148 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2342804-8bd2-4271-8763-63f3b01ee5fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:52.933578 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2342804-8bd2-4271-8763-63f3b01ee5fe None admin] RBAC: Adding query filter params (group.id=2b230c0386804131b8a3d902dab3ded5, role.id=3e32dbf75f9b41f5adb9fe59851267bb, scope.project.id=9e62ec835a2f4472a37ccfe5a26c44f7) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:52.933891 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2342804-8bd2-4271-8763-63f3b01ee5fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:52.935332 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2342804-8bd2-4271-8763-63f3b01ee5fe None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:52.941071 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 225/455] 10.222.0.70 () {56 vars in 1376 bytes} [Tue Aug 2 21:27:52 2022] GET /identity/v3/role_assignments?group.id=2b230c0386804131b8a3d902dab3ded5&scope.project.id=9e62ec835a2f4472a37ccfe5a26c44f7&role.id=3e32dbf75f9b41f5adb9fe59851267bb => generated 611 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:27:55.346427 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440fc5a8-7f3f-40d6-914c-a26b970ecdc7 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:55.347408 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440fc5a8-7f3f-40d6-914c-a26b970ecdc7 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:55.347893 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440fc5a8-7f3f-40d6-914c-a26b970ecdc7 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:55.349758 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 231/456] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:27:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:27:55.356352 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8065cb07-771c-43da-a41a-1162fcbc97e7 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:55.356794 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8065cb07-771c-43da-a41a-1162fcbc97e7 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:55.356912 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8065cb07-771c-43da-a41a-1162fcbc97e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:55.385555 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-8065cb07-771c-43da-a41a-1162fcbc97e7 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:55.387595 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-8065cb07-771c-43da-a41a-1162fcbc97e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:55.481015 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 226/457] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:27:55.525616 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440fc5a8-7f3f-40d6-914c-a26b970ecdc7 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:55.647213 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440fc5a8-7f3f-40d6-914c-a26b970ecdc7 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:55.668839 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:55.689989 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76c4c50-95bd-4d27-9b1d-8012872fe766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:55.690639 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76c4c50-95bd-4d27-9b1d-8012872fe766 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:55.690927 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76c4c50-95bd-4d27-9b1d-8012872fe766 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:55.691207 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76c4c50-95bd-4d27-9b1d-8012872fe766 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:55.703069 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76c4c50-95bd-4d27-9b1d-8012872fe766 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:55.704581 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76c4c50-95bd-4d27-9b1d-8012872fe766 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:55.727065 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-c76c4c50-95bd-4d27-9b1d-8012872fe766 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:55.727065 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:55.727065 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:55.727065 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:55.727065 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:55.727065 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:55.727065 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:55.727065 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:55.727065 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:55.727065 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:55.727065 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:55.727065 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:55.727065 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:27:55.727065 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:27:55.727065 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:27:55.727945 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:27:55.727945 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:55.727945 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:55.727945 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:55.727945 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:55.727945 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:55.727945 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:55.727945 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:55.727945 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:55.727945 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:55.727945 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:55.727945 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:55.727945 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:55.727945 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:55.727945 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:55.727945 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:55.727945 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:55.729115 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:27:55.729115 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:27:55.729115 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:55.729115 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:27:55.732293 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 232/458] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 2 21:27:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:55.735470 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8065cb07-771c-43da-a41a-1162fcbc97e7 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:55.752596 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc388a-a108-4855-9e5f-eb922a2017ea None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:55.752892 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc388a-a108-4855-9e5f-eb922a2017ea None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:55.753173 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc388a-a108-4855-9e5f-eb922a2017ea None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:55.754782 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 233/459] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:27:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:27:55.765855 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:55.773763 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ace46ec-adbd-42f6-855a-ead3229f24d0 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:55.774089 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ace46ec-adbd-42f6-855a-ead3229f24d0 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:55.774329 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ace46ec-adbd-42f6-855a-ead3229f24d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:55.800578 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-5ace46ec-adbd-42f6-855a-ead3229f24d0 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:55.801788 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-5ace46ec-adbd-42f6-855a-ead3229f24d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:55.924856 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 234/460] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 21:27:55.927060 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8065cb07-771c-43da-a41a-1162fcbc97e7 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:55.964778 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb94157-e5e1-4566-8315-4e8528e63f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:55.965403 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb94157-e5e1-4566-8315-4e8528e63f5c None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:55.965682 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb94157-e5e1-4566-8315-4e8528e63f5c None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:55.966026 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb94157-e5e1-4566-8315-4e8528e63f5c None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:55.966747 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb94157-e5e1-4566-8315-4e8528e63f5c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:55.967030 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb94157-e5e1-4566-8315-4e8528e63f5c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:55.968436 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb94157-e5e1-4566-8315-4e8528e63f5c None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:55.974708 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ace46ec-adbd-42f6-855a-ead3229f24d0 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:56.001260 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 227/461] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 2 21:27:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:56.006128 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb94157-e5e1-4566-8315-4e8528e63f5c None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:56.105107 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:56.130567 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb94157-e5e1-4566-8315-4e8528e63f5c None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:56.170862 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e2ee7a-64ae-4208-b55f-13fcb065954f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:56.171505 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e2ee7a-64ae-4208-b55f-13fcb065954f None admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:56.171792 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e2ee7a-64ae-4208-b55f-13fcb065954f None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:56.172073 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e2ee7a-64ae-4208-b55f-13fcb065954f None admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:56.172795 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e2ee7a-64ae-4208-b55f-13fcb065954f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:56.174241 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e2ee7a-64ae-4208-b55f-13fcb065954f None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:56.201407 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 228/462] 10.222.0.70 () {60 vars in 1132 bytes} [Tue Aug 2 21:27:56 2022] POST /identity/v3/users => generated 246 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:27:56.202481 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ace46ec-adbd-42f6-855a-ead3229f24d0 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:56.202659 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684b52a2-6378-4f51-a6e6-32b31be2c0f6 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:56.202968 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684b52a2-6378-4f51-a6e6-32b31be2c0f6 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:56.203229 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684b52a2-6378-4f51-a6e6-32b31be2c0f6 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:56.204704 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:56.208332 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 229/463] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:27:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:27:56.211553 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08a6053-37df-4a49-af40-20a8ad54e5aa None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:56.216068 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08a6053-37df-4a49-af40-20a8ad54e5aa None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:56.216777 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08a6053-37df-4a49-af40-20a8ad54e5aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:56.262073 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-d08a6053-37df-4a49-af40-20a8ad54e5aa None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:56.263312 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-d08a6053-37df-4a49-af40-20a8ad54e5aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:56.275322 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ec22fa-e66a-45bf-9746-661ba5d202b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:56.275999 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ec22fa-e66a-45bf-9746-661ba5d202b8 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:56.276398 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ec22fa-e66a-45bf-9746-661ba5d202b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:56.276913 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ec22fa-e66a-45bf-9746-661ba5d202b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:56.290332 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ec22fa-e66a-45bf-9746-661ba5d202b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:56.291992 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ec22fa-e66a-45bf-9746-661ba5d202b8 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:56.311128 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-19ec22fa-e66a-45bf-9746-661ba5d202b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:56.311128 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:56.311128 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:56.311128 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:56.311128 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:56.311128 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:56.311128 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:56.311128 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:56.311128 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:56.311128 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:56.311128 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:56.311128 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:56.311128 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:27:56.311128 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:27:56.311128 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:27:56.312046 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:27:56.312046 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:56.312046 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:56.312046 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:56.312046 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:56.312046 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:56.312046 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:56.312046 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:56.312046 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:56.312046 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:56.312046 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:56.312046 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:56.312046 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:56.312046 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:56.312046 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:56.312046 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:56.312046 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:56.312923 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:27:56.312923 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:27:56.312923 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:56.312923 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:27:56.312923 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 235/464] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 2 21:27:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 21:27:56.318668 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ec22fa-e66a-45bf-9746-661ba5d202b8 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:56.411437 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 230/465] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:27:56.414142 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df80a9a-e36b-4f8b-b6be-c18de1ba9b60 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:56.414584 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df80a9a-e36b-4f8b-b6be-c18de1ba9b60 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:56.414980 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df80a9a-e36b-4f8b-b6be-c18de1ba9b60 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:56.416991 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 231/466] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:27:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:27:56.424688 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc191a2-ac16-4406-aef1-4a37a2305c85 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:56.425259 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc191a2-ac16-4406-aef1-4a37a2305c85 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:56.425602 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc191a2-ac16-4406-aef1-4a37a2305c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:56.445347 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-6cc191a2-ac16-4406-aef1-4a37a2305c85 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:56.446666 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-6cc191a2-ac16-4406-aef1-4a37a2305c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:56.462048 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ec22fa-e66a-45bf-9746-661ba5d202b8 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:56.505943 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbe24e1-994c-4881-a4f8-1bbe8987d9dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:56.506690 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbe24e1-994c-4881-a4f8-1bbe8987d9dc None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:56.507046 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbe24e1-994c-4881-a4f8-1bbe8987d9dc None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:56.507394 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbe24e1-994c-4881-a4f8-1bbe8987d9dc None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:56.508108 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbe24e1-994c-4881-a4f8-1bbe8987d9dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:56.508451 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbe24e1-994c-4881-a4f8-1bbe8987d9dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:56.510002 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbe24e1-994c-4881-a4f8-1bbe8987d9dc None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:56.524377 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 236/467] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 2 21:27:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:56.528271 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbe24e1-994c-4881-a4f8-1bbe8987d9dc None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:56.549328 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:56.550965 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:56.561650 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 232/468] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 21:27:56.563313 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc191a2-ac16-4406-aef1-4a37a2305c85 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:56.672923 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbe24e1-994c-4881-a4f8-1bbe8987d9dc None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:56.688620 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc191a2-ac16-4406-aef1-4a37a2305c85 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:56.725256 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62474ab4-ab24-41f6-91e4-7523a21b5d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:56.726378 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62474ab4-ab24-41f6-91e4-7523a21b5d19 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:56.727216 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62474ab4-ab24-41f6-91e4-7523a21b5d19 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:56.727802 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62474ab4-ab24-41f6-91e4-7523a21b5d19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:56.732441 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e53aa2-aaa3-4a9c-900d-fe9d1e62b49b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:56.733197 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e53aa2-aaa3-4a9c-900d-fe9d1e62b49b None admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:56.733597 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e53aa2-aaa3-4a9c-900d-fe9d1e62b49b None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:56.733934 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e53aa2-aaa3-4a9c-900d-fe9d1e62b49b None admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:56.734718 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e53aa2-aaa3-4a9c-900d-fe9d1e62b49b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:56.738869 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e53aa2-aaa3-4a9c-900d-fe9d1e62b49b None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:56.740757 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62474ab4-ab24-41f6-91e4-7523a21b5d19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:56.742504 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62474ab4-ab24-41f6-91e4-7523a21b5d19 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:56.763839 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-62474ab4-ab24-41f6-91e4-7523a21b5d19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:56.763839 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:56.763839 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:56.763839 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:56.763839 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:56.763839 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:56.763839 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:56.763839 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:56.763839 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:56.763839 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:56.763839 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:56.763839 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:56.763839 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:27:56.763839 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:27:56.763839 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:27:56.764845 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:27:56.764845 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:56.764845 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:56.764845 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:56.764845 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:56.764845 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:56.764845 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:56.764845 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:56.764845 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:56.764845 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:56.764845 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:56.764845 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:56.764845 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:56.764845 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:56.764845 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:56.764845 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:56.764845 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:56.765744 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:27:56.765744 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:27:56.765744 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:56.765744 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:27:56.767607 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 237/469] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 2 21:27:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:56.768740 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62474ab4-ab24-41f6-91e4-7523a21b5d19 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:56.769028 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 233/470] 10.222.0.70 () {60 vars in 1132 bytes} [Tue Aug 2 21:27:56 2022] POST /identity/v3/users => generated 248 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:27:56.776478 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e53aa2-aaa3-4a9c-900d-fe9d1e62b49b None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:56.904951 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:56.924981 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:56.972417 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e53aa2-aaa3-4a9c-900d-fe9d1e62b49b None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:56.974004 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62474ab4-ab24-41f6-91e4-7523a21b5d19 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:57.020030 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba14bf92-15ae-427a-8c5c-f0af2b090011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:57.020629 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba14bf92-15ae-427a-8c5c-f0af2b090011 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:57.020913 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba14bf92-15ae-427a-8c5c-f0af2b090011 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:57.021187 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba14bf92-15ae-427a-8c5c-f0af2b090011 None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:57.021887 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba14bf92-15ae-427a-8c5c-f0af2b090011 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:57.022199 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba14bf92-15ae-427a-8c5c-f0af2b090011 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:57.023620 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba14bf92-15ae-427a-8c5c-f0af2b090011 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:57.026065 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146c6a41-db9c-4d7f-82f0-99f306015dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:57.027289 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146c6a41-db9c-4d7f-82f0-99f306015dba None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:57.027575 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146c6a41-db9c-4d7f-82f0-99f306015dba None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:57.027849 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146c6a41-db9c-4d7f-82f0-99f306015dba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:57.037170 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 234/471] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 2 21:27:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:27:57.038280 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b66d7f-7f96-44a3-95db-2eee980ffe86 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:57.038562 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b66d7f-7f96-44a3-95db-2eee980ffe86 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:57.038833 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b66d7f-7f96-44a3-95db-2eee980ffe86 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:57.040147 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 235/472] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:27:57 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:27:57.045494 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b66d7f-7f96-44a3-95db-2eee980ffe86 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:57.049900 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146c6a41-db9c-4d7f-82f0-99f306015dba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:57.050599 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146c6a41-db9c-4d7f-82f0-99f306015dba None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:57.069117 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-146c6a41-db9c-4d7f-82f0-99f306015dba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:57.069117 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:57.069117 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:57.069117 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:57.069117 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:57.069117 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:57.069117 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:57.069117 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:57.069117 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:57.069117 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:57.069117 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:57.069117 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:57.069117 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:27:57.069117 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:27:57.069117 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:27:57.070196 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:27:57.070196 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:57.070196 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:57.070196 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:57.070196 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:57.070196 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:57.070196 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:57.070196 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:57.070196 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:57.070196 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:57.070196 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:57.070196 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:57.070196 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:57.070196 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:57.070196 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:57.070196 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:57.070196 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:57.071266 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:27:57.071266 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:27:57.071266 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:57.071266 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:27:57.071266 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 238/473] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 2 21:27:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:57.071814 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26d125c-acfb-41d6-b3e2-0190ea5b66da None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:57.072137 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26d125c-acfb-41d6-b3e2-0190ea5b66da None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:57.074036 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26d125c-acfb-41d6-b3e2-0190ea5b66da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:57.093972 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-f26d125c-acfb-41d6-b3e2-0190ea5b66da None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:57.095358 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-f26d125c-acfb-41d6-b3e2-0190ea5b66da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:57.177864 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 239/474] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:27:57.178080 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b66d7f-7f96-44a3-95db-2eee980ffe86 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:57.178189 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26d125c-acfb-41d6-b3e2-0190ea5b66da None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:57.203878 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:57.247171 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d884292-f083-412e-89da-ba5989db6994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:57.247807 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d884292-f083-412e-89da-ba5989db6994 None admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:57.248096 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d884292-f083-412e-89da-ba5989db6994 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:57.248440 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d884292-f083-412e-89da-ba5989db6994 None admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:57.249131 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d884292-f083-412e-89da-ba5989db6994 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:57.250764 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d884292-f083-412e-89da-ba5989db6994 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:57.253300 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:57.280851 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 236/475] 10.222.0.70 () {60 vars in 1132 bytes} [Tue Aug 2 21:27:57 2022] POST /identity/v3/users => generated 248 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 21:27:57.281812 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d884292-f083-412e-89da-ba5989db6994 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:57.343011 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26d125c-acfb-41d6-b3e2-0190ea5b66da None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:57.384702 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b6e509-2d95-44c1-a83e-1b515782bd5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:57.385717 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b6e509-2d95-44c1-a83e-1b515782bd5d None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:57.386755 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b6e509-2d95-44c1-a83e-1b515782bd5d None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:57.387265 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b6e509-2d95-44c1-a83e-1b515782bd5d None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:57.388323 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b6e509-2d95-44c1-a83e-1b515782bd5d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:57.388858 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b6e509-2d95-44c1-a83e-1b515782bd5d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:57.390473 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b6e509-2d95-44c1-a83e-1b515782bd5d None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:57.405066 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 240/476] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 2 21:27:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:57.413299 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b6e509-2d95-44c1-a83e-1b515782bd5d None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:57.474832 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d884292-f083-412e-89da-ba5989db6994 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:57.519954 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b6f631-f081-48e9-9cb1-f3ddd9728dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:57.520972 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b6f631-f081-48e9-9cb1-f3ddd9728dfd None admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:57.521458 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b6f631-f081-48e9-9cb1-f3ddd9728dfd None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:57.522007 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b6f631-f081-48e9-9cb1-f3ddd9728dfd None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:57.523380 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b6f631-f081-48e9-9cb1-f3ddd9728dfd None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:57.525914 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b6f631-f081-48e9-9cb1-f3ddd9728dfd None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:57.536791 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.sql.core [None req-80b6f631-f081-48e9-9cb1-f3ddd9728dfd None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 02 21:27:57.536791 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 02 21:27:57.536791 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [parameters: {'id': 'd2dd1c3b7c024c2fb42cf75cf2e3d2be', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 02 21:27:57.536791 dv-cinder-851449-4-smb devstack@keystone.service[80419]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80419) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 02 21:27:57.561547 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-80b6f631-f081-48e9-9cb1-f3ddd9728dfd None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 02 21:27:57.561547 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:57.561547 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 02 21:27:57.561547 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 02 21:27:57.561547 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 02 21:27:57.561547 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 02 21:27:57.561547 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 02 21:27:57.561547 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application result = self._query(query) Aug 02 21:27:57.561547 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 02 21:27:57.561547 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application conn.query(q) Aug 02 21:27:57.561547 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 02 21:27:57.561547 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 02 21:27:57.561547 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 02 21:27:57.561547 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application result.read() Aug 02 21:27:57.561547 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 02 21:27:57.562477 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 02 21:27:57.562477 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 02 21:27:57.562477 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 02 21:27:57.562477 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 02 21:27:57.562477 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 02 21:27:57.562477 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 02 21:27:57.562477 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 02 21:27:57.562477 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 02 21:27:57.562477 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:27:57.562477 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 02 21:27:57.562477 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:27:57.562477 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:57.562477 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 02 21:27:57.562477 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 02 21:27:57.562477 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 02 21:27:57.562477 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return ref.to_dict() Aug 02 21:27:57.562477 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 02 21:27:57.562477 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application next(self.gen) Aug 02 21:27:57.563448 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 02 21:27:57.563448 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application yield resource Aug 02 21:27:57.563448 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 02 21:27:57.563448 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application next(self.gen) Aug 02 21:27:57.563448 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 02 21:27:57.563448 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self.session.rollback() Aug 02 21:27:57.563448 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 02 21:27:57.563448 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self.force_reraise() Aug 02 21:27:57.563448 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 02 21:27:57.563448 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise self.value Aug 02 21:27:57.563448 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 02 21:27:57.563448 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 02 21:27:57.563448 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 02 21:27:57.563448 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application session.commit() Aug 02 21:27:57.563448 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 02 21:27:57.563448 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 02 21:27:57.563448 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 02 21:27:57.564406 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self._prepare_impl() Aug 02 21:27:57.564406 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 02 21:27:57.564406 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self.session.flush() Aug 02 21:27:57.564406 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 02 21:27:57.564406 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self._flush(objects) Aug 02 21:27:57.564406 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 02 21:27:57.564406 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 02 21:27:57.564406 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 02 21:27:57.564406 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application compat.raise_( Aug 02 21:27:57.564406 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 02 21:27:57.564406 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception Aug 02 21:27:57.564406 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 02 21:27:57.564406 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application flush_context.execute() Aug 02 21:27:57.564406 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 02 21:27:57.564406 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rec.execute(self) Aug 02 21:27:57.564406 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 02 21:27:57.564406 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 02 21:27:57.565286 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 02 21:27:57.565286 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 02 21:27:57.565286 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 02 21:27:57.565286 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 02 21:27:57.565286 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 02 21:27:57.565286 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 02 21:27:57.565286 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 02 21:27:57.565286 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 02 21:27:57.565286 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 02 21:27:57.565286 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 02 21:27:57.565286 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 02 21:27:57.565286 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 02 21:27:57.565286 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 02 21:27:57.565286 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 02 21:27:57.565286 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 02 21:27:57.565286 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception Aug 02 21:27:57.566109 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 02 21:27:57.566109 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 02 21:27:57.566109 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 02 21:27:57.566109 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 02 21:27:57.566109 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 02 21:27:57.566109 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application result = self._query(query) Aug 02 21:27:57.566109 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 02 21:27:57.566109 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application conn.query(q) Aug 02 21:27:57.566109 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 02 21:27:57.566109 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 02 21:27:57.566109 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 02 21:27:57.566109 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application result.read() Aug 02 21:27:57.566109 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 02 21:27:57.566109 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 02 21:27:57.566109 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 02 21:27:57.566109 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 02 21:27:57.566880 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 02 21:27:57.566880 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 02 21:27:57.566880 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 02 21:27:57.566880 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 02 21:27:57.566880 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 02 21:27:57.566880 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 02 21:27:57.566880 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [parameters: {'id': 'd2dd1c3b7c024c2fb42cf75cf2e3d2be', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 02 21:27:57.566880 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 02 21:27:57.566880 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:27:57.566880 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 21:27:57.566880 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:27:57.566880 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:57.566880 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:57.566880 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:57.566880 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:57.566880 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:57.567705 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:57.567705 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:57.567705 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:57.567705 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:57.567705 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:57.567705 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:57.567705 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 02 21:27:57.567705 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 02 21:27:57.567705 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:57.567705 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:57.567705 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 02 21:27:57.567705 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 02 21:27:57.567705 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 02 21:27:57.567705 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 02 21:27:57.567705 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 02 21:27:57.567705 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:27:57.575641 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 237/477] 10.222.0.70 () {60 vars in 1131 bytes} [Tue Aug 2 21:27:57 2022] POST /identity/v3/roles => generated 144 bytes in 285 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:57.577647 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b6f631-f081-48e9-9cb1-f3ddd9728dfd None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:57.615124 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b6e509-2d95-44c1-a83e-1b515782bd5d None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:57.625250 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:57.628142 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:57.661278 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2830b2e-4775-406a-b552-f6fc06dca1c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:57.661907 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2830b2e-4775-406a-b552-f6fc06dca1c8 None admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:57.662194 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2830b2e-4775-406a-b552-f6fc06dca1c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:57.662474 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2830b2e-4775-406a-b552-f6fc06dca1c8 None admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:57.663268 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2830b2e-4775-406a-b552-f6fc06dca1c8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:57.665167 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2830b2e-4775-406a-b552-f6fc06dca1c8 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:57.695847 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 241/478] 10.222.0.70 () {60 vars in 1132 bytes} [Tue Aug 2 21:27:57 2022] POST /identity/v3/users => generated 249 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:27:57.714833 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b6f631-f081-48e9-9cb1-f3ddd9728dfd None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:57.755312 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba128d8-e6ff-4eaa-9343-c9243c1eb49d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:57.756394 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba128d8-e6ff-4eaa-9343-c9243c1eb49d None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:57.756901 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba128d8-e6ff-4eaa-9343-c9243c1eb49d None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:57.757377 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba128d8-e6ff-4eaa-9343-c9243c1eb49d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:57.769924 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba128d8-e6ff-4eaa-9343-c9243c1eb49d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:27:57.775870 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-4ba128d8-e6ff-4eaa-9343-c9243c1eb49d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 21:27:57.775870 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:57.775870 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:57.775870 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:57.775870 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:57.775870 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:57.775870 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:57.775870 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:57.775870 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:57.775870 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:57.775870 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:57.775870 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:57.775870 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:27:57.775870 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:27:57.775870 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:27:57.775870 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:27:57.776897 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:27:57.776897 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:27:57.776897 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:27:57.776897 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:27:57.776897 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:57.776897 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:57.776897 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:57.776897 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:57.776897 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:57.776897 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:57.776897 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:57.776897 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:57.776897 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:57.776897 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:57.776897 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:57.776897 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:57.777708 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:57.777708 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:57.777708 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:57.777708 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:57.777708 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:27:57.777708 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:27:57.777708 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:27:57.777708 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:27:57.777708 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:27:57.777708 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:27:57.777708 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 02 21:27:57.777708 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:27:57.780642 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 238/479] 10.222.0.70 () {56 vars in 1114 bytes} [Tue Aug 2 21:27:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 21:27:57.786295 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2830b2e-4775-406a-b552-f6fc06dca1c8 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:57.901925 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2830b2e-4775-406a-b552-f6fc06dca1c8 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:57.940550 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d74d0e-104f-449c-a02c-5d54816c9bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:57.941548 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d74d0e-104f-449c-a02c-5d54816c9bae None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:57.942032 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d74d0e-104f-449c-a02c-5d54816c9bae None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:57.942523 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d74d0e-104f-449c-a02c-5d54816c9bae None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:57.943448 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d74d0e-104f-449c-a02c-5d54816c9bae None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:57.943965 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d74d0e-104f-449c-a02c-5d54816c9bae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:57.945589 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d74d0e-104f-449c-a02c-5d54816c9bae None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:57.954490 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 242/480] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Aug 2 21:27:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:58.810209 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86039041-d3ed-4753-855a-37359a0923d5 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:58.810753 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86039041-d3ed-4753-855a-37359a0923d5 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:58.810753 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86039041-d3ed-4753-855a-37359a0923d5 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:58.812653 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 239/481] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:27:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:27:58.821788 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baaaec8-c763-4044-a5d3-88b2fd480e22 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:58.822250 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baaaec8-c763-4044-a5d3-88b2fd480e22 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:58.822350 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baaaec8-c763-4044-a5d3-88b2fd480e22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:58.850746 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-0baaaec8-c763-4044-a5d3-88b2fd480e22 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:58.851958 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-0baaaec8-c763-4044-a5d3-88b2fd480e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:58.883269 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:58.954522 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 243/482] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:27:58.987981 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86039041-d3ed-4753-855a-37359a0923d5 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:59.115150 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:59.128886 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86039041-d3ed-4753-855a-37359a0923d5 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:59.172517 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad8206e-108e-4abd-aaf5-6f6a174e4c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:59.173169 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad8206e-108e-4abd-aaf5-6f6a174e4c77 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:59.173453 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad8206e-108e-4abd-aaf5-6f6a174e4c77 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:59.173732 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad8206e-108e-4abd-aaf5-6f6a174e4c77 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:59.192757 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad8206e-108e-4abd-aaf5-6f6a174e4c77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:27:59.197731 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-4ad8206e-108e-4abd-aaf5-6f6a174e4c77 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 21:27:59.197731 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:59.197731 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:59.197731 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:59.197731 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:59.197731 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:59.197731 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:59.197731 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:59.197731 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:59.197731 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:59.197731 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:59.197731 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:59.197731 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:27:59.197731 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:27:59.197731 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:27:59.197731 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:27:59.198739 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:27:59.198739 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:27:59.198739 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:27:59.198739 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:27:59.198739 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:59.198739 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:59.198739 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:59.198739 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:59.198739 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:59.198739 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:59.198739 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:59.198739 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:59.198739 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:59.198739 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:59.198739 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:59.198739 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:59.199521 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:59.199521 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:59.199521 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:59.199521 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:59.199521 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:27:59.199521 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:27:59.199521 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:27:59.199521 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:27:59.199521 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:27:59.199521 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:27:59.199521 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 21:27:59.199521 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:27:59.199521 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 240/483] 10.222.0.70 () {56 vars in 1102 bytes} [Tue Aug 2 21:27:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:27:59.205166 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baaaec8-c763-4044-a5d3-88b2fd480e22 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:59.274527 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b7f4a-b9c8-49c8-888a-b3df68156628 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:59.274849 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b7f4a-b9c8-49c8-888a-b3df68156628 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:59.275173 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6b7f4a-b9c8-49c8-888a-b3df68156628 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:59.276968 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 241/484] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:27:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 21:27:59.282452 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4ddcd3-c132-4c99-a94d-6041f1b59512 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:59.282807 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4ddcd3-c132-4c99-a94d-6041f1b59512 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:59.283089 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4ddcd3-c132-4c99-a94d-6041f1b59512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:59.329266 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-6c4ddcd3-c132-4c99-a94d-6041f1b59512 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:27:59.330479 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-6c4ddcd3-c132-4c99-a94d-6041f1b59512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:27:59.332620 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baaaec8-c763-4044-a5d3-88b2fd480e22 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:59.370003 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a966525f-58f6-409c-89bf-67fe5a83518b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:59.370578 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a966525f-58f6-409c-89bf-67fe5a83518b None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:59.370956 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a966525f-58f6-409c-89bf-67fe5a83518b None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:59.371240 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a966525f-58f6-409c-89bf-67fe5a83518b None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:59.371961 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a966525f-58f6-409c-89bf-67fe5a83518b None admin] RBAC: Adding query filter params (name=service) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:59.372287 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a966525f-58f6-409c-89bf-67fe5a83518b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:59.373654 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a966525f-58f6-409c-89bf-67fe5a83518b None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:59.383057 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 244/485] 10.222.0.70 () {56 vars in 1103 bytes} [Tue Aug 2 21:27:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:59.393186 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a966525f-58f6-409c-89bf-67fe5a83518b None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:59.427112 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:59.438850 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 242/486] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:27:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 21:27:59.506002 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4ddcd3-c132-4c99-a94d-6041f1b59512 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:59.532572 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a966525f-58f6-409c-89bf-67fe5a83518b None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:59.566838 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d505a34-4e17-4588-b131-66e6b2f25e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:59.567658 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d505a34-4e17-4588-b131-66e6b2f25e12 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:59.567944 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d505a34-4e17-4588-b131-66e6b2f25e12 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:59.568222 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d505a34-4e17-4588-b131-66e6b2f25e12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:59.585859 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d505a34-4e17-4588-b131-66e6b2f25e12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:59.587332 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d505a34-4e17-4588-b131-66e6b2f25e12 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:59.618879 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-5d505a34-4e17-4588-b131-66e6b2f25e12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:59.618879 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:59.618879 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:59.618879 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:59.618879 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:59.618879 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:59.618879 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:59.618879 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:59.618879 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:59.618879 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:59.618879 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:59.618879 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:59.618879 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:27:59.618879 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:27:59.618879 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:27:59.619761 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:27:59.619761 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:59.619761 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:59.619761 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:59.619761 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:59.619761 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:59.619761 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:59.619761 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:59.619761 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:59.619761 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:59.619761 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:59.619761 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:59.619761 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:59.619761 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:59.619761 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:59.619761 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:59.619761 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:59.620726 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:27:59.620726 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:27:59.620726 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:27:59.620726 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:27:59.628377 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 245/487] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 2 21:27:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 21:27:59.637075 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d505a34-4e17-4588-b131-66e6b2f25e12 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:59.656586 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:59.673439 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4ddcd3-c132-4c99-a94d-6041f1b59512 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:59.723347 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531613ce-bfa2-435d-a7ff-38e100dc4378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:59.723999 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531613ce-bfa2-435d-a7ff-38e100dc4378 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:59.724302 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531613ce-bfa2-435d-a7ff-38e100dc4378 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:59.724589 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531613ce-bfa2-435d-a7ff-38e100dc4378 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:59.748092 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531613ce-bfa2-435d-a7ff-38e100dc4378 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:27:59.753095 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-531613ce-bfa2-435d-a7ff-38e100dc4378 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 21:27:59.753095 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:27:59.753095 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:27:59.753095 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:27:59.753095 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:27:59.753095 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:27:59.753095 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:27:59.753095 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:27:59.753095 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:27:59.753095 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:27:59.753095 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:27:59.753095 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:27:59.753095 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:27:59.753095 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:27:59.753095 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:27:59.753095 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:27:59.753980 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:27:59.753980 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:27:59.753980 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:27:59.753980 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:27:59.753980 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:27:59.753980 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:27:59.753980 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:27:59.753980 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:27:59.753980 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:27:59.753980 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:27:59.753980 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:27:59.753980 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:27:59.753980 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:27:59.753980 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:27:59.753980 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:27:59.753980 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:27:59.754757 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:27:59.754757 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:27:59.754757 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:27:59.754757 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:27:59.754757 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:27:59.754757 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:27:59.754757 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:27:59.754757 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:27:59.754757 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:27:59.754757 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:27:59.754757 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 21:27:59.754757 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:27:59.766402 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 243/488] 10.222.0.70 () {56 vars in 1102 bytes} [Tue Aug 2 21:27:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 21:27:59.767333 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531613ce-bfa2-435d-a7ff-38e100dc4378 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:59.791594 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:27:59.835343 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d505a34-4e17-4588-b131-66e6b2f25e12 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:27:59.895214 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb8a5fe-e4ca-456b-a700-7d397bc13859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:27:59.895760 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb8a5fe-e4ca-456b-a700-7d397bc13859 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:27:59.896040 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb8a5fe-e4ca-456b-a700-7d397bc13859 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:27:59.896476 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb8a5fe-e4ca-456b-a700-7d397bc13859 None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:27:59.897180 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb8a5fe-e4ca-456b-a700-7d397bc13859 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:27:59.897485 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb8a5fe-e4ca-456b-a700-7d397bc13859 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:27:59.899021 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb8a5fe-e4ca-456b-a700-7d397bc13859 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:27:59.913997 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 246/489] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 2 21:27:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:27:59.920494 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb8a5fe-e4ca-456b-a700-7d397bc13859 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:27:59.946211 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531613ce-bfa2-435d-a7ff-38e100dc4378 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:00.034645 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb8a5fe-e4ca-456b-a700-7d397bc13859 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:00.065532 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:00.065913 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1bba2b-5a1a-4496-b58d-a6b5170cbe39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:00.066657 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1bba2b-5a1a-4496-b58d-a6b5170cbe39 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:00.066832 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1bba2b-5a1a-4496-b58d-a6b5170cbe39 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:00.067169 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1bba2b-5a1a-4496-b58d-a6b5170cbe39 None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:00.067835 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1bba2b-5a1a-4496-b58d-a6b5170cbe39 None admin] RBAC: Adding query filter params (name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:00.068148 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1bba2b-5a1a-4496-b58d-a6b5170cbe39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:00.069576 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1bba2b-5a1a-4496-b58d-a6b5170cbe39 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:00.075571 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf9e09c-a8f6-495e-ad4c-9b42a417813d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:00.076539 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf9e09c-a8f6-495e-ad4c-9b42a417813d None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:00.077015 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf9e09c-a8f6-495e-ad4c-9b42a417813d None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:00.077569 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf9e09c-a8f6-495e-ad4c-9b42a417813d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:00.085906 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf9e09c-a8f6-495e-ad4c-9b42a417813d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:00.087632 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf9e09c-a8f6-495e-ad4c-9b42a417813d None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:00.087756 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 244/490] 10.222.0.70 () {56 vars in 1103 bytes} [Tue Aug 2 21:27:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:00.093914 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1bba2b-5a1a-4496-b58d-a6b5170cbe39 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:00.105425 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:00.109003 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-fcf9e09c-a8f6-495e-ad4c-9b42a417813d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 02 21:28:00.109003 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:00.109003 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:00.109003 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:00.109003 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:00.109003 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:00.109003 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:00.109003 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:00.109003 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:00.109003 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:00.109003 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:00.109003 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:00.109003 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 21:28:00.109003 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 21:28:00.109003 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 21:28:00.109003 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 21:28:00.111406 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:00.111406 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:00.111406 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 21:28:00.111406 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:28:00.111406 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 21:28:00.111406 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:28:00.111406 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:00.111406 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:00.111406 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:00.111406 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:00.111406 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:00.111406 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:00.111406 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:00.111406 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:00.111406 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:00.111406 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:00.111406 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:00.111406 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:00.112356 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:00.112356 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:00.112356 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 21:28:00.112356 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 21:28:00.112356 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 21:28:00.112356 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 21:28:00.112356 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 21:28:00.112356 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 21:28:00.112356 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 02 21:28:00.112356 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:28:00.114049 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 247/491] 10.222.0.70 () {56 vars in 1093 bytes} [Tue Aug 2 21:27:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:00.121705 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf9e09c-a8f6-495e-ad4c-9b42a417813d None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:00.280308 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1bba2b-5a1a-4496-b58d-a6b5170cbe39 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:00.295493 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf9e09c-a8f6-495e-ad4c-9b42a417813d None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:00.319094 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70cfa82-b5a0-4f04-a414-308ffdc6af05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:00.319904 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70cfa82-b5a0-4f04-a414-308ffdc6af05 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:00.320199 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70cfa82-b5a0-4f04-a414-308ffdc6af05 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:00.320520 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70cfa82-b5a0-4f04-a414-308ffdc6af05 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:00.333082 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70cfa82-b5a0-4f04-a414-308ffdc6af05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:00.334550 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70cfa82-b5a0-4f04-a414-308ffdc6af05 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:00.341012 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfa1a2f-3d61-4776-acb1-c3b0718f05ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:00.342071 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfa1a2f-3d61-4776-acb1-c3b0718f05ce None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:00.342342 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfa1a2f-3d61-4776-acb1-c3b0718f05ce None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:00.343177 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfa1a2f-3d61-4776-acb1-c3b0718f05ce None admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:00.344062 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfa1a2f-3d61-4776-acb1-c3b0718f05ce None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:00.344488 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfa1a2f-3d61-4776-acb1-c3b0718f05ce None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:00.346106 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfa1a2f-3d61-4776-acb1-c3b0718f05ce None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:00.349727 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-b70cfa82-b5a0-4f04-a414-308ffdc6af05 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:00.349727 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:00.349727 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:00.349727 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:00.349727 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:00.349727 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:00.349727 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:00.349727 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:00.349727 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:00.349727 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:00.349727 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:00.349727 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:00.349727 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:28:00.349727 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:28:00.349727 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:28:00.350564 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:28:00.350564 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:00.350564 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:00.350564 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:00.350564 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:00.350564 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:00.350564 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:00.350564 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:00.350564 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:00.350564 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:00.350564 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:00.350564 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:00.350564 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:00.350564 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:00.350564 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:00.350564 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:00.350564 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:00.351417 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:28:00.351417 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:28:00.351417 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:00.351417 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:00.351417 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 245/492] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 2 21:28:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 21:28:00.352460 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f572ca96-c0ae-454b-945e-5fdc07f86a60 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:00.352726 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f572ca96-c0ae-454b-945e-5fdc07f86a60 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:00.353003 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f572ca96-c0ae-454b-945e-5fdc07f86a60 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:00.354385 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 246/493] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:28:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:28:00.355407 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de853f69-dc74-47e2-bf7b-7bd4f575dc8f None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:00.355621 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de853f69-dc74-47e2-bf7b-7bd4f575dc8f None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:00.355897 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de853f69-dc74-47e2-bf7b-7bd4f575dc8f None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:00.360368 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 247/494] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:28:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:28:00.360368 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de853f69-dc74-47e2-bf7b-7bd4f575dc8f None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:00.395329 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 248/495] 10.222.0.70 () {56 vars in 1133 bytes} [Tue Aug 2 21:28:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:00.396787 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ee09d0-8ee4-4feb-8746-84fbabc16f1c None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:00.397148 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ee09d0-8ee4-4feb-8746-84fbabc16f1c None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:00.397518 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ee09d0-8ee4-4feb-8746-84fbabc16f1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:00.415071 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-88ee09d0-8ee4-4feb-8746-84fbabc16f1c None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:28:00.416299 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-88ee09d0-8ee4-4feb-8746-84fbabc16f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:28:00.428378 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:00.461787 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:00.480902 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de853f69-dc74-47e2-bf7b-7bd4f575dc8f None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:00.487926 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 249/496] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:28:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:28:00.489340 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded7ddfb-bc1e-40d1-9a74-e2634272c1b1 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:00.489632 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded7ddfb-bc1e-40d1-9a74-e2634272c1b1 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:00.489908 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded7ddfb-bc1e-40d1-9a74-e2634272c1b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:00.510984 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-ded7ddfb-bc1e-40d1-9a74-e2634272c1b1 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:28:00.512540 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-ded7ddfb-bc1e-40d1-9a74-e2634272c1b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:28:00.515662 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e7d7c0-b563-4244-9307-dadb11d53d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:00.516498 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e7d7c0-b563-4244-9307-dadb11d53d6c None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:00.516780 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e7d7c0-b563-4244-9307-dadb11d53d6c None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:00.517054 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e7d7c0-b563-4244-9307-dadb11d53d6c None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:00.517761 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e7d7c0-b563-4244-9307-dadb11d53d6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:00.518068 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e7d7c0-b563-4244-9307-dadb11d53d6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:00.519444 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e7d7c0-b563-4244-9307-dadb11d53d6c None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:00.531292 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 248/497] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 2 21:28:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:00.532065 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e7d7c0-b563-4244-9307-dadb11d53d6c None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:00.581699 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 250/498] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:28:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:28:00.582945 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a480f3ce-dc77-417e-8480-e73e0351c42f None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:00.583241 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a480f3ce-dc77-417e-8480-e73e0351c42f None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:00.583515 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a480f3ce-dc77-417e-8480-e73e0351c42f None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:00.585008 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 251/499] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:28:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:28:00.585608 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a480f3ce-dc77-417e-8480-e73e0351c42f None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:00.634082 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e7d7c0-b563-4244-9307-dadb11d53d6c None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:00.650321 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:00.668762 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6bdd9f-beac-4494-94cc-480b3471100b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:00.669390 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6bdd9f-beac-4494-94cc-480b3471100b None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:00.669679 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6bdd9f-beac-4494-94cc-480b3471100b None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:00.669961 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6bdd9f-beac-4494-94cc-480b3471100b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:00.697690 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a480f3ce-dc77-417e-8480-e73e0351c42f None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:00.706812 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:00.732261 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb4c07b-1c97-46b5-a639-c720cfb9f686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:00.732910 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb4c07b-1c97-46b5-a639-c720cfb9f686 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:00.733197 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb4c07b-1c97-46b5-a639-c720cfb9f686 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:00.733475 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb4c07b-1c97-46b5-a639-c720cfb9f686 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:00.736548 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6bdd9f-beac-4494-94cc-480b3471100b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:00.738281 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6bdd9f-beac-4494-94cc-480b3471100b None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:00.744150 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb4c07b-1c97-46b5-a639-c720cfb9f686 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:00.746264 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb4c07b-1c97-46b5-a639-c720cfb9f686 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:00.760905 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-6eb4c07b-1c97-46b5-a639-c720cfb9f686 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:00.760905 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:00.760905 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:00.760905 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:00.760905 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:00.760905 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:00.760905 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:00.760905 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:00.760905 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:00.760905 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:00.760905 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:00.760905 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:00.760905 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:28:00.760905 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:28:00.760905 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:28:00.761729 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:28:00.761729 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:00.761729 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:00.761729 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:00.761729 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:00.761729 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:00.761729 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:00.761729 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:00.761729 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:00.761729 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:00.761729 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:00.761729 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:00.761729 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:00.761729 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:00.761729 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:00.761729 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:00.761729 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:00.762573 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:28:00.762573 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:28:00.762573 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:00.762573 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:28:00.762573 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 252/500] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 2 21:28:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:00.762905 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb4c07b-1c97-46b5-a639-c720cfb9f686 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:00.841393 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 249/501] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 2 21:28:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 21:28:00.843314 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8679d4-5944-4a0a-abeb-3df6acfdf627 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:00.843623 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8679d4-5944-4a0a-abeb-3df6acfdf627 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:00.844128 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8679d4-5944-4a0a-abeb-3df6acfdf627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:00.863295 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-cb8679d4-5944-4a0a-abeb-3df6acfdf627 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:28:00.864527 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-cb8679d4-5944-4a0a-abeb-3df6acfdf627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:28:00.868273 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb4c07b-1c97-46b5-a639-c720cfb9f686 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:00.875033 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:00.902689 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30b9b5c-bf98-402d-bc82-47029f6a982f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:00.903329 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30b9b5c-bf98-402d-bc82-47029f6a982f None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:00.903616 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30b9b5c-bf98-402d-bc82-47029f6a982f None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:00.903896 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30b9b5c-bf98-402d-bc82-47029f6a982f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:00.912165 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30b9b5c-bf98-402d-bc82-47029f6a982f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:00.914292 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30b9b5c-bf98-402d-bc82-47029f6a982f None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:00.927912 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-b30b9b5c-bf98-402d-bc82-47029f6a982f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 02 21:28:00.927912 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:00.927912 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:00.927912 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:00.927912 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:00.927912 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:00.927912 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:00.927912 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:00.927912 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:00.927912 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:00.927912 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:00.927912 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:00.927912 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 21:28:00.927912 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 21:28:00.927912 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 21:28:00.927912 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 21:28:00.929079 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:00.929079 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:00.929079 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 21:28:00.929079 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:28:00.929079 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 21:28:00.929079 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:28:00.929079 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:00.929079 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:00.929079 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:00.929079 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:00.929079 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:00.929079 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:00.929079 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:00.929079 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:00.929079 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:00.929079 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:00.929079 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:00.929079 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:00.929988 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:00.929988 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:00.929988 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 21:28:00.929988 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 21:28:00.929988 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 21:28:00.929988 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 21:28:00.929988 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 21:28:00.929988 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 21:28:00.929988 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 02 21:28:00.929988 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:28:00.929988 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 253/502] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 2 21:28:00 2022] GET /identity/v3/users/cinder => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:00.931420 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 250/503] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:28:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:28:00.932277 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8679d4-5944-4a0a-abeb-3df6acfdf627 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:00.934338 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30b9b5c-bf98-402d-bc82-47029f6a982f None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:00.956352 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:01.036997 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30b9b5c-bf98-402d-bc82-47029f6a982f None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:01.039355 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8679d4-5944-4a0a-abeb-3df6acfdf627 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:01.069960 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750e606c-1e13-489f-b69d-79c12fbd875b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:01.070595 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e606c-1e13-489f-b69d-79c12fbd875b None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:01.070880 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e606c-1e13-489f-b69d-79c12fbd875b None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:01.071159 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e606c-1e13-489f-b69d-79c12fbd875b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:01.073272 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb635c3c-8052-4534-9ff2-8682a11928bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:01.073878 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb635c3c-8052-4534-9ff2-8682a11928bc None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:01.074158 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb635c3c-8052-4534-9ff2-8682a11928bc None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:01.074433 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb635c3c-8052-4534-9ff2-8682a11928bc None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:01.075114 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb635c3c-8052-4534-9ff2-8682a11928bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:01.075417 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb635c3c-8052-4534-9ff2-8682a11928bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:01.076827 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb635c3c-8052-4534-9ff2-8682a11928bc None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:01.081224 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750e606c-1e13-489f-b69d-79c12fbd875b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:28:01.086610 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-750e606c-1e13-489f-b69d-79c12fbd875b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 21:28:01.086610 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:01.086610 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:01.086610 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:01.086610 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:01.086610 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:01.086610 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:01.086610 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:01.086610 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:01.086610 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:01.086610 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:01.086610 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:01.086610 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:28:01.086610 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:28:01.086610 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:28:01.086610 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:28:01.087620 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:28:01.087620 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:28:01.087620 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:28:01.087620 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:28:01.087620 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:01.087620 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:01.087620 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:01.087620 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:01.087620 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:01.087620 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:01.087620 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:01.087620 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:01.087620 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:01.087620 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:01.087620 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:01.087620 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:01.093812 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:01.093812 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:01.093812 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:01.093812 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:01.093812 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:28:01.093812 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:28:01.093812 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:28:01.093812 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:28:01.093812 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:28:01.093812 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:28:01.093812 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 21:28:01.093812 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:28:01.093812 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 254/504] 10.222.0.70 () {56 vars in 1102 bytes} [Tue Aug 2 21:28:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:01.094525 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 251/505] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 2 21:28:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:01.094610 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750e606c-1e13-489f-b69d-79c12fbd875b None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:01.094680 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb635c3c-8052-4534-9ff2-8682a11928bc None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:01.099853 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:01.173640 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:01.192711 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb635c3c-8052-4534-9ff2-8682a11928bc None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:01.192920 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750e606c-1e13-489f-b69d-79c12fbd875b None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:01.226026 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ecef32-23f8-46f3-85dc-6bd9228cd911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:01.226305 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5ed7b6-8a01-4d39-8ff1-ef409310164d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:01.226642 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ecef32-23f8-46f3-85dc-6bd9228cd911 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:01.226930 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ecef32-23f8-46f3-85dc-6bd9228cd911 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:01.227037 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5ed7b6-8a01-4d39-8ff1-ef409310164d None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:01.227212 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5ed7b6-8a01-4d39-8ff1-ef409310164d None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:01.227305 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ecef32-23f8-46f3-85dc-6bd9228cd911 None admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:01.227486 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5ed7b6-8a01-4d39-8ff1-ef409310164d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:01.228001 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ecef32-23f8-46f3-85dc-6bd9228cd911 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:01.228343 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ecef32-23f8-46f3-85dc-6bd9228cd911 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:01.229821 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ecef32-23f8-46f3-85dc-6bd9228cd911 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:01.238064 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5ed7b6-8a01-4d39-8ff1-ef409310164d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:01.239513 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5ed7b6-8a01-4d39-8ff1-ef409310164d None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:01.253682 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-bd5ed7b6-8a01-4d39-8ff1-ef409310164d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:01.253682 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:01.253682 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:01.253682 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:01.253682 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:01.253682 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:01.253682 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:01.253682 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:01.253682 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:01.253682 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:01.253682 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:01.253682 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:01.253682 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:28:01.253682 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:28:01.253682 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:28:01.254570 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:28:01.254570 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:01.254570 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:01.254570 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:01.254570 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:01.254570 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:01.254570 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:01.254570 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:01.254570 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:01.254570 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:01.254570 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:01.254570 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:01.254570 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:01.254570 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:01.254570 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:01.254570 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:01.254570 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:01.255405 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:28:01.255405 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:28:01.255405 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:01.255405 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:28:01.255405 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 255/506] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 2 21:28:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:01.255663 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5ed7b6-8a01-4d39-8ff1-ef409310164d None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:01.268015 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 252/507] 10.222.0.70 () {56 vars in 1137 bytes} [Tue Aug 2 21:28:01 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:01.268889 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ecef32-23f8-46f3-85dc-6bd9228cd911 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:01.337153 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:01.357642 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5ed7b6-8a01-4d39-8ff1-ef409310164d None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:01.376074 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ecef32-23f8-46f3-85dc-6bd9228cd911 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:01.388176 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:01.395421 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae38f26-1242-4bbc-8b71-3cd9c265b39b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:01.396274 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae38f26-1242-4bbc-8b71-3cd9c265b39b None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:01.396569 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae38f26-1242-4bbc-8b71-3cd9c265b39b None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:01.396856 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae38f26-1242-4bbc-8b71-3cd9c265b39b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:01.407440 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae38f26-1242-4bbc-8b71-3cd9c265b39b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:28:01.410501 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f03aa53-4c1f-48c6-963b-f3e7800e92ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:01.411149 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f03aa53-4c1f-48c6-963b-f3e7800e92ca None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:01.411431 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f03aa53-4c1f-48c6-963b-f3e7800e92ca None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:01.411707 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f03aa53-4c1f-48c6-963b-f3e7800e92ca None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:01.412461 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f03aa53-4c1f-48c6-963b-f3e7800e92ca None admin] RBAC: Adding query filter params (name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:01.412800 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f03aa53-4c1f-48c6-963b-f3e7800e92ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:01.412892 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-cae38f26-1242-4bbc-8b71-3cd9c265b39b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 21:28:01.412892 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:01.412892 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:01.412892 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:01.412892 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:01.412892 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:01.412892 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:01.412892 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:01.412892 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:01.412892 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:01.412892 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:01.412892 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:01.412892 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:28:01.412892 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:28:01.412892 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:28:01.412892 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:28:01.413711 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:28:01.413711 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:28:01.413711 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:28:01.413711 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:28:01.413711 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:01.413711 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:01.413711 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:01.413711 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:01.413711 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:01.413711 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:01.413711 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:01.413711 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:01.413711 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:01.413711 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:01.413711 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:01.413711 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:01.414517 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:01.414517 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:01.414517 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:01.414517 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:01.414517 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:28:01.414517 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:28:01.414517 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:28:01.414517 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:28:01.414517 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:28:01.414517 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:28:01.414517 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 21:28:01.414517 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:28:01.414517 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 256/508] 10.222.0.70 () {56 vars in 1102 bytes} [Tue Aug 2 21:28:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:01.415192 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f03aa53-4c1f-48c6-963b-f3e7800e92ca None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:01.415267 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae38f26-1242-4bbc-8b71-3cd9c265b39b None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:01.426139 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 253/509] 10.222.0.70 () {56 vars in 1103 bytes} [Tue Aug 2 21:28:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:01.426954 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f03aa53-4c1f-48c6-963b-f3e7800e92ca None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:01.516752 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae38f26-1242-4bbc-8b71-3cd9c265b39b None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:01.526401 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f03aa53-4c1f-48c6-963b-f3e7800e92ca None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:01.549762 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3a329e-59af-4dba-8a2e-21591e1fbbb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:01.550424 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3a329e-59af-4dba-8a2e-21591e1fbbb9 None admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:01.550710 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3a329e-59af-4dba-8a2e-21591e1fbbb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:01.550980 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3a329e-59af-4dba-8a2e-21591e1fbbb9 None admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:01.551670 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:01.551781 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3a329e-59af-4dba-8a2e-21591e1fbbb9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:01.553153 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3a329e-59af-4dba-8a2e-21591e1fbbb9 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:01.561531 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b7ccdd-1d2d-434b-8063-608e4795995b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:01.562147 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b7ccdd-1d2d-434b-8063-608e4795995b None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:01.562436 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b7ccdd-1d2d-434b-8063-608e4795995b None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:01.562717 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b7ccdd-1d2d-434b-8063-608e4795995b None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:01.563405 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b7ccdd-1d2d-434b-8063-608e4795995b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:01.563710 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b7ccdd-1d2d-434b-8063-608e4795995b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:01.565101 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b7ccdd-1d2d-434b-8063-608e4795995b None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:01.575460 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 257/510] 10.222.0.70 () {60 vars in 1132 bytes} [Tue Aug 2 21:28:01 2022] POST /identity/v3/users => generated 247 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:28:01.576375 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3a329e-59af-4dba-8a2e-21591e1fbbb9 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:01.582726 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 254/511] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 2 21:28:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:01.582726 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b7ccdd-1d2d-434b-8063-608e4795995b None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:01.638872 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:01.698268 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3a329e-59af-4dba-8a2e-21591e1fbbb9 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:01.706001 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b7ccdd-1d2d-434b-8063-608e4795995b None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:01.737338 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8a4115-6cbb-43b4-afd6-b773da70f432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:01.738068 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8a4115-6cbb-43b4-afd6-b773da70f432 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:01.738359 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8a4115-6cbb-43b4-afd6-b773da70f432 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:01.738632 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8a4115-6cbb-43b4-afd6-b773da70f432 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:01.746605 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfddfd21-d13b-4797-a603-a4fb2758de27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:01.747235 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfddfd21-d13b-4797-a603-a4fb2758de27 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:01.747527 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfddfd21-d13b-4797-a603-a4fb2758de27 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:01.747804 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfddfd21-d13b-4797-a603-a4fb2758de27 None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:01.748587 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfddfd21-d13b-4797-a603-a4fb2758de27 None admin] RBAC: Adding query filter params (name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:01.748898 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfddfd21-d13b-4797-a603-a4fb2758de27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:01.750290 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfddfd21-d13b-4797-a603-a4fb2758de27 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:01.762727 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 255/512] 10.222.0.70 () {56 vars in 1103 bytes} [Tue Aug 2 21:28:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:01.762727 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfddfd21-d13b-4797-a603-a4fb2758de27 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:01.813256 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:01.822969 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8a4115-6cbb-43b4-afd6-b773da70f432 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:01.825070 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8a4115-6cbb-43b4-afd6-b773da70f432 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:01.867314 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfddfd21-d13b-4797-a603-a4fb2758de27 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:01.878240 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:01.904752 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad14706a-2f48-4dee-ab51-ace5b9bf4811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:01.905333 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad14706a-2f48-4dee-ab51-ace5b9bf4811 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:01.905613 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad14706a-2f48-4dee-ab51-ace5b9bf4811 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:01.905889 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad14706a-2f48-4dee-ab51-ace5b9bf4811 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:01.918948 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad14706a-2f48-4dee-ab51-ace5b9bf4811 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:01.920542 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad14706a-2f48-4dee-ab51-ace5b9bf4811 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:01.935905 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-ad14706a-2f48-4dee-ab51-ace5b9bf4811 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:01.935905 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:01.935905 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:01.935905 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:01.935905 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:01.935905 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:01.935905 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:01.935905 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:01.935905 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:01.935905 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:01.935905 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:01.935905 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:01.935905 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:28:01.935905 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:28:01.935905 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:28:01.937036 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:28:01.937036 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:01.937036 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:01.937036 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:01.937036 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:01.937036 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:01.937036 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:01.937036 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:01.937036 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:01.937036 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:01.937036 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:01.937036 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:01.937036 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:01.937036 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:01.937036 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:01.937036 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:01.937036 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:01.937899 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:28:01.937899 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:28:01.937899 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:01.937899 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:01.937899 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 256/513] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 2 21:28:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:01.937899 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad14706a-2f48-4dee-ab51-ace5b9bf4811 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:01.944843 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 258/514] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 2 21:28:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 21:28:01.946021 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8a4115-6cbb-43b4-afd6-b773da70f432 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:02.038930 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:02.042922 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad14706a-2f48-4dee-ab51-ace5b9bf4811 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:02.053449 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8a4115-6cbb-43b4-afd6-b773da70f432 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:02.078678 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067545fc-8d60-4a41-a54f-202ef15ea9c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:02.079306 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067545fc-8d60-4a41-a54f-202ef15ea9c1 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:02.079583 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067545fc-8d60-4a41-a54f-202ef15ea9c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:02.079854 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067545fc-8d60-4a41-a54f-202ef15ea9c1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:02.086575 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067545fc-8d60-4a41-a54f-202ef15ea9c1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:02.088132 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067545fc-8d60-4a41-a54f-202ef15ea9c1 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:02.093365 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ee4a07-4641-4dd6-b982-cd0f5af8ae64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:02.094207 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ee4a07-4641-4dd6-b982-cd0f5af8ae64 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:02.094631 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ee4a07-4641-4dd6-b982-cd0f5af8ae64 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:02.095045 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ee4a07-4641-4dd6-b982-cd0f5af8ae64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:02.099990 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-067545fc-8d60-4a41-a54f-202ef15ea9c1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:28:02.099990 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:02.099990 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:02.099990 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:02.099990 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:02.099990 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:02.099990 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:02.099990 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:02.099990 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:02.099990 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:02.099990 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:02.099990 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:02.099990 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 21:28:02.099990 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 21:28:02.099990 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 21:28:02.101033 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 21:28:02.101033 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:02.101033 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:02.101033 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:02.101033 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:02.101033 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:02.101033 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:02.101033 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:02.101033 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:02.101033 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:02.101033 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:02.101033 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:02.101033 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:02.101033 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:02.101033 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:02.101033 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:02.101033 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:02.102079 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 21:28:02.102079 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 21:28:02.102079 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 21:28:02.102079 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 21:28:02.102079 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 21:28:02.102079 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 21:28:02.102079 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:28:02.102079 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:02.102079 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 257/515] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Aug 2 21:28:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:02.102079 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067545fc-8d60-4a41-a54f-202ef15ea9c1 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:02.114403 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ee4a07-4641-4dd6-b982-cd0f5af8ae64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:02.116092 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ee4a07-4641-4dd6-b982-cd0f5af8ae64 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:02.125555 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:02.133174 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-27ee4a07-4641-4dd6-b982-cd0f5af8ae64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:02.133174 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:02.133174 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:02.133174 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:02.133174 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:02.133174 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:02.133174 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:02.133174 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:02.133174 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:02.133174 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:02.133174 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:02.133174 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:02.133174 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:28:02.133174 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:28:02.133174 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:28:02.134134 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:28:02.134134 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:02.134134 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:02.134134 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:02.134134 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:02.134134 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:02.134134 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:02.134134 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:02.134134 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:02.134134 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:02.134134 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:02.134134 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:02.134134 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:02.134134 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:02.134134 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:02.134134 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:02.134134 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:02.135175 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:28:02.135175 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:28:02.135175 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:02.135175 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:28:02.136707 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 259/516] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 2 21:28:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:02.137625 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ee4a07-4641-4dd6-b982-cd0f5af8ae64 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:02.210095 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067545fc-8d60-4a41-a54f-202ef15ea9c1 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:02.241570 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ee4a07-4641-4dd6-b982-cd0f5af8ae64 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:02.247371 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83423e3-2b18-460e-8a8b-8616a71c97fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:02.248038 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83423e3-2b18-460e-8a8b-8616a71c97fb None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:02.248283 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83423e3-2b18-460e-8a8b-8616a71c97fb None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:02.248563 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83423e3-2b18-460e-8a8b-8616a71c97fb None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:02.249252 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83423e3-2b18-460e-8a8b-8616a71c97fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:02.249554 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83423e3-2b18-460e-8a8b-8616a71c97fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:02.250917 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83423e3-2b18-460e-8a8b-8616a71c97fb None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:02.263929 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 258/517] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 2 21:28:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:02.265187 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83423e3-2b18-460e-8a8b-8616a71c97fb None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:02.281509 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647fa104-d5c9-4328-a1dd-c0a368df103f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:02.282819 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647fa104-d5c9-4328-a1dd-c0a368df103f None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:02.283105 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647fa104-d5c9-4328-a1dd-c0a368df103f None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:02.283381 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647fa104-d5c9-4328-a1dd-c0a368df103f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:02.295198 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647fa104-d5c9-4328-a1dd-c0a368df103f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:02.296976 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647fa104-d5c9-4328-a1dd-c0a368df103f None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:02.298360 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:02.312868 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-647fa104-d5c9-4328-a1dd-c0a368df103f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:02.312868 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:02.312868 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:02.312868 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:02.312868 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:02.312868 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:02.312868 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:02.312868 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:02.312868 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:02.312868 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:02.312868 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:02.312868 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:02.312868 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:28:02.312868 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:28:02.312868 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:28:02.313750 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:28:02.313750 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:02.313750 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:02.313750 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:02.313750 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:02.313750 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:02.313750 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:02.313750 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:02.313750 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:02.313750 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:02.313750 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:02.313750 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:02.313750 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:02.313750 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:02.313750 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:02.313750 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:02.313750 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:02.314583 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:28:02.314583 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:28:02.314583 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:02.314583 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:28:02.314583 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 260/518] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 2 21:28:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:02.315127 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647fa104-d5c9-4328-a1dd-c0a368df103f None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:02.381219 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:02.391582 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83423e3-2b18-460e-8a8b-8616a71c97fb None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:02.431476 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647fa104-d5c9-4328-a1dd-c0a368df103f None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:02.438942 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5304449e-0f11-47b7-833e-dfb40fb16e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:02.439659 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5304449e-0f11-47b7-833e-dfb40fb16e86 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:02.440018 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5304449e-0f11-47b7-833e-dfb40fb16e86 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:02.440404 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5304449e-0f11-47b7-833e-dfb40fb16e86 None admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:02.442375 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5304449e-0f11-47b7-833e-dfb40fb16e86 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:02.442483 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5304449e-0f11-47b7-833e-dfb40fb16e86 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:02.444085 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5304449e-0f11-47b7-833e-dfb40fb16e86 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:02.469292 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 259/519] 10.222.0.70 () {56 vars in 1148 bytes} [Tue Aug 2 21:28:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:02.470351 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5304449e-0f11-47b7-833e-dfb40fb16e86 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:02.471156 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c2830a-5ac1-4638-9abb-0c958b627d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:02.471967 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c2830a-5ac1-4638-9abb-0c958b627d96 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:02.472463 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c2830a-5ac1-4638-9abb-0c958b627d96 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:02.472909 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c2830a-5ac1-4638-9abb-0c958b627d96 None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:02.474115 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c2830a-5ac1-4638-9abb-0c958b627d96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:02.474765 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c2830a-5ac1-4638-9abb-0c958b627d96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:02.476350 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c2830a-5ac1-4638-9abb-0c958b627d96 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:02.490864 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 261/520] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 2 21:28:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:02.491980 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c2830a-5ac1-4638-9abb-0c958b627d96 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:02.581373 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:02.614161 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5304449e-0f11-47b7-833e-dfb40fb16e86 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:02.614920 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c2830a-5ac1-4638-9abb-0c958b627d96 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:02.629922 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:02.654413 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558768b3-a0c8-4185-8523-e630794d2f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:02.655072 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558768b3-a0c8-4185-8523-e630794d2f0f None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:02.655358 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558768b3-a0c8-4185-8523-e630794d2f0f None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:02.655636 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558768b3-a0c8-4185-8523-e630794d2f0f None admin] PATH_INFO: `/v3/users/glance` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:02.665446 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f574f70a-0641-4638-a9e8-a0ca2b60d5ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:02.665446 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f574f70a-0641-4638-a9e8-a0ca2b60d5ea None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:02.665446 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f574f70a-0641-4638-a9e8-a0ca2b60d5ea None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:02.665446 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f574f70a-0641-4638-a9e8-a0ca2b60d5ea None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:02.665836 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f574f70a-0641-4638-a9e8-a0ca2b60d5ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:02.665836 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f574f70a-0641-4638-a9e8-a0ca2b60d5ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:02.668881 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f574f70a-0641-4638-a9e8-a0ca2b60d5ea None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:02.668996 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558768b3-a0c8-4185-8523-e630794d2f0f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:02.670465 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558768b3-a0c8-4185-8523-e630794d2f0f None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:02.697942 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 262/521] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 2 21:28:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:02.699687 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-558768b3-a0c8-4185-8523-e630794d2f0f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 02 21:28:02.699687 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:02.699687 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:02.699687 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:02.699687 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:02.699687 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:02.699687 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:02.699687 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:02.699687 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:02.699687 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:02.699687 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:02.699687 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:02.699687 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 21:28:02.699687 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 21:28:02.699687 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 21:28:02.699687 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 21:28:02.700663 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:02.700663 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:02.700663 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 21:28:02.700663 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:28:02.700663 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 21:28:02.700663 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:28:02.700663 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:02.700663 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:02.700663 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:02.700663 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:02.700663 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:02.700663 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:02.700663 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:02.700663 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:02.700663 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:02.700663 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:02.700663 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:02.700663 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:02.701779 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:02.701779 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:02.701779 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 21:28:02.701779 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 21:28:02.701779 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 21:28:02.701779 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 21:28:02.701779 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 21:28:02.701779 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 21:28:02.701779 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 02 21:28:02.701779 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:02.710154 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f574f70a-0641-4638-a9e8-a0ca2b60d5ea None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:02.710346 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 260/522] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 2 21:28:02 2022] GET /identity/v3/users/glance => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:02.710346 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558768b3-a0c8-4185-8523-e630794d2f0f None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:02.825487 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f574f70a-0641-4638-a9e8-a0ca2b60d5ea None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:02.828506 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558768b3-a0c8-4185-8523-e630794d2f0f None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:02.862463 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37388f8-8176-4825-9318-ae75db0325ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:02.863700 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37388f8-8176-4825-9318-ae75db0325ab None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:02.863988 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37388f8-8176-4825-9318-ae75db0325ab None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:02.864088 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70542c9-d442-4431-9be7-0c4d1ea871ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:02.864320 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37388f8-8176-4825-9318-ae75db0325ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:02.864692 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70542c9-d442-4431-9be7-0c4d1ea871ef None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:02.864977 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70542c9-d442-4431-9be7-0c4d1ea871ef None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:02.865070 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37388f8-8176-4825-9318-ae75db0325ab None admin] RBAC: Adding query filter params (role.id=59a4c9a6a22d4bdb966856a28c4aabaf, scope.project.id=42672e04d6ce4b0ab5f7eccfb0cc946c, user.id=87dd5c1c5e854d4b96e0b7dad6aa3719) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:02.865254 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70542c9-d442-4431-9be7-0c4d1ea871ef None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:02.865346 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37388f8-8176-4825-9318-ae75db0325ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:02.866787 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37388f8-8176-4825-9318-ae75db0325ab None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:02.880534 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 263/523] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Aug 2 21:28:02 2022] GET /identity/v3/role_assignments?user.id=87dd5c1c5e854d4b96e0b7dad6aa3719&scope.project.id=42672e04d6ce4b0ab5f7eccfb0cc946c&role.id=59a4c9a6a22d4bdb966856a28c4aabaf => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:02.880534 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37388f8-8176-4825-9318-ae75db0325ab None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:02.883452 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70542c9-d442-4431-9be7-0c4d1ea871ef None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:02.885084 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70542c9-d442-4431-9be7-0c4d1ea871ef None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:02.888922 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:02.900900 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-e70542c9-d442-4431-9be7-0c4d1ea871ef None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 02 21:28:02.900900 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:02.900900 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:02.900900 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:02.900900 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:02.900900 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:02.900900 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:02.900900 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:02.900900 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:02.900900 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:02.900900 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:02.900900 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:02.900900 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 21:28:02.900900 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 21:28:02.900900 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 21:28:02.900900 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 21:28:02.902698 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:02.902698 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:02.902698 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 21:28:02.902698 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:28:02.902698 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 21:28:02.902698 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:28:02.902698 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:02.902698 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:02.902698 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:02.902698 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:02.902698 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:02.902698 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:02.902698 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:02.902698 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:02.902698 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:02.902698 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:02.902698 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:02.902698 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:02.903951 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:02.903951 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:02.903951 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 21:28:02.903951 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 21:28:02.903951 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 21:28:02.903951 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 21:28:02.903951 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 21:28:02.903951 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 21:28:02.903951 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 02 21:28:02.903951 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:02.908023 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 261/524] 10.222.0.70 () {56 vars in 1102 bytes} [Tue Aug 2 21:28:02 2022] GET /identity/v3/users/neutron => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:02.909341 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70542c9-d442-4431-9be7-0c4d1ea871ef None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:02.930293 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:03.008206 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37388f8-8176-4825-9318-ae75db0325ab None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:03.052573 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b53f53-5bca-4141-9f78-875681d21b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:03.055132 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b53f53-5bca-4141-9f78-875681d21b3b None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:03.055132 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b53f53-5bca-4141-9f78-875681d21b3b None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:03.055642 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b53f53-5bca-4141-9f78-875681d21b3b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:03.062978 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70542c9-d442-4431-9be7-0c4d1ea871ef None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:03.069380 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b53f53-5bca-4141-9f78-875681d21b3b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:03.071033 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b53f53-5bca-4141-9f78-875681d21b3b None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:03.085586 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-e4b53f53-5bca-4141-9f78-875681d21b3b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:28:03.085586 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:03.085586 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:03.085586 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:03.085586 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:03.085586 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:03.085586 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:03.085586 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:03.085586 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:03.085586 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:03.085586 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:03.085586 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:03.085586 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 21:28:03.085586 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 21:28:03.085586 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 21:28:03.086471 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 21:28:03.086471 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:03.086471 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:03.086471 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:03.086471 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:03.086471 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:03.086471 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:03.086471 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:03.086471 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:03.086471 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:03.086471 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:03.086471 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:03.086471 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:03.086471 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:03.086471 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:03.086471 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:03.086471 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:03.087315 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 21:28:03.087315 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 21:28:03.087315 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 21:28:03.087315 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 21:28:03.087315 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 21:28:03.087315 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 21:28:03.087315 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:28:03.087315 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:28:03.089894 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 264/525] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Aug 2 21:28:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:03.090877 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b53f53-5bca-4141-9f78-875681d21b3b None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:03.115784 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50266f5-41c0-4df6-91c0-04d52205c91c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:03.116440 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50266f5-41c0-4df6-91c0-04d52205c91c None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:03.116728 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50266f5-41c0-4df6-91c0-04d52205c91c None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:03.117009 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50266f5-41c0-4df6-91c0-04d52205c91c None admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:03.117812 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50266f5-41c0-4df6-91c0-04d52205c91c None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:03.118123 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50266f5-41c0-4df6-91c0-04d52205c91c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:03.120563 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50266f5-41c0-4df6-91c0-04d52205c91c None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:03.144381 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 262/526] 10.222.0.70 () {56 vars in 1137 bytes} [Tue Aug 2 21:28:02 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:03.145320 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50266f5-41c0-4df6-91c0-04d52205c91c None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:03.205456 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b53f53-5bca-4141-9f78-875681d21b3b None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:03.208661 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:03.223601 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:03.250336 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dbd8b5-40a9-4497-a836-704160fd19d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:03.251215 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dbd8b5-40a9-4497-a836-704160fd19d2 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:03.251511 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dbd8b5-40a9-4497-a836-704160fd19d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:03.251789 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dbd8b5-40a9-4497-a836-704160fd19d2 None admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:03.252938 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dbd8b5-40a9-4497-a836-704160fd19d2 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:03.253257 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dbd8b5-40a9-4497-a836-704160fd19d2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:03.255474 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27dbd8b5-40a9-4497-a836-704160fd19d2 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:03.276530 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50266f5-41c0-4df6-91c0-04d52205c91c None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:03.285152 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 265/527] 10.222.0.70 () {56 vars in 1139 bytes} [Tue Aug 2 21:28:03 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:03.286070 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dbd8b5-40a9-4497-a836-704160fd19d2 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:03.323626 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a468cc-14ae-4111-84f6-18b6cf3464a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:03.325245 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a468cc-14ae-4111-84f6-18b6cf3464a9 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:03.326019 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a468cc-14ae-4111-84f6-18b6cf3464a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:03.326508 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a468cc-14ae-4111-84f6-18b6cf3464a9 None admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:03.327694 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a468cc-14ae-4111-84f6-18b6cf3464a9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:03.328362 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a468cc-14ae-4111-84f6-18b6cf3464a9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:03.330585 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a468cc-14ae-4111-84f6-18b6cf3464a9 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:03.352820 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 263/528] 10.222.0.70 () {56 vars in 1148 bytes} [Tue Aug 2 21:28:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:03.352820 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a468cc-14ae-4111-84f6-18b6cf3464a9 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:03.420897 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27dbd8b5-40a9-4497-a836-704160fd19d2 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:03.458878 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e74b81-533b-4e9f-b3a1-a8f2d827f13e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:03.459700 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e74b81-533b-4e9f-b3a1-a8f2d827f13e None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:03.460087 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e74b81-533b-4e9f-b3a1-a8f2d827f13e None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:03.460489 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e74b81-533b-4e9f-b3a1-a8f2d827f13e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:03.464024 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a468cc-14ae-4111-84f6-18b6cf3464a9 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:03.486880 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:03.488579 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:03.506553 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06790f16-0340-499a-b3d7-2c6e45840b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:03.507264 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06790f16-0340-499a-b3d7-2c6e45840b0b None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:03.507554 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06790f16-0340-499a-b3d7-2c6e45840b0b None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:03.507837 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06790f16-0340-499a-b3d7-2c6e45840b0b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:03.537965 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e74b81-533b-4e9f-b3a1-a8f2d827f13e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:03.539848 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e74b81-533b-4e9f-b3a1-a8f2d827f13e None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:03.596192 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06790f16-0340-499a-b3d7-2c6e45840b0b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:03.598001 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06790f16-0340-499a-b3d7-2c6e45840b0b None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:03.665876 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 266/529] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 2 21:28:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 21:28:03.666723 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e74b81-533b-4e9f-b3a1-a8f2d827f13e None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:03.712845 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 264/530] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 2 21:28:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 21:28:03.712845 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450631ca-e9fb-4bb2-a59d-d26c625b1766 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:03.712845 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450631ca-e9fb-4bb2-a59d-d26c625b1766 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:03.712845 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450631ca-e9fb-4bb2-a59d-d26c625b1766 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:03.712845 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 265/531] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:28:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:28:03.712845 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450631ca-e9fb-4bb2-a59d-d26c625b1766 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:03.730390 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:03.735818 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:03.782507 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e74b81-533b-4e9f-b3a1-a8f2d827f13e None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:03.819584 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be486ed3-0dfd-4fe5-b7d8-475d887074b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:03.820492 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be486ed3-0dfd-4fe5-b7d8-475d887074b3 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:03.820745 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450631ca-e9fb-4bb2-a59d-d26c625b1766 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:03.821138 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be486ed3-0dfd-4fe5-b7d8-475d887074b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:03.821604 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be486ed3-0dfd-4fe5-b7d8-475d887074b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:03.822674 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be486ed3-0dfd-4fe5-b7d8-475d887074b3 None admin] RBAC: Adding query filter params (role.id=59a4c9a6a22d4bdb966856a28c4aabaf, scope.project.id=42672e04d6ce4b0ab5f7eccfb0cc946c, user.id=123eb76f95ee4e39905944da701c712d) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:03.823276 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be486ed3-0dfd-4fe5-b7d8-475d887074b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:03.824736 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be486ed3-0dfd-4fe5-b7d8-475d887074b3 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:03.840263 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 267/532] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Aug 2 21:28:03 2022] GET /identity/v3/role_assignments?user.id=123eb76f95ee4e39905944da701c712d&scope.project.id=42672e04d6ce4b0ab5f7eccfb0cc946c&role.id=59a4c9a6a22d4bdb966856a28c4aabaf => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:03.840263 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be486ed3-0dfd-4fe5-b7d8-475d887074b3 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:03.869843 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f670db-5181-4f34-a7eb-7d8bcc4a8704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:03.870545 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f670db-5181-4f34-a7eb-7d8bcc4a8704 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:03.870827 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f670db-5181-4f34-a7eb-7d8bcc4a8704 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:03.871105 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f670db-5181-4f34-a7eb-7d8bcc4a8704 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:03.884970 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f670db-5181-4f34-a7eb-7d8bcc4a8704 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:03.887090 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f670db-5181-4f34-a7eb-7d8bcc4a8704 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:03.910822 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-64f670db-5181-4f34-a7eb-7d8bcc4a8704 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:03.910822 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:03.910822 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:03.910822 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:03.910822 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:03.910822 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:03.910822 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:03.910822 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:03.910822 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:03.910822 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:03.910822 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:03.910822 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:03.910822 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:28:03.910822 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:28:03.910822 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:28:03.911937 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:28:03.911937 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:03.911937 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:03.911937 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:03.911937 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:03.911937 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:03.911937 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:03.911937 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:03.911937 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:03.911937 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:03.911937 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:03.911937 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:03.911937 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:03.911937 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:03.911937 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:03.911937 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:03.911937 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:03.913034 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:28:03.913034 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:28:03.913034 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:03.913034 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:03.913034 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 266/533] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 2 21:28:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:03.915268 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f61f5b3-9787-4360-810c-9eb82fa192a5 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:03.915268 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f61f5b3-9787-4360-810c-9eb82fa192a5 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:03.915268 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f61f5b3-9787-4360-810c-9eb82fa192a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:03.937458 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-6f61f5b3-9787-4360-810c-9eb82fa192a5 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:28:03.938667 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-6f61f5b3-9787-4360-810c-9eb82fa192a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:28:03.982109 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be486ed3-0dfd-4fe5-b7d8-475d887074b3 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:04.002658 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:04.024716 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582c64b8-db5a-4fea-bb82-1b036873186b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:04.025376 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582c64b8-db5a-4fea-bb82-1b036873186b None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:04.025665 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582c64b8-db5a-4fea-bb82-1b036873186b None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:04.025945 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582c64b8-db5a-4fea-bb82-1b036873186b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:04.038421 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582c64b8-db5a-4fea-bb82-1b036873186b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:04.038858 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:04.039927 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582c64b8-db5a-4fea-bb82-1b036873186b None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:04.046488 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 267/534] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:28:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:28:04.047728 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f61f5b3-9787-4360-810c-9eb82fa192a5 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:04.066371 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-582c64b8-db5a-4fea-bb82-1b036873186b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:04.066371 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:04.066371 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:04.066371 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:04.066371 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:04.066371 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:04.066371 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:04.066371 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:04.066371 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:04.066371 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:04.066371 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:04.066371 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:04.066371 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:28:04.066371 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:28:04.066371 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:28:04.067272 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:28:04.067272 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:04.067272 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:04.067272 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:04.067272 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:04.067272 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:04.067272 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:04.067272 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:04.067272 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:04.067272 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:04.067272 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:04.067272 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:04.067272 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:04.067272 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:04.067272 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:04.067272 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:04.067272 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:04.068138 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:28:04.068138 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:28:04.068138 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:04.068138 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:28:04.069792 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 268/535] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 2 21:28:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:04.070588 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582c64b8-db5a-4fea-bb82-1b036873186b None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:04.174999 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f61f5b3-9787-4360-810c-9eb82fa192a5 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:04.176970 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582c64b8-db5a-4fea-bb82-1b036873186b None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:04.213406 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95369455-d7e8-4008-aad6-56046257e4dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:04.214612 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95369455-d7e8-4008-aad6-56046257e4dc None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:04.214909 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95369455-d7e8-4008-aad6-56046257e4dc None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:04.215172 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95369455-d7e8-4008-aad6-56046257e4dc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:04.216098 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a438dd8-0ddf-4259-bbba-6cad3ae86095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:04.217074 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a438dd8-0ddf-4259-bbba-6cad3ae86095 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:04.217546 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a438dd8-0ddf-4259-bbba-6cad3ae86095 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:04.218061 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a438dd8-0ddf-4259-bbba-6cad3ae86095 None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:04.218948 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a438dd8-0ddf-4259-bbba-6cad3ae86095 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:04.219447 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a438dd8-0ddf-4259-bbba-6cad3ae86095 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:04.221066 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a438dd8-0ddf-4259-bbba-6cad3ae86095 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:04.225847 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95369455-d7e8-4008-aad6-56046257e4dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:28:04.231323 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-95369455-d7e8-4008-aad6-56046257e4dc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 21:28:04.231323 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:04.231323 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:04.231323 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:04.231323 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:04.231323 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:04.231323 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:04.231323 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:04.231323 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:04.231323 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:04.231323 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:04.231323 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:04.231323 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:28:04.231323 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:28:04.231323 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:28:04.231323 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:28:04.232248 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:28:04.232248 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:28:04.232248 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:28:04.232248 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:28:04.232248 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:04.232248 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:04.232248 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:04.232248 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:04.232248 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:04.232248 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:04.232248 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:04.232248 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:04.232248 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:04.232248 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:04.232248 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:04.232248 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:04.233061 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:04.233061 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:04.233061 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:04.233061 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:04.233061 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:28:04.233061 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:28:04.233061 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:28:04.233061 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:28:04.233061 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:28:04.233061 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:28:04.233061 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 21:28:04.233061 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:28:04.237375 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 268/537] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 2 21:28:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:04.237871 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 269/537] 10.222.0.70 () {56 vars in 1102 bytes} [Tue Aug 2 21:28:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:04.238762 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95369455-d7e8-4008-aad6-56046257e4dc None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:04.239272 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a438dd8-0ddf-4259-bbba-6cad3ae86095 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:04.271738 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:04.310748 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:04.361379 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95369455-d7e8-4008-aad6-56046257e4dc None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:04.366851 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a438dd8-0ddf-4259-bbba-6cad3ae86095 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:04.405007 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c28ac1-e8a7-4ecf-8e0a-235e600208ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:04.405992 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c28ac1-e8a7-4ecf-8e0a-235e600208ba None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:04.406538 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c28ac1-e8a7-4ecf-8e0a-235e600208ba None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:04.406857 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec20a61-d9d6-4474-a866-8aeca4d475a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:04.407298 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c28ac1-e8a7-4ecf-8e0a-235e600208ba None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:04.407469 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec20a61-d9d6-4474-a866-8aeca4d475a3 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:04.407762 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec20a61-d9d6-4474-a866-8aeca4d475a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:04.408040 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec20a61-d9d6-4474-a866-8aeca4d475a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:04.408791 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec20a61-d9d6-4474-a866-8aeca4d475a3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:04.409018 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c28ac1-e8a7-4ecf-8e0a-235e600208ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:04.409114 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec20a61-d9d6-4474-a866-8aeca4d475a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:04.409594 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c28ac1-e8a7-4ecf-8e0a-235e600208ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:04.410540 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec20a61-d9d6-4474-a866-8aeca4d475a3 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:04.411381 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c28ac1-e8a7-4ecf-8e0a-235e600208ba None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:04.419497 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 269/538] 10.222.0.70 () {56 vars in 1103 bytes} [Tue Aug 2 21:28:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:04.420511 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec20a61-d9d6-4474-a866-8aeca4d475a3 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:04.430693 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 270/539] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 2 21:28:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:04.431851 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c28ac1-e8a7-4ecf-8e0a-235e600208ba None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:04.538909 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:04.546377 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec20a61-d9d6-4474-a866-8aeca4d475a3 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:04.551045 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c28ac1-e8a7-4ecf-8e0a-235e600208ba None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:04.571352 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:04.585279 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd413cb4-4a6e-40a5-8ed0-cd492f7cfe4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:04.585910 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd413cb4-4a6e-40a5-8ed0-cd492f7cfe4c None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:04.586195 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd413cb4-4a6e-40a5-8ed0-cd492f7cfe4c None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:04.586561 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd413cb4-4a6e-40a5-8ed0-cd492f7cfe4c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:04.589764 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14c13cf-a74e-41ab-b005-4fbeaa56dabf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:04.590665 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14c13cf-a74e-41ab-b005-4fbeaa56dabf None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:04.591160 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14c13cf-a74e-41ab-b005-4fbeaa56dabf None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:04.591629 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14c13cf-a74e-41ab-b005-4fbeaa56dabf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:04.594390 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd413cb4-4a6e-40a5-8ed0-cd492f7cfe4c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:04.595856 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd413cb4-4a6e-40a5-8ed0-cd492f7cfe4c None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:04.603417 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14c13cf-a74e-41ab-b005-4fbeaa56dabf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:04.605242 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14c13cf-a74e-41ab-b005-4fbeaa56dabf None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:04.608303 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-dd413cb4-4a6e-40a5-8ed0-cd492f7cfe4c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:28:04.608303 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:04.608303 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:04.608303 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:04.608303 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:04.608303 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:04.608303 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:04.608303 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:04.608303 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:04.608303 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:04.608303 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:04.608303 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:04.608303 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 21:28:04.608303 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 21:28:04.608303 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 21:28:04.609104 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 21:28:04.609104 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:04.609104 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:04.609104 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:04.609104 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:04.609104 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:04.609104 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:04.609104 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:04.609104 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:04.609104 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:04.609104 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:04.609104 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:04.609104 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:04.609104 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:04.609104 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:04.609104 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:04.609104 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:04.609931 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 21:28:04.609931 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 21:28:04.609931 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 21:28:04.609931 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 21:28:04.609931 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 21:28:04.609931 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 21:28:04.609931 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:28:04.609931 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:04.614370 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 270/540] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Aug 2 21:28:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:04.615241 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd413cb4-4a6e-40a5-8ed0-cd492f7cfe4c None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:04.625066 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-d14c13cf-a74e-41ab-b005-4fbeaa56dabf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:04.625066 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:04.625066 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:04.625066 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:04.625066 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:04.625066 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:04.625066 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:04.625066 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:04.625066 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:04.625066 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:04.625066 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:04.625066 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:04.625066 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:28:04.625066 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:28:04.625066 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:28:04.625922 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:28:04.625922 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:04.625922 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:04.625922 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:04.625922 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:04.625922 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:04.625922 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:04.625922 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:04.625922 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:04.625922 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:04.625922 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:04.625922 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:04.625922 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:04.625922 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:04.625922 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:04.625922 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:04.625922 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:04.626764 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:28:04.626764 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:28:04.626764 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:04.626764 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:28:04.628626 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 271/541] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 2 21:28:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:04.629743 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14c13cf-a74e-41ab-b005-4fbeaa56dabf None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:04.731097 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd413cb4-4a6e-40a5-8ed0-cd492f7cfe4c None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:04.735025 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14c13cf-a74e-41ab-b005-4fbeaa56dabf None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:04.768756 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031c3abc-4cf1-4d78-b305-adecf579dbf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:04.769514 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031c3abc-4cf1-4d78-b305-adecf579dbf8 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:04.769801 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031c3abc-4cf1-4d78-b305-adecf579dbf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:04.770079 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031c3abc-4cf1-4d78-b305-adecf579dbf8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:04.772561 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008692f5-b676-4593-9555-0c6ef82c0e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:04.773405 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008692f5-b676-4593-9555-0c6ef82c0e5c None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:04.773882 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008692f5-b676-4593-9555-0c6ef82c0e5c None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:04.774347 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008692f5-b676-4593-9555-0c6ef82c0e5c None admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:04.775297 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008692f5-b676-4593-9555-0c6ef82c0e5c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:04.775811 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008692f5-b676-4593-9555-0c6ef82c0e5c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:04.777388 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031c3abc-4cf1-4d78-b305-adecf579dbf8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:04.777733 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008692f5-b676-4593-9555-0c6ef82c0e5c None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:04.778830 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031c3abc-4cf1-4d78-b305-adecf579dbf8 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:04.790581 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-031c3abc-4cf1-4d78-b305-adecf579dbf8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:28:04.790581 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:04.790581 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:04.790581 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:04.790581 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:04.790581 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:04.790581 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:04.790581 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:04.790581 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:04.790581 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:04.790581 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:04.790581 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:04.790581 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 21:28:04.790581 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 21:28:04.790581 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 21:28:04.791418 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 21:28:04.791418 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:04.791418 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:04.791418 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:04.791418 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:04.791418 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:04.791418 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:04.791418 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:04.791418 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:04.791418 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:04.791418 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:04.791418 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:04.791418 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:04.791418 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:04.791418 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:04.791418 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:04.791418 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:04.792877 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 21:28:04.792877 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 21:28:04.792877 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 21:28:04.792877 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 21:28:04.792877 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 21:28:04.792877 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 21:28:04.792877 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:28:04.792877 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:04.792877 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 271/542] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Aug 2 21:28:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:04.792877 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031c3abc-4cf1-4d78-b305-adecf579dbf8 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:04.800133 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 272/543] 10.222.0.70 () {56 vars in 1148 bytes} [Tue Aug 2 21:28:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:04.801284 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008692f5-b676-4593-9555-0c6ef82c0e5c None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:04.804148 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:04.844687 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:04.907405 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031c3abc-4cf1-4d78-b305-adecf579dbf8 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:04.912735 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008692f5-b676-4593-9555-0c6ef82c0e5c None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:04.944846 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbd9ecd-38e3-4225-b562-17e5d1810d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:04.945530 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbd9ecd-38e3-4225-b562-17e5d1810d8f None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:04.945759 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbd9ecd-38e3-4225-b562-17e5d1810d8f None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:04.946100 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbd9ecd-38e3-4225-b562-17e5d1810d8f None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:04.946802 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbd9ecd-38e3-4225-b562-17e5d1810d8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:04.947154 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbd9ecd-38e3-4225-b562-17e5d1810d8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:04.948731 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbd9ecd-38e3-4225-b562-17e5d1810d8f None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:04.956806 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8462cf-f5b3-42f6-b16f-be20eed39849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:04.957440 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8462cf-f5b3-42f6-b16f-be20eed39849 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:04.957894 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8462cf-f5b3-42f6-b16f-be20eed39849 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:04.958331 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8462cf-f5b3-42f6-b16f-be20eed39849 None admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:04.959687 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8462cf-f5b3-42f6-b16f-be20eed39849 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:04.960003 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8462cf-f5b3-42f6-b16f-be20eed39849 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:04.962070 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8462cf-f5b3-42f6-b16f-be20eed39849 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:04.966018 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 272/544] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 2 21:28:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:04.967160 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbd9ecd-38e3-4225-b562-17e5d1810d8f None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:04.977108 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 273/545] 10.222.0.70 () {56 vars in 1148 bytes} [Tue Aug 2 21:28:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:04.978358 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8462cf-f5b3-42f6-b16f-be20eed39849 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:05.045423 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:05.080058 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbd9ecd-38e3-4225-b562-17e5d1810d8f None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:05.081768 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:05.091052 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8462cf-f5b3-42f6-b16f-be20eed39849 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:05.117080 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86685e76-3201-49aa-9734-44cd13df1cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:05.117698 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86685e76-3201-49aa-9734-44cd13df1cba None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:05.117982 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86685e76-3201-49aa-9734-44cd13df1cba None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:05.118247 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86685e76-3201-49aa-9734-44cd13df1cba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:05.119024 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86685e76-3201-49aa-9734-44cd13df1cba None admin] RBAC: Adding query filter params (role.id=59a4c9a6a22d4bdb966856a28c4aabaf, scope.project.id=42672e04d6ce4b0ab5f7eccfb0cc946c, user.id=accb7ab8b4f447389ed394a48fc27619) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:05.119334 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86685e76-3201-49aa-9734-44cd13df1cba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:05.121456 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86685e76-3201-49aa-9734-44cd13df1cba None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:05.132287 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 273/546] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Aug 2 21:28:04 2022] GET /identity/v3/role_assignments?user.id=accb7ab8b4f447389ed394a48fc27619&scope.project.id=42672e04d6ce4b0ab5f7eccfb0cc946c&role.id=59a4c9a6a22d4bdb966856a28c4aabaf => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:05.132465 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c76f91f-251f-4432-a73d-56ae9f34a60b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:05.132465 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c76f91f-251f-4432-a73d-56ae9f34a60b None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:05.132465 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c76f91f-251f-4432-a73d-56ae9f34a60b None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:05.132709 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3d83be-de51-4dd4-a51b-810edfde9e61 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:05.132775 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c76f91f-251f-4432-a73d-56ae9f34a60b None admin] PATH_INFO: `/v3/users/swift` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:05.132839 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3d83be-de51-4dd4-a51b-810edfde9e61 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:05.132839 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3d83be-de51-4dd4-a51b-810edfde9e61 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:05.132839 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 274/547] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:28:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:28:05.132839 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3d83be-de51-4dd4-a51b-810edfde9e61 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:05.147618 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c76f91f-251f-4432-a73d-56ae9f34a60b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:05.149440 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c76f91f-251f-4432-a73d-56ae9f34a60b None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:05.163555 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-3c76f91f-251f-4432-a73d-56ae9f34a60b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 02 21:28:05.163555 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:05.163555 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:05.163555 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:05.163555 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:05.163555 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:05.163555 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:05.163555 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:05.163555 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:05.163555 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:05.163555 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:05.163555 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:05.163555 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 21:28:05.163555 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 21:28:05.163555 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 21:28:05.163555 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 21:28:05.164541 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:05.164541 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:05.164541 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 21:28:05.164541 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:28:05.164541 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 21:28:05.164541 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:28:05.164541 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:05.164541 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:05.164541 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:05.164541 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:05.164541 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:05.164541 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:05.164541 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:05.164541 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:05.164541 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:05.164541 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:05.164541 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:05.164541 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:05.166070 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:05.166070 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:05.166070 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 21:28:05.166070 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 21:28:05.166070 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 21:28:05.166070 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 21:28:05.166070 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 21:28:05.166070 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 21:28:05.166070 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 02 21:28:05.166070 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:28:05.166070 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 274/548] 10.222.0.70 () {56 vars in 1096 bytes} [Tue Aug 2 21:28:04 2022] GET /identity/v3/users/swift => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:05.166646 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaef52b-b459-4cea-b9d5-9ea038b5bbdb None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:05.166646 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaef52b-b459-4cea-b9d5-9ea038b5bbdb None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:05.166646 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaef52b-b459-4cea-b9d5-9ea038b5bbdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:05.187708 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-baaef52b-b459-4cea-b9d5-9ea038b5bbdb None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:28:05.189187 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-baaef52b-b459-4cea-b9d5-9ea038b5bbdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:28:05.263166 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3d83be-de51-4dd4-a51b-810edfde9e61 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:05.286125 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 275/549] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:28:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:28:05.287647 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaef52b-b459-4cea-b9d5-9ea038b5bbdb None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:05.327164 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757fb56c-9b05-4cf0-a9cf-af12e4b0ca7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:05.328010 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757fb56c-9b05-4cf0-a9cf-af12e4b0ca7b None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:05.328478 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757fb56c-9b05-4cf0-a9cf-af12e4b0ca7b None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:05.328891 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757fb56c-9b05-4cf0-a9cf-af12e4b0ca7b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:05.329837 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757fb56c-9b05-4cf0-a9cf-af12e4b0ca7b None admin] RBAC: Adding query filter params (role.id=59a4c9a6a22d4bdb966856a28c4aabaf, scope.project.id=42672e04d6ce4b0ab5f7eccfb0cc946c, user.id=723f5f43572a493dae0349070a2adb5e) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:05.330420 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757fb56c-9b05-4cf0-a9cf-af12e4b0ca7b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:05.331573 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757fb56c-9b05-4cf0-a9cf-af12e4b0ca7b None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:05.338187 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 275/550] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Aug 2 21:28:05 2022] GET /identity/v3/role_assignments?user.id=723f5f43572a493dae0349070a2adb5e&scope.project.id=42672e04d6ce4b0ab5f7eccfb0cc946c&role.id=59a4c9a6a22d4bdb966856a28c4aabaf => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:05.339852 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757fb56c-9b05-4cf0-a9cf-af12e4b0ca7b None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:05.376460 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:05.414576 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:05.468263 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaef52b-b459-4cea-b9d5-9ea038b5bbdb None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:05.511351 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7577af-4a4c-4a7f-aae1-178e560746f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:05.511978 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7577af-4a4c-4a7f-aae1-178e560746f2 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:05.512279 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7577af-4a4c-4a7f-aae1-178e560746f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:05.512558 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7577af-4a4c-4a7f-aae1-178e560746f2 None admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:05.513361 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7577af-4a4c-4a7f-aae1-178e560746f2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:05.513669 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7577af-4a4c-4a7f-aae1-178e560746f2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:05.515104 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7577af-4a4c-4a7f-aae1-178e560746f2 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:05.538459 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 276/551] 10.222.0.70 () {56 vars in 1135 bytes} [Tue Aug 2 21:28:05 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:05.544350 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7577af-4a4c-4a7f-aae1-178e560746f2 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:05.563945 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757fb56c-9b05-4cf0-a9cf-af12e4b0ca7b None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:05.609717 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d3daed-e980-40eb-b49f-252a8d5bdd22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:05.610800 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d3daed-e980-40eb-b49f-252a8d5bdd22 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:05.611281 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d3daed-e980-40eb-b49f-252a8d5bdd22 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:05.611754 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d3daed-e980-40eb-b49f-252a8d5bdd22 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:05.623635 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d3daed-e980-40eb-b49f-252a8d5bdd22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:28:05.629808 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-72d3daed-e980-40eb-b49f-252a8d5bdd22 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 21:28:05.629808 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:05.629808 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:05.629808 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:05.629808 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:05.629808 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:05.629808 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:05.629808 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:05.629808 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:05.629808 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:05.629808 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:05.629808 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:05.629808 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:28:05.629808 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:28:05.629808 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:28:05.629808 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:28:05.630825 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:28:05.630825 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:28:05.630825 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:28:05.630825 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:28:05.630825 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:05.630825 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:05.630825 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:05.630825 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:05.630825 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:05.630825 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:05.630825 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:05.630825 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:05.630825 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:05.630825 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:05.630825 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:05.630825 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:05.631744 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:05.631744 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:05.631744 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:05.631744 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:05.631744 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:28:05.631744 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:28:05.631744 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:28:05.631744 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:28:05.631744 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:28:05.631744 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:28:05.631744 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 21:28:05.631744 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:05.634220 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 276/552] 10.222.0.70 () {56 vars in 1102 bytes} [Tue Aug 2 21:28:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:05.640095 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d3daed-e980-40eb-b49f-252a8d5bdd22 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:05.753913 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:05.754394 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7577af-4a4c-4a7f-aae1-178e560746f2 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:05.770731 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:05.773277 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d3daed-e980-40eb-b49f-252a8d5bdd22 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:05.816402 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75d3828-e9b2-4406-91ab-eb1c401d993f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:05.817036 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75d3828-e9b2-4406-91ab-eb1c401d993f None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:05.817321 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75d3828-e9b2-4406-91ab-eb1c401d993f None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:05.817596 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75d3828-e9b2-4406-91ab-eb1c401d993f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:05.842843 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c32885-b0aa-4419-9c03-c606707962f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:05.843465 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c32885-b0aa-4419-9c03-c606707962f8 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:05.843749 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c32885-b0aa-4419-9c03-c606707962f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:05.844023 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c32885-b0aa-4419-9c03-c606707962f8 None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:05.844769 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c32885-b0aa-4419-9c03-c606707962f8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:05.845073 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c32885-b0aa-4419-9c03-c606707962f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:05.846454 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c32885-b0aa-4419-9c03-c606707962f8 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:05.859469 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 277/553] 10.222.0.70 () {56 vars in 1103 bytes} [Tue Aug 2 21:28:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:05.860767 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c32885-b0aa-4419-9c03-c606707962f8 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:05.944812 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75d3828-e9b2-4406-91ab-eb1c401d993f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:05.946275 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75d3828-e9b2-4406-91ab-eb1c401d993f None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:05.974854 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c32885-b0aa-4419-9c03-c606707962f8 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:06.014594 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b91b338-0a96-4a97-954b-2794365e1f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:06.015354 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b91b338-0a96-4a97-954b-2794365e1f2e None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:06.015640 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b91b338-0a96-4a97-954b-2794365e1f2e None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:06.015920 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b91b338-0a96-4a97-954b-2794365e1f2e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:06.028279 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b91b338-0a96-4a97-954b-2794365e1f2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:06.030146 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b91b338-0a96-4a97-954b-2794365e1f2e None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:06.046076 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-6b91b338-0a96-4a97-954b-2794365e1f2e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:06.046076 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:06.046076 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:06.046076 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:06.046076 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:06.046076 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:06.046076 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:06.046076 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:06.046076 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:06.046076 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:06.046076 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:06.046076 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:06.046076 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:28:06.046076 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:28:06.046076 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:28:06.047102 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:28:06.047102 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:06.047102 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:06.047102 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:06.047102 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:06.047102 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:06.047102 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:06.047102 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:06.047102 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:06.047102 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:06.047102 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:06.047102 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:06.047102 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:06.047102 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:06.047102 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:06.047102 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:06.047102 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:06.047972 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:28:06.047972 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:28:06.047972 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:06.047972 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:06.052179 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 278/554] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 2 21:28:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:06.053578 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac404aa-9afb-4eb7-a49f-358b96d7df7e None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:06.053874 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac404aa-9afb-4eb7-a49f-358b96d7df7e None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:06.054160 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac404aa-9afb-4eb7-a49f-358b96d7df7e None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:06.055998 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 279/555] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:28:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:28:06.056791 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac404aa-9afb-4eb7-a49f-358b96d7df7e None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:06.077506 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:06.081826 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 277/556] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 2 21:28:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 538 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 02 21:28:06.083155 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e78fb-c99f-4b09-a4d1-bfda90098bf0 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:06.083455 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e78fb-c99f-4b09-a4d1-bfda90098bf0 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:06.083737 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e78fb-c99f-4b09-a4d1-bfda90098bf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:06.103473 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-333e78fb-c99f-4b09-a4d1-bfda90098bf0 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:28:06.104776 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-333e78fb-c99f-4b09-a4d1-bfda90098bf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:28:06.107995 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:06.176009 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac404aa-9afb-4eb7-a49f-358b96d7df7e None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:06.184703 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 278/557] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:28:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:28:06.185474 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333e78fb-c99f-4b09-a4d1-bfda90098bf0 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:06.216700 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d589b6e3-4a02-4cc4-b066-b78090b81f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:06.217822 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d589b6e3-4a02-4cc4-b066-b78090b81f11 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:06.218279 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d589b6e3-4a02-4cc4-b066-b78090b81f11 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:06.218706 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d589b6e3-4a02-4cc4-b066-b78090b81f11 None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:06.219731 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d589b6e3-4a02-4cc4-b066-b78090b81f11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:06.220610 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d589b6e3-4a02-4cc4-b066-b78090b81f11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:06.222219 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d589b6e3-4a02-4cc4-b066-b78090b81f11 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:06.244718 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 280/558] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 2 21:28:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:28:06.246059 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d589b6e3-4a02-4cc4-b066-b78090b81f11 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:06.326027 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:06.335974 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333e78fb-c99f-4b09-a4d1-bfda90098bf0 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:06.370658 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d589b6e3-4a02-4cc4-b066-b78090b81f11 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:06.382571 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca22842-1ef7-4c30-b679-e70e2053016e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:06.383903 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca22842-1ef7-4c30-b679-e70e2053016e None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:06.384680 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca22842-1ef7-4c30-b679-e70e2053016e None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:06.385185 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca22842-1ef7-4c30-b679-e70e2053016e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:06.397446 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:06.402972 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca22842-1ef7-4c30-b679-e70e2053016e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:06.406299 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca22842-1ef7-4c30-b679-e70e2053016e None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:06.409739 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9b0b4f-75b7-4180-baa7-64a01512dd14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:06.410541 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b0b4f-75b7-4180-baa7-64a01512dd14 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:06.410923 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b0b4f-75b7-4180-baa7-64a01512dd14 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:06.411298 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b0b4f-75b7-4180-baa7-64a01512dd14 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:06.424389 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9b0b4f-75b7-4180-baa7-64a01512dd14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:28:06.427409 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-8ca22842-1ef7-4c30-b679-e70e2053016e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:06.427409 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:06.427409 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:06.427409 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:06.427409 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:06.427409 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:06.427409 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:06.427409 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:06.427409 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:06.427409 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:06.427409 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:06.427409 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:06.427409 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:28:06.427409 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:28:06.427409 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:28:06.428359 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:28:06.428359 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:06.428359 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:06.428359 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:06.428359 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:06.428359 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:06.428359 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:06.428359 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:06.428359 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:06.428359 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:06.428359 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:06.428359 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:06.428359 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:06.428359 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:06.428359 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:06.428359 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:06.428359 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:06.429261 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:28:06.429261 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:28:06.429261 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:06.429261 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:28:06.430304 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-0e9b0b4f-75b7-4180-baa7-64a01512dd14 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 21:28:06.430304 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:06.430304 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:06.430304 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:06.430304 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:06.430304 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:06.430304 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:06.430304 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:06.430304 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:06.430304 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:06.430304 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:06.430304 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:06.430304 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:28:06.430304 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:28:06.430304 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:28:06.430304 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:28:06.431175 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:28:06.431175 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:28:06.431175 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:28:06.431175 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:28:06.431175 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:06.431175 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:06.431175 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:06.431175 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:06.431175 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:06.431175 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:06.431175 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:06.431175 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:06.431175 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:06.431175 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:06.431175 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:06.431175 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:06.432263 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:06.432263 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:06.432263 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:06.432263 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:06.432263 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:28:06.432263 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:28:06.432263 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:28:06.432263 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:28:06.432263 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:28:06.432263 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:28:06.432263 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 21:28:06.432263 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:06.432263 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 281/559] 10.222.0.70 () {56 vars in 1102 bytes} [Tue Aug 2 21:28:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:06.433755 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9b0b4f-75b7-4180-baa7-64a01512dd14 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:06.439859 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 279/560] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 2 21:28:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:06.442007 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca22842-1ef7-4c30-b679-e70e2053016e None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:06.553372 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca22842-1ef7-4c30-b679-e70e2053016e None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:06.570355 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9b0b4f-75b7-4180-baa7-64a01512dd14 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:06.593176 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1b7fdb-3fe2-45c3-8c2e-fbeb5cbdc287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:06.594145 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b7fdb-3fe2-45c3-8c2e-fbeb5cbdc287 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:06.594614 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b7fdb-3fe2-45c3-8c2e-fbeb5cbdc287 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:06.595071 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b7fdb-3fe2-45c3-8c2e-fbeb5cbdc287 None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:06.595700 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:06.596191 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1b7fdb-3fe2-45c3-8c2e-fbeb5cbdc287 None admin] RBAC: Adding query filter params (name=service) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:06.596796 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1b7fdb-3fe2-45c3-8c2e-fbeb5cbdc287 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:06.598497 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1b7fdb-3fe2-45c3-8c2e-fbeb5cbdc287 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:06.609258 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c7018b-e810-42ed-9abb-b51c74e7d89c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:06.609969 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c7018b-e810-42ed-9abb-b51c74e7d89c None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:06.610394 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c7018b-e810-42ed-9abb-b51c74e7d89c None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:06.610527 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c7018b-e810-42ed-9abb-b51c74e7d89c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:06.610748 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 280/561] 10.222.0.70 () {56 vars in 1103 bytes} [Tue Aug 2 21:28:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:06.611868 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1b7fdb-3fe2-45c3-8c2e-fbeb5cbdc287 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:06.619841 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c7018b-e810-42ed-9abb-b51c74e7d89c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:06.621995 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c7018b-e810-42ed-9abb-b51c74e7d89c None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:06.634045 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-51c7018b-e810-42ed-9abb-b51c74e7d89c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 02 21:28:06.634045 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:06.634045 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:06.634045 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:06.634045 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:06.634045 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:06.634045 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:06.634045 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:06.634045 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:06.634045 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:06.634045 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:06.634045 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:06.634045 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 21:28:06.634045 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 21:28:06.634045 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 21:28:06.634045 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 21:28:06.635004 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:06.635004 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:06.635004 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 21:28:06.635004 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:28:06.635004 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 21:28:06.635004 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:28:06.635004 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:06.635004 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:06.635004 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:06.635004 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:06.635004 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:06.635004 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:06.635004 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:06.635004 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:06.635004 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:06.635004 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:06.635004 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:06.635004 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:06.636069 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:06.636069 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:06.636069 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 21:28:06.636069 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 21:28:06.636069 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 21:28:06.636069 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 21:28:06.636069 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 21:28:06.636069 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 21:28:06.636069 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 02 21:28:06.636069 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:06.639896 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 282/562] 10.222.0.70 () {56 vars in 1093 bytes} [Tue Aug 2 21:28:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:06.641107 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c7018b-e810-42ed-9abb-b51c74e7d89c None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:06.676184 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:06.724995 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1b7fdb-3fe2-45c3-8c2e-fbeb5cbdc287 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:06.748016 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c7018b-e810-42ed-9abb-b51c74e7d89c None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:06.762027 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62860806-e614-41ca-a620-9f43a9516d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:06.762875 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62860806-e614-41ca-a620-9f43a9516d0f None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:06.763333 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62860806-e614-41ca-a620-9f43a9516d0f None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:06.763840 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62860806-e614-41ca-a620-9f43a9516d0f None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:06.764783 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62860806-e614-41ca-a620-9f43a9516d0f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:06.765297 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62860806-e614-41ca-a620-9f43a9516d0f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:06.766909 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62860806-e614-41ca-a620-9f43a9516d0f None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:06.779420 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 281/563] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 2 21:28:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:06.780672 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62860806-e614-41ca-a620-9f43a9516d0f None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:06.784391 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff5bec9-1ef7-4213-b5fb-9452af70e755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:06.785629 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff5bec9-1ef7-4213-b5fb-9452af70e755 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:06.785629 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff5bec9-1ef7-4213-b5fb-9452af70e755 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:06.785857 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff5bec9-1ef7-4213-b5fb-9452af70e755 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:06.797836 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff5bec9-1ef7-4213-b5fb-9452af70e755 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:06.799317 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff5bec9-1ef7-4213-b5fb-9452af70e755 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:06.814702 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-5ff5bec9-1ef7-4213-b5fb-9452af70e755 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:06.814702 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:06.814702 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:06.814702 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:06.814702 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:06.814702 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:06.814702 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:06.814702 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:06.814702 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:06.814702 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:06.814702 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:06.814702 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:06.814702 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:28:06.814702 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:28:06.814702 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:28:06.815605 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:28:06.815605 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:06.815605 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:06.815605 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:06.815605 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:06.815605 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:06.815605 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:06.815605 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:06.815605 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:06.815605 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:06.815605 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:06.815605 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:06.815605 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:06.815605 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:06.815605 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:06.815605 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:06.815605 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:06.817102 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:28:06.817102 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:28:06.817102 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:06.817102 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:06.817102 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 283/564] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 2 21:28:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:06.817102 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff5bec9-1ef7-4213-b5fb-9452af70e755 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:06.854161 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:06.892132 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62860806-e614-41ca-a620-9f43a9516d0f None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:06.909548 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:06.929393 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff5bec9-1ef7-4213-b5fb-9452af70e755 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:06.933946 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2fe870-1ed1-4b28-af35-36a0bd6784ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:06.934815 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2fe870-1ed1-4b28-af35-36a0bd6784ed None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:06.935302 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2fe870-1ed1-4b28-af35-36a0bd6784ed None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:06.935795 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2fe870-1ed1-4b28-af35-36a0bd6784ed None admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:06.936842 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2fe870-1ed1-4b28-af35-36a0bd6784ed None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:06.937362 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2fe870-1ed1-4b28-af35-36a0bd6784ed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:06.939015 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2fe870-1ed1-4b28-af35-36a0bd6784ed None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:06.957871 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 282/565] 10.222.0.70 () {56 vars in 1133 bytes} [Tue Aug 2 21:28:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:06.959075 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2fe870-1ed1-4b28-af35-36a0bd6784ed None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:06.971175 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a798bc7a-4cf7-4610-b8ef-c6bda40b7a03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:06.971877 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a798bc7a-4cf7-4610-b8ef-c6bda40b7a03 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:06.972102 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a798bc7a-4cf7-4610-b8ef-c6bda40b7a03 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:06.972409 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a798bc7a-4cf7-4610-b8ef-c6bda40b7a03 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:06.980374 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a798bc7a-4cf7-4610-b8ef-c6bda40b7a03 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:06.982110 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a798bc7a-4cf7-4610-b8ef-c6bda40b7a03 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:06.994421 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-a798bc7a-4cf7-4610-b8ef-c6bda40b7a03 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:28:06.994421 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:06.994421 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:06.994421 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:06.994421 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:06.994421 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:06.994421 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:06.994421 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:06.994421 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:06.994421 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:06.994421 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:06.994421 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:06.994421 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 21:28:06.994421 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 21:28:06.994421 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 21:28:06.995368 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 21:28:06.995368 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:06.995368 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:06.995368 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:06.995368 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:06.995368 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:06.995368 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:06.995368 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:06.995368 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:06.995368 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:06.995368 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:06.995368 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:06.995368 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:06.995368 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:06.995368 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:06.995368 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:06.995368 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:06.996873 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 21:28:06.996873 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 21:28:06.996873 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 21:28:06.996873 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 21:28:06.996873 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 21:28:06.996873 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 21:28:06.996873 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:28:06.996873 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:06.996873 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 284/566] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Aug 2 21:28:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:06.996873 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a798bc7a-4cf7-4610-b8ef-c6bda40b7a03 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:07.071435 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2fe870-1ed1-4b28-af35-36a0bd6784ed None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:07.099695 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:07.106806 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a798bc7a-4cf7-4610-b8ef-c6bda40b7a03 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:07.109335 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868c8213-96d5-4a9e-9e69-4e45240c3f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:07.110630 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868c8213-96d5-4a9e-9e69-4e45240c3f13 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:07.111152 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868c8213-96d5-4a9e-9e69-4e45240c3f13 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:07.111629 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868c8213-96d5-4a9e-9e69-4e45240c3f13 None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:07.112570 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868c8213-96d5-4a9e-9e69-4e45240c3f13 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:07.113359 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868c8213-96d5-4a9e-9e69-4e45240c3f13 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:07.114945 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868c8213-96d5-4a9e-9e69-4e45240c3f13 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:07.127783 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 283/567] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 2 21:28:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:07.129041 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868c8213-96d5-4a9e-9e69-4e45240c3f13 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:07.144520 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52377fb6-4bb5-4c0a-b0dd-d191ac08f7a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:07.145218 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52377fb6-4bb5-4c0a-b0dd-d191ac08f7a9 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:07.145551 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52377fb6-4bb5-4c0a-b0dd-d191ac08f7a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:07.145834 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52377fb6-4bb5-4c0a-b0dd-d191ac08f7a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:07.158143 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52377fb6-4bb5-4c0a-b0dd-d191ac08f7a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:07.159520 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52377fb6-4bb5-4c0a-b0dd-d191ac08f7a9 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:07.164891 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:07.175390 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-52377fb6-4bb5-4c0a-b0dd-d191ac08f7a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:07.175390 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:07.175390 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:07.175390 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:07.175390 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:07.175390 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:07.175390 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:07.175390 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:07.175390 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:07.175390 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:07.175390 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:07.175390 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:07.175390 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:28:07.175390 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:28:07.175390 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:28:07.176321 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:28:07.176321 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:07.176321 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:07.176321 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:07.176321 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:07.176321 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:07.176321 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:07.176321 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:07.176321 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:07.176321 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:07.176321 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:07.176321 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:07.176321 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:07.176321 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:07.176321 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:07.176321 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:07.176321 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:07.177210 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:28:07.177210 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:28:07.177210 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:07.177210 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:07.177210 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 285/568] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 2 21:28:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:07.177488 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52377fb6-4bb5-4c0a-b0dd-d191ac08f7a9 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:07.244423 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868c8213-96d5-4a9e-9e69-4e45240c3f13 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:07.282152 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab7f6de-6f70-49cc-8289-537ec2da7b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:07.283174 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab7f6de-6f70-49cc-8289-537ec2da7b0b None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:07.283700 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab7f6de-6f70-49cc-8289-537ec2da7b0b None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:07.284182 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab7f6de-6f70-49cc-8289-537ec2da7b0b None admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:07.285231 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab7f6de-6f70-49cc-8289-537ec2da7b0b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:07.285744 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab7f6de-6f70-49cc-8289-537ec2da7b0b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:07.287589 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab7f6de-6f70-49cc-8289-537ec2da7b0b None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:07.290986 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52377fb6-4bb5-4c0a-b0dd-d191ac08f7a9 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:07.303062 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 284/569] 10.222.0.70 () {56 vars in 1148 bytes} [Tue Aug 2 21:28:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:07.304270 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab7f6de-6f70-49cc-8289-537ec2da7b0b None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:07.328850 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7198f366-4741-43c2-8bed-c3606625e940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:07.329404 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7198f366-4741-43c2-8bed-c3606625e940 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:07.329633 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7198f366-4741-43c2-8bed-c3606625e940 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:07.329930 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7198f366-4741-43c2-8bed-c3606625e940 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:07.338221 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7198f366-4741-43c2-8bed-c3606625e940 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:07.344064 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7198f366-4741-43c2-8bed-c3606625e940 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:07.360678 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-7198f366-4741-43c2-8bed-c3606625e940 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 02 21:28:07.360678 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:07.360678 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:07.360678 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:07.360678 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:07.360678 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:07.360678 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:07.360678 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:07.360678 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:07.360678 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:07.360678 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:07.360678 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:07.360678 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 21:28:07.360678 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 21:28:07.360678 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 21:28:07.360678 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 21:28:07.361685 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:07.361685 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:07.361685 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 21:28:07.361685 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:28:07.361685 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 21:28:07.361685 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:28:07.361685 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:07.361685 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:07.361685 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:07.361685 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:07.361685 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:07.361685 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:07.361685 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:07.361685 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:07.361685 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:07.361685 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:07.361685 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:07.361685 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:07.363567 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:07.363567 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:07.363567 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 21:28:07.363567 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 21:28:07.363567 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 21:28:07.363567 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 21:28:07.363567 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 21:28:07.363567 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 21:28:07.363567 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 02 21:28:07.363567 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:07.363567 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 286/570] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 2 21:28:07 2022] GET /identity/v3/users/cinder => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:07.364150 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7198f366-4741-43c2-8bed-c3606625e940 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:07.382028 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:07.419126 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:07.431387 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab7f6de-6f70-49cc-8289-537ec2da7b0b None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:07.467070 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7726d3a2-9647-493c-a8ee-ae775bd44d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:07.467693 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7726d3a2-9647-493c-a8ee-ae775bd44d68 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:07.467979 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7726d3a2-9647-493c-a8ee-ae775bd44d68 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:07.468281 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7726d3a2-9647-493c-a8ee-ae775bd44d68 None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:07.468978 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7726d3a2-9647-493c-a8ee-ae775bd44d68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:07.469285 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7726d3a2-9647-493c-a8ee-ae775bd44d68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:07.470658 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7726d3a2-9647-493c-a8ee-ae775bd44d68 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:07.478130 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7198f366-4741-43c2-8bed-c3606625e940 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:07.482426 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 285/571] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 2 21:28:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:07.483059 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7726d3a2-9647-493c-a8ee-ae775bd44d68 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:07.521799 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce764b3-09a7-48f3-936b-75c90cc90c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:07.522340 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce764b3-09a7-48f3-936b-75c90cc90c5e None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:07.522621 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce764b3-09a7-48f3-936b-75c90cc90c5e None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:07.522895 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce764b3-09a7-48f3-936b-75c90cc90c5e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:07.523676 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce764b3-09a7-48f3-936b-75c90cc90c5e None admin] RBAC: Adding query filter params (role.id=59a4c9a6a22d4bdb966856a28c4aabaf, scope.project.id=42672e04d6ce4b0ab5f7eccfb0cc946c, user.id=2ee7ebf40212465aac997b461a2d10fc) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:07.523986 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce764b3-09a7-48f3-936b-75c90cc90c5e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:07.525444 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce764b3-09a7-48f3-936b-75c90cc90c5e None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:07.531313 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 287/572] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Aug 2 21:28:07 2022] GET /identity/v3/role_assignments?user.id=2ee7ebf40212465aac997b461a2d10fc&scope.project.id=42672e04d6ce4b0ab5f7eccfb0cc946c&role.id=59a4c9a6a22d4bdb966856a28c4aabaf => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:07.532481 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e329ac59-1424-4a01-9544-134817d39623 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:07.532772 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e329ac59-1424-4a01-9544-134817d39623 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:07.533045 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e329ac59-1424-4a01-9544-134817d39623 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:07.534530 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 288/573] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:28:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:28:07.535286 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e329ac59-1424-4a01-9544-134817d39623 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:07.597934 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7726d3a2-9647-493c-a8ee-ae775bd44d68 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:07.627885 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:07.640250 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07b8339-6b69-4e6a-836c-a89b24bce8c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:07.640906 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b8339-6b69-4e6a-836c-a89b24bce8c4 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:07.641194 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b8339-6b69-4e6a-836c-a89b24bce8c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:07.641473 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07b8339-6b69-4e6a-836c-a89b24bce8c4 None admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:07.642284 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07b8339-6b69-4e6a-836c-a89b24bce8c4 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:07.642598 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07b8339-6b69-4e6a-836c-a89b24bce8c4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:07.644068 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07b8339-6b69-4e6a-836c-a89b24bce8c4 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:07.664841 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e329ac59-1424-4a01-9544-134817d39623 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:07.670442 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 286/574] 10.222.0.70 () {56 vars in 1137 bytes} [Tue Aug 2 21:28:07 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:07.670442 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181f9d56-a569-48e6-a872-c072ccdb747c None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:07.670442 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181f9d56-a569-48e6-a872-c072ccdb747c None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:07.670442 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181f9d56-a569-48e6-a872-c072ccdb747c None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:07.670442 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 287/575] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:28:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:28:07.670893 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53930f14-187f-4b91-b3e6-0d1b74203423 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:07.670893 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53930f14-187f-4b91-b3e6-0d1b74203423 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:07.671180 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53930f14-187f-4b91-b3e6-0d1b74203423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:07.690681 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-53930f14-187f-4b91-b3e6-0d1b74203423 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:28:07.691889 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-53930f14-187f-4b91-b3e6-0d1b74203423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:28:07.694909 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:07.710912 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e7a714-2be7-493f-9150-b44c27dc8375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:07.711560 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e7a714-2be7-493f-9150-b44c27dc8375 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:07.711903 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e7a714-2be7-493f-9150-b44c27dc8375 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:07.712195 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e7a714-2be7-493f-9150-b44c27dc8375 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:07.719691 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e7a714-2be7-493f-9150-b44c27dc8375 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:07.721307 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e7a714-2be7-493f-9150-b44c27dc8375 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:07.733785 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-b5e7a714-2be7-493f-9150-b44c27dc8375 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:28:07.733785 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:07.733785 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:07.733785 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:07.733785 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:07.733785 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:07.733785 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:07.733785 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:07.733785 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:07.733785 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:07.733785 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:07.733785 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:07.733785 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 21:28:07.733785 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 21:28:07.733785 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 21:28:07.734666 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 21:28:07.734666 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:07.734666 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:07.734666 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:07.734666 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:07.734666 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:07.734666 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:07.734666 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:07.734666 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:07.734666 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:07.734666 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:07.734666 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:07.734666 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:07.734666 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:07.734666 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:07.734666 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:07.734666 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:07.735544 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 21:28:07.735544 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 21:28:07.735544 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 21:28:07.735544 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 21:28:07.735544 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 21:28:07.735544 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 21:28:07.735544 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:28:07.735544 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:07.739802 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 289/576] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Aug 2 21:28:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:07.740684 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e7a714-2be7-493f-9150-b44c27dc8375 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:07.777056 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 288/577] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:28:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:28:07.778212 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405a2613-5cc3-489e-9f17-a09493c8f4dd None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:07.778505 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405a2613-5cc3-489e-9f17-a09493c8f4dd None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:07.778778 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405a2613-5cc3-489e-9f17-a09493c8f4dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:07.809732 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-405a2613-5cc3-489e-9f17-a09493c8f4dd None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:28:07.810922 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-405a2613-5cc3-489e-9f17-a09493c8f4dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:28:07.855701 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e7a714-2be7-493f-9150-b44c27dc8375 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:07.888399 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 289/578] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:28:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:28:07.888399 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405a2613-5cc3-489e-9f17-a09493c8f4dd None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:07.891157 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:07.901020 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961091ae-1153-460f-93bc-2fa9d4b8b177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:07.902206 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961091ae-1153-460f-93bc-2fa9d4b8b177 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:07.902488 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961091ae-1153-460f-93bc-2fa9d4b8b177 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:07.902759 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961091ae-1153-460f-93bc-2fa9d4b8b177 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:07.917735 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961091ae-1153-460f-93bc-2fa9d4b8b177 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:07.919212 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961091ae-1153-460f-93bc-2fa9d4b8b177 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:07.934359 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-961091ae-1153-460f-93bc-2fa9d4b8b177 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:07.934359 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:07.934359 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:07.934359 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:07.934359 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:07.934359 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:07.934359 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:07.934359 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:07.934359 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:07.934359 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:07.934359 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:07.934359 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:07.934359 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:28:07.934359 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:28:07.934359 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:28:07.935255 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:28:07.935255 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:07.935255 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:07.935255 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:07.935255 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:07.935255 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:07.935255 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:07.935255 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:07.935255 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:07.935255 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:07.935255 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:07.935255 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:07.935255 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:07.935255 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:07.935255 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:07.935255 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:07.935255 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:07.936115 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:28:07.936115 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:28:07.936115 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:07.936115 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:07.940170 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 290/579] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 2 21:28:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:07.941026 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961091ae-1153-460f-93bc-2fa9d4b8b177 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:07.967460 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:08.003405 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405a2613-5cc3-489e-9f17-a09493c8f4dd None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:08.038130 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0214c1d-3a3f-417c-bafb-895a32ecf1b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:08.038672 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0214c1d-3a3f-417c-bafb-895a32ecf1b6 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:08.038955 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0214c1d-3a3f-417c-bafb-895a32ecf1b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:08.039231 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0214c1d-3a3f-417c-bafb-895a32ecf1b6 None admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:08.039983 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0214c1d-3a3f-417c-bafb-895a32ecf1b6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:08.040326 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0214c1d-3a3f-417c-bafb-895a32ecf1b6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:08.041771 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0214c1d-3a3f-417c-bafb-895a32ecf1b6 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:08.052851 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961091ae-1153-460f-93bc-2fa9d4b8b177 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:08.059555 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 290/580] 10.222.0.70 () {56 vars in 1148 bytes} [Tue Aug 2 21:28:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:08.059555 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0214c1d-3a3f-417c-bafb-895a32ecf1b6 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:08.089990 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b04e9f6-85f0-4452-a82f-78ddad1c5056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:08.090639 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b04e9f6-85f0-4452-a82f-78ddad1c5056 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:08.090917 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b04e9f6-85f0-4452-a82f-78ddad1c5056 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:08.091194 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b04e9f6-85f0-4452-a82f-78ddad1c5056 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:08.101741 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b04e9f6-85f0-4452-a82f-78ddad1c5056 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:28:08.107527 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-8b04e9f6-85f0-4452-a82f-78ddad1c5056 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 21:28:08.107527 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:08.107527 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:08.107527 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:08.107527 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:08.107527 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:08.107527 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:08.107527 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:08.107527 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:08.107527 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:08.107527 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:08.107527 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:08.107527 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:28:08.107527 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:28:08.107527 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:28:08.107527 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:28:08.108467 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:28:08.108467 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:28:08.108467 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:28:08.108467 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:28:08.108467 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:08.108467 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:08.108467 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:08.108467 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:08.108467 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:08.108467 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:08.108467 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:08.108467 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:08.108467 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:08.108467 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:08.108467 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:08.108467 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:08.109402 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:08.109402 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:08.109402 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:08.109402 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:08.109402 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:28:08.109402 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:28:08.109402 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:28:08.109402 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:28:08.109402 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:28:08.109402 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:28:08.109402 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 21:28:08.109402 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:08.109402 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 291/581] 10.222.0.70 () {56 vars in 1102 bytes} [Tue Aug 2 21:28:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:08.110169 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b04e9f6-85f0-4452-a82f-78ddad1c5056 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:08.163098 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:08.172054 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0214c1d-3a3f-417c-bafb-895a32ecf1b6 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:08.202623 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:08.208908 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d33034-c489-48ab-8cda-5c12aab8b497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:08.209566 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d33034-c489-48ab-8cda-5c12aab8b497 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:08.209851 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d33034-c489-48ab-8cda-5c12aab8b497 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:08.210131 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d33034-c489-48ab-8cda-5c12aab8b497 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:08.221310 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d33034-c489-48ab-8cda-5c12aab8b497 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:28:08.226595 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-b1d33034-c489-48ab-8cda-5c12aab8b497 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 21:28:08.226595 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:08.226595 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:08.226595 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:08.226595 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:08.226595 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:08.226595 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:08.226595 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:08.226595 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:08.226595 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:08.226595 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:08.226595 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:08.226595 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:28:08.226595 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:28:08.226595 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:28:08.226595 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:28:08.227539 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:28:08.227539 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:28:08.227539 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:28:08.227539 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:28:08.227539 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:08.227539 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:08.227539 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:08.227539 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:08.227539 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:08.227539 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:08.227539 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:08.227539 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:08.227539 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:08.227539 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:08.227539 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:08.227539 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:08.228421 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:08.228421 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:08.228421 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:08.228421 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:08.228421 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:28:08.228421 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:28:08.228421 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:28:08.228421 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:28:08.228421 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:28:08.228421 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:28:08.228421 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 21:28:08.228421 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:28:08.228421 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 291/582] 10.222.0.70 () {56 vars in 1102 bytes} [Tue Aug 2 21:28:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:08.229121 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d33034-c489-48ab-8cda-5c12aab8b497 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:08.236400 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b04e9f6-85f0-4452-a82f-78ddad1c5056 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:08.272752 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc23eab-995f-44a0-b296-4ef48f336083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:08.273374 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc23eab-995f-44a0-b296-4ef48f336083 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:08.273649 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc23eab-995f-44a0-b296-4ef48f336083 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:08.273921 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc23eab-995f-44a0-b296-4ef48f336083 None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:08.274853 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc23eab-995f-44a0-b296-4ef48f336083 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:08.274970 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc23eab-995f-44a0-b296-4ef48f336083 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:08.276899 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc23eab-995f-44a0-b296-4ef48f336083 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:08.292587 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 292/583] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 2 21:28:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:08.293349 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc23eab-995f-44a0-b296-4ef48f336083 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:08.343769 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d33034-c489-48ab-8cda-5c12aab8b497 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:08.381280 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220cc461-f4d0-4b45-a7a3-f08cf28eb3da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:08.382063 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220cc461-f4d0-4b45-a7a3-f08cf28eb3da None admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:08.382353 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220cc461-f4d0-4b45-a7a3-f08cf28eb3da None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:08.382794 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220cc461-f4d0-4b45-a7a3-f08cf28eb3da None admin] PATH_INFO: `/v3/projects/42672e04d6ce4b0ab5f7eccfb0cc946c/users/87dd5c1c5e854d4b96e0b7dad6aa3719/roles/59a4c9a6a22d4bdb966856a28c4aabaf` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:08.398272 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc23eab-995f-44a0-b296-4ef48f336083 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:08.401818 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:08.403649 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220cc461-f4d0-4b45-a7a3-f08cf28eb3da None admin] RBAC: Authorizing `identity:create_grant(project_id=42672e04d6ce4b0ab5f7eccfb0cc946c, user_id=87dd5c1c5e854d4b96e0b7dad6aa3719, role_id=59a4c9a6a22d4bdb966856a28c4aabaf)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:08.405306 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220cc461-f4d0-4b45-a7a3-f08cf28eb3da None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:08.432263 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 292/584] 10.222.0.70 () {58 vars in 1439 bytes} [Tue Aug 2 21:28:08 2022] PUT /identity/v3/projects/42672e04d6ce4b0ab5f7eccfb0cc946c/users/87dd5c1c5e854d4b96e0b7dad6aa3719/roles/59a4c9a6a22d4bdb966856a28c4aabaf => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:28:08.432263 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220cc461-f4d0-4b45-a7a3-f08cf28eb3da None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:08.449828 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b930b5d-9f44-4229-98f6-37a76fe42a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:08.450558 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b930b5d-9f44-4229-98f6-37a76fe42a92 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:08.450945 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b930b5d-9f44-4229-98f6-37a76fe42a92 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:08.451331 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b930b5d-9f44-4229-98f6-37a76fe42a92 None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:08.452278 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b930b5d-9f44-4229-98f6-37a76fe42a92 None admin] RBAC: Adding query filter params (name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:08.452801 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b930b5d-9f44-4229-98f6-37a76fe42a92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:08.454489 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b930b5d-9f44-4229-98f6-37a76fe42a92 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:08.470550 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 293/585] 10.222.0.70 () {56 vars in 1103 bytes} [Tue Aug 2 21:28:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:08.471674 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b930b5d-9f44-4229-98f6-37a76fe42a92 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:08.484160 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:08.556899 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220cc461-f4d0-4b45-a7a3-f08cf28eb3da None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:08.596068 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b7be06-38c9-45ab-81e0-6934fd90edad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:08.596736 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b7be06-38c9-45ab-81e0-6934fd90edad None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:08.597020 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b7be06-38c9-45ab-81e0-6934fd90edad None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:08.597294 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b7be06-38c9-45ab-81e0-6934fd90edad None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:08.598023 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b7be06-38c9-45ab-81e0-6934fd90edad None admin] RBAC: Adding query filter params (name=service) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:08.598331 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b7be06-38c9-45ab-81e0-6934fd90edad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:08.599803 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b7be06-38c9-45ab-81e0-6934fd90edad None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:08.607470 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b930b5d-9f44-4229-98f6-37a76fe42a92 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:08.614903 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 293/586] 10.222.0.70 () {56 vars in 1103 bytes} [Tue Aug 2 21:28:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:08.615554 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b7be06-38c9-45ab-81e0-6934fd90edad None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:08.665911 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5484e2df-0069-4a1f-ab3f-676c20689349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:08.672122 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5484e2df-0069-4a1f-ab3f-676c20689349 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:08.672122 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5484e2df-0069-4a1f-ab3f-676c20689349 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:08.672122 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5484e2df-0069-4a1f-ab3f-676c20689349 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:08.679626 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5484e2df-0069-4a1f-ab3f-676c20689349 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:08.681849 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5484e2df-0069-4a1f-ab3f-676c20689349 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:08.697650 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-5484e2df-0069-4a1f-ab3f-676c20689349 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:28:08.697650 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:08.697650 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:08.697650 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:08.697650 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:08.697650 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:08.697650 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:08.697650 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:08.697650 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:08.697650 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:08.697650 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:08.697650 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:08.697650 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 21:28:08.697650 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 21:28:08.697650 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 21:28:08.700444 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 21:28:08.700444 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:08.700444 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:08.700444 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:08.700444 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:08.700444 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:08.700444 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:08.700444 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:08.700444 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:08.700444 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:08.700444 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:08.700444 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:08.700444 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:08.700444 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:08.700444 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:08.700444 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:08.700444 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:08.702607 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 21:28:08.702607 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 21:28:08.702607 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 21:28:08.702607 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 21:28:08.702607 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 21:28:08.702607 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 21:28:08.702607 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:28:08.702607 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:08.702607 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 294/587] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Aug 2 21:28:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:08.702607 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5484e2df-0069-4a1f-ab3f-676c20689349 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:08.739765 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:08.745973 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b7be06-38c9-45ab-81e0-6934fd90edad None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:08.747767 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:08.784499 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc72868-3c2c-4c17-af37-3c2b3330f93a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:08.785318 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc72868-3c2c-4c17-af37-3c2b3330f93a None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:08.785938 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc72868-3c2c-4c17-af37-3c2b3330f93a None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:08.786226 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc72868-3c2c-4c17-af37-3c2b3330f93a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:08.799579 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc72868-3c2c-4c17-af37-3c2b3330f93a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:08.801085 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc72868-3c2c-4c17-af37-3c2b3330f93a None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:08.819723 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-cdc72868-3c2c-4c17-af37-3c2b3330f93a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:08.819723 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:08.819723 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:08.819723 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:08.819723 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:08.819723 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:08.819723 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:08.819723 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:08.819723 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:08.819723 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:08.819723 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:08.819723 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:08.819723 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:28:08.819723 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:28:08.819723 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:28:08.821114 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:28:08.821114 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:08.821114 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:08.821114 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:08.821114 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:08.821114 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:08.821114 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:08.821114 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:08.821114 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:08.821114 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:08.821114 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:08.821114 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:08.821114 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:08.821114 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:08.821114 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:08.821114 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:08.821114 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:08.822081 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:28:08.822081 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:28:08.822081 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:08.822081 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:28:08.822081 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 294/588] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 2 21:28:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:08.822081 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc72868-3c2c-4c17-af37-3c2b3330f93a None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:08.837729 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5484e2df-0069-4a1f-ab3f-676c20689349 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:08.874698 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591ca45f-f369-492b-9b78-19058bde8ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:08.875617 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591ca45f-f369-492b-9b78-19058bde8ae2 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:08.876050 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591ca45f-f369-492b-9b78-19058bde8ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:08.876452 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591ca45f-f369-492b-9b78-19058bde8ae2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:08.888107 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591ca45f-f369-492b-9b78-19058bde8ae2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:08.889746 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591ca45f-f369-492b-9b78-19058bde8ae2 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:08.906072 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-591ca45f-f369-492b-9b78-19058bde8ae2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:08.906072 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:08.906072 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:08.906072 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:08.906072 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:08.906072 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:08.906072 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:08.906072 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:08.906072 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:08.906072 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:08.906072 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:08.906072 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:08.906072 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:28:08.906072 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:28:08.906072 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:28:08.908003 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:28:08.908003 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:08.908003 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:08.908003 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:08.908003 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:08.908003 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:08.908003 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:08.908003 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:08.908003 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:08.908003 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:08.908003 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:08.908003 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:08.908003 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:08.908003 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:08.908003 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:08.908003 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:08.908003 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:08.910206 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:28:08.910206 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:28:08.910206 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:08.910206 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:08.912270 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 295/589] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 2 21:28:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:08.914365 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591ca45f-f369-492b-9b78-19058bde8ae2 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:08.941267 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc72868-3c2c-4c17-af37-3c2b3330f93a None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:08.981780 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb8b583-78df-4f57-9cf0-265b92ff1beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:08.982411 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb8b583-78df-4f57-9cf0-265b92ff1beb None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:08.982700 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb8b583-78df-4f57-9cf0-265b92ff1beb None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:08.982981 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb8b583-78df-4f57-9cf0-265b92ff1beb None admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:08.984006 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb8b583-78df-4f57-9cf0-265b92ff1beb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:08.984900 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb8b583-78df-4f57-9cf0-265b92ff1beb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:08.986677 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb8b583-78df-4f57-9cf0-265b92ff1beb None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:08.997876 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:09.002415 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 295/590] 10.222.0.70 () {56 vars in 1148 bytes} [Tue Aug 2 21:28:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:09.003026 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb8b583-78df-4f57-9cf0-265b92ff1beb None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:09.028906 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591ca45f-f369-492b-9b78-19058bde8ae2 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:09.048854 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:09.067619 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85005fd-2fa1-4a63-909e-e91cd615c795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:09.068396 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85005fd-2fa1-4a63-909e-e91cd615c795 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:09.068678 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85005fd-2fa1-4a63-909e-e91cd615c795 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:09.068958 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85005fd-2fa1-4a63-909e-e91cd615c795 None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:09.069651 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85005fd-2fa1-4a63-909e-e91cd615c795 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:09.070011 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85005fd-2fa1-4a63-909e-e91cd615c795 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:09.071388 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85005fd-2fa1-4a63-909e-e91cd615c795 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:09.089554 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 296/591] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 2 21:28:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:09.090489 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85005fd-2fa1-4a63-909e-e91cd615c795 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:09.122618 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb8b583-78df-4f57-9cf0-265b92ff1beb None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:09.157523 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd29a98-e934-4717-b092-c84de00135aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:09.158237 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd29a98-e934-4717-b092-c84de00135aa None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:09.158528 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd29a98-e934-4717-b092-c84de00135aa None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:09.158810 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd29a98-e934-4717-b092-c84de00135aa None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:09.159504 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd29a98-e934-4717-b092-c84de00135aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:09.159814 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd29a98-e934-4717-b092-c84de00135aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:09.161213 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd29a98-e934-4717-b092-c84de00135aa None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:09.173044 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 296/592] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 2 21:28:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:09.173898 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd29a98-e934-4717-b092-c84de00135aa None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:09.203436 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85005fd-2fa1-4a63-909e-e91cd615c795 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:09.240489 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d268803-b8c5-4282-b784-eb55154dfc9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:09.241194 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d268803-b8c5-4282-b784-eb55154dfc9d None admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:09.241478 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d268803-b8c5-4282-b784-eb55154dfc9d None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:09.241755 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d268803-b8c5-4282-b784-eb55154dfc9d None admin] PATH_INFO: `/v3/projects/42672e04d6ce4b0ab5f7eccfb0cc946c/users/123eb76f95ee4e39905944da701c712d/roles/59a4c9a6a22d4bdb966856a28c4aabaf` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:09.251306 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:09.252590 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:09.259930 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d268803-b8c5-4282-b784-eb55154dfc9d None admin] RBAC: Authorizing `identity:create_grant(project_id=42672e04d6ce4b0ab5f7eccfb0cc946c, user_id=123eb76f95ee4e39905944da701c712d, role_id=59a4c9a6a22d4bdb966856a28c4aabaf)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:09.263066 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d268803-b8c5-4282-b784-eb55154dfc9d None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:09.279204 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd29a98-e934-4717-b092-c84de00135aa None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:09.286850 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 297/593] 10.222.0.70 () {58 vars in 1439 bytes} [Tue Aug 2 21:28:09 2022] PUT /identity/v3/projects/42672e04d6ce4b0ab5f7eccfb0cc946c/users/123eb76f95ee4e39905944da701c712d/roles/59a4c9a6a22d4bdb966856a28c4aabaf => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:28:09.288124 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d268803-b8c5-4282-b784-eb55154dfc9d None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:09.327217 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad173d8-d803-4b28-b542-32b678701f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:09.327781 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad173d8-d803-4b28-b542-32b678701f64 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:09.328117 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad173d8-d803-4b28-b542-32b678701f64 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:09.328620 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad173d8-d803-4b28-b542-32b678701f64 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:09.337748 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad173d8-d803-4b28-b542-32b678701f64 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:09.339200 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad173d8-d803-4b28-b542-32b678701f64 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:09.351322 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-aad173d8-d803-4b28-b542-32b678701f64 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 02 21:28:09.351322 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:09.351322 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:09.351322 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:09.351322 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:09.351322 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:09.351322 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:09.351322 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:09.351322 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:09.351322 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:09.351322 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:09.351322 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:09.351322 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 21:28:09.351322 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 21:28:09.351322 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 21:28:09.351322 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 21:28:09.352508 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:09.352508 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:09.352508 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 21:28:09.352508 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:28:09.352508 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 21:28:09.352508 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:28:09.352508 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:09.352508 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:09.352508 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:09.352508 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:09.352508 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:09.352508 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:09.352508 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:09.352508 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:09.352508 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:09.352508 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:09.352508 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:09.352508 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:09.353532 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:09.353532 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:09.353532 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 21:28:09.353532 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 21:28:09.353532 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 21:28:09.353532 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 21:28:09.353532 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 21:28:09.353532 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 21:28:09.353532 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 02 21:28:09.353532 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:28:09.353532 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 297/594] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 2 21:28:09 2022] GET /identity/v3/users/glance => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:09.358607 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad173d8-d803-4b28-b542-32b678701f64 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:09.449175 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d268803-b8c5-4282-b784-eb55154dfc9d None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:09.477793 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad173d8-d803-4b28-b542-32b678701f64 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:09.498497 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dafcfa-aea1-43ed-8f37-fe788d7f022e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:09.499410 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dafcfa-aea1-43ed-8f37-fe788d7f022e None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:09.499840 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dafcfa-aea1-43ed-8f37-fe788d7f022e None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:09.500389 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dafcfa-aea1-43ed-8f37-fe788d7f022e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:09.509403 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dafcfa-aea1-43ed-8f37-fe788d7f022e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:09.511253 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dafcfa-aea1-43ed-8f37-fe788d7f022e None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:09.515161 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d64a151-effc-4a4f-ac1a-e78ee3198c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:09.515800 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d64a151-effc-4a4f-ac1a-e78ee3198c3a None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:09.516086 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d64a151-effc-4a4f-ac1a-e78ee3198c3a None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:09.516392 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d64a151-effc-4a4f-ac1a-e78ee3198c3a None admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:09.517199 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d64a151-effc-4a4f-ac1a-e78ee3198c3a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:09.517515 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d64a151-effc-4a4f-ac1a-e78ee3198c3a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:09.518966 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d64a151-effc-4a4f-ac1a-e78ee3198c3a None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:09.520910 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:09.527973 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-f8dafcfa-aea1-43ed-8f37-fe788d7f022e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 02 21:28:09.527973 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:09.527973 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:09.527973 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:09.527973 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:09.527973 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:09.527973 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:09.527973 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:09.527973 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:09.527973 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:09.527973 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:09.527973 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:09.527973 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 21:28:09.527973 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 21:28:09.527973 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 21:28:09.527973 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 21:28:09.529233 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:09.529233 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:09.529233 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 21:28:09.529233 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:28:09.529233 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 21:28:09.529233 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:28:09.529233 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:09.529233 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:09.529233 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:09.529233 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:09.529233 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:09.529233 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:09.529233 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:09.529233 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:09.529233 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:09.529233 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:09.529233 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:09.529233 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:09.530270 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:09.530270 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:09.530270 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 21:28:09.530270 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 21:28:09.530270 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 21:28:09.530270 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 21:28:09.530270 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 21:28:09.530270 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 21:28:09.530270 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 02 21:28:09.530270 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:09.532667 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 298/595] 10.222.0.70 () {56 vars in 1102 bytes} [Tue Aug 2 21:28:09 2022] GET /identity/v3/users/neutron => generated 85 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:09.538788 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dafcfa-aea1-43ed-8f37-fe788d7f022e None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:09.539126 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 298/596] 10.222.0.70 () {56 vars in 1137 bytes} [Tue Aug 2 21:28:09 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:28:09.545068 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d64a151-effc-4a4f-ac1a-e78ee3198c3a None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:09.602383 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:09.653487 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d64a151-effc-4a4f-ac1a-e78ee3198c3a None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:09.665723 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dafcfa-aea1-43ed-8f37-fe788d7f022e None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:09.693033 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49174654-b0fd-4be3-a0b8-2e52d77813bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:09.693537 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49174654-b0fd-4be3-a0b8-2e52d77813bf None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:09.693822 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49174654-b0fd-4be3-a0b8-2e52d77813bf None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:09.694097 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49174654-b0fd-4be3-a0b8-2e52d77813bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:09.705331 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49174654-b0fd-4be3-a0b8-2e52d77813bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:09.707206 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49174654-b0fd-4be3-a0b8-2e52d77813bf None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:09.707891 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6bb751-899d-4dbe-88fe-d6118a9b6c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:09.708813 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6bb751-899d-4dbe-88fe-d6118a9b6c2d None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:09.709324 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6bb751-899d-4dbe-88fe-d6118a9b6c2d None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:09.709853 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6bb751-899d-4dbe-88fe-d6118a9b6c2d None admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:09.710796 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6bb751-899d-4dbe-88fe-d6118a9b6c2d None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:09.711265 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6bb751-899d-4dbe-88fe-d6118a9b6c2d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:09.712897 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6bb751-899d-4dbe-88fe-d6118a9b6c2d None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:09.723661 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-49174654-b0fd-4be3-a0b8-2e52d77813bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:09.723661 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:09.723661 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:09.723661 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:09.723661 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:09.723661 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:09.723661 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:09.723661 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:09.723661 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:09.723661 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:09.723661 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:09.723661 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:09.723661 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:28:09.723661 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:28:09.723661 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:28:09.724752 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:28:09.724752 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:09.724752 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:09.724752 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:09.724752 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:09.724752 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:09.724752 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:09.724752 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:09.724752 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:09.724752 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:09.724752 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:09.724752 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:09.724752 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:09.724752 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:09.724752 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:09.724752 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:09.724752 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:09.725784 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:28:09.725784 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:28:09.725784 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:09.725784 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:28:09.725784 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 299/597] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 2 21:28:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 21:28:09.730546 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49174654-b0fd-4be3-a0b8-2e52d77813bf None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:09.740317 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 299/598] 10.222.0.70 () {56 vars in 1139 bytes} [Tue Aug 2 21:28:09 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:09.742136 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6bb751-899d-4dbe-88fe-d6118a9b6c2d None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:09.782819 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:09.840456 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49174654-b0fd-4be3-a0b8-2e52d77813bf None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:09.853357 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6bb751-899d-4dbe-88fe-d6118a9b6c2d None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:09.875153 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d01d36-a222-459a-a753-aabd90987337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:09.875777 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d01d36-a222-459a-a753-aabd90987337 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:09.876119 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d01d36-a222-459a-a753-aabd90987337 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:09.876435 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d01d36-a222-459a-a753-aabd90987337 None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:09.876650 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:09.877259 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d01d36-a222-459a-a753-aabd90987337 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:09.877436 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d01d36-a222-459a-a753-aabd90987337 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:09.878801 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d01d36-a222-459a-a753-aabd90987337 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:09.892128 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6813a46-3e0a-4ff9-9cf3-e29ec0aec779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:09.893348 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6813a46-3e0a-4ff9-9cf3-e29ec0aec779 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:09.893778 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6813a46-3e0a-4ff9-9cf3-e29ec0aec779 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:09.894198 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6813a46-3e0a-4ff9-9cf3-e29ec0aec779 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:09.896520 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 300/599] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 2 21:28:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:28:09.897942 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20df793-1b84-48a0-b582-ce5054a2d2a3 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:09.898296 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20df793-1b84-48a0-b582-ce5054a2d2a3 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:09.898607 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20df793-1b84-48a0-b582-ce5054a2d2a3 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:09.900170 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 301/600] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:28:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:28:09.900906 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20df793-1b84-48a0-b582-ce5054a2d2a3 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:09.910363 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6813a46-3e0a-4ff9-9cf3-e29ec0aec779 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:09.912117 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6813a46-3e0a-4ff9-9cf3-e29ec0aec779 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:09.928884 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-c6813a46-3e0a-4ff9-9cf3-e29ec0aec779 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:09.928884 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:09.928884 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:09.928884 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:09.928884 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:09.928884 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:09.928884 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:09.928884 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:09.928884 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:09.928884 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:09.928884 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:09.928884 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:09.928884 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:28:09.928884 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:28:09.928884 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:28:09.929953 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:28:09.929953 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:09.929953 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:09.929953 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:09.929953 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:09.929953 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:09.929953 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:09.929953 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:09.929953 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:09.929953 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:09.929953 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:09.929953 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:09.929953 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:09.929953 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:09.929953 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:09.929953 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:09.929953 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:09.930949 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:28:09.930949 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:28:09.930949 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:09.930949 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:09.937771 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 300/601] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 2 21:28:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 21:28:09.939550 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4748692d-d2fe-4356-a610-8e9cc9ea86e9 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:09.940011 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4748692d-d2fe-4356-a610-8e9cc9ea86e9 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:09.940457 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4748692d-d2fe-4356-a610-8e9cc9ea86e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:09.960060 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-4748692d-d2fe-4356-a610-8e9cc9ea86e9 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:28:09.961616 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-4748692d-d2fe-4356-a610-8e9cc9ea86e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:28:10.008645 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20df793-1b84-48a0-b582-ce5054a2d2a3 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:10.011768 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:10.038730 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 301/602] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:28:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:28:10.040013 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4748692d-d2fe-4356-a610-8e9cc9ea86e9 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:10.045223 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d246ff6c-35f7-4d43-b6ae-74ab7f43db0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:10.045971 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d246ff6c-35f7-4d43-b6ae-74ab7f43db0a None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:10.046257 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d246ff6c-35f7-4d43-b6ae-74ab7f43db0a None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:10.046535 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d246ff6c-35f7-4d43-b6ae-74ab7f43db0a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:10.057918 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d246ff6c-35f7-4d43-b6ae-74ab7f43db0a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:10.057918 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d246ff6c-35f7-4d43-b6ae-74ab7f43db0a None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:10.068576 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-d246ff6c-35f7-4d43-b6ae-74ab7f43db0a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:28:10.068576 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:10.068576 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:10.068576 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:10.068576 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:10.068576 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:10.068576 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:10.068576 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:10.068576 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:10.068576 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:10.068576 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:10.068576 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:10.068576 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 21:28:10.068576 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 21:28:10.068576 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 21:28:10.069512 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 21:28:10.069512 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:10.069512 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:10.069512 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:10.069512 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:10.069512 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:10.069512 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:10.069512 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:10.069512 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:10.069512 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:10.069512 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:10.069512 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:10.069512 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:10.069512 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:10.069512 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:10.069512 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:10.069512 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:10.070408 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 21:28:10.070408 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 21:28:10.070408 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 21:28:10.070408 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 21:28:10.070408 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 21:28:10.070408 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 21:28:10.070408 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:28:10.070408 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:28:10.070408 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 302/603] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Aug 2 21:28:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:10.070912 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d246ff6c-35f7-4d43-b6ae-74ab7f43db0a None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:10.146576 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:10.160282 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4748692d-d2fe-4356-a610-8e9cc9ea86e9 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:10.187828 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d246ff6c-35f7-4d43-b6ae-74ab7f43db0a None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:10.199122 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97814d98-a37e-4442-930c-28832de0dc42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:10.200249 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97814d98-a37e-4442-930c-28832de0dc42 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:10.200740 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97814d98-a37e-4442-930c-28832de0dc42 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:10.201236 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97814d98-a37e-4442-930c-28832de0dc42 None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:10.202397 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97814d98-a37e-4442-930c-28832de0dc42 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:10.203002 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97814d98-a37e-4442-930c-28832de0dc42 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:10.204636 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97814d98-a37e-4442-930c-28832de0dc42 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:10.221945 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 302/604] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 2 21:28:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:10.223285 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97814d98-a37e-4442-930c-28832de0dc42 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:10.224696 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc96769e-caa6-4c73-90e8-ede243dfbc03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:10.225475 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc96769e-caa6-4c73-90e8-ede243dfbc03 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:10.225827 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc96769e-caa6-4c73-90e8-ede243dfbc03 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:10.226243 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc96769e-caa6-4c73-90e8-ede243dfbc03 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:10.238821 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc96769e-caa6-4c73-90e8-ede243dfbc03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:28:10.244249 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-bc96769e-caa6-4c73-90e8-ede243dfbc03 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 21:28:10.244249 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:10.244249 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:10.244249 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:10.244249 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:10.244249 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:10.244249 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:10.244249 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:10.244249 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:10.244249 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:10.244249 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:10.244249 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:10.244249 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:28:10.244249 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:28:10.244249 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:28:10.244249 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:28:10.245774 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:28:10.245774 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:28:10.245774 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:28:10.245774 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:28:10.245774 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:10.245774 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:10.245774 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:10.245774 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:10.245774 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:10.245774 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:10.245774 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:10.245774 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:10.245774 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:10.245774 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:10.245774 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:10.245774 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:10.246620 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:10.246620 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:10.246620 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:10.246620 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:10.246620 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:28:10.246620 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:28:10.246620 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:28:10.246620 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:28:10.246620 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:28:10.246620 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:28:10.246620 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 21:28:10.246620 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:28:10.250957 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 303/605] 10.222.0.70 () {56 vars in 1102 bytes} [Tue Aug 2 21:28:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:10.251817 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc96769e-caa6-4c73-90e8-ede243dfbc03 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:10.280488 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:10.344101 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97814d98-a37e-4442-930c-28832de0dc42 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:10.364070 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc96769e-caa6-4c73-90e8-ede243dfbc03 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:10.383054 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fd77da-a5e8-4c69-a022-06c462cfc602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:10.384067 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fd77da-a5e8-4c69-a022-06c462cfc602 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:10.384572 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fd77da-a5e8-4c69-a022-06c462cfc602 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:10.385028 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fd77da-a5e8-4c69-a022-06c462cfc602 None admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:10.385983 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fd77da-a5e8-4c69-a022-06c462cfc602 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:10.386550 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fd77da-a5e8-4c69-a022-06c462cfc602 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:10.388155 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fd77da-a5e8-4c69-a022-06c462cfc602 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:10.401223 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdf6f1a-3829-430c-a2a6-06b65a7bcf1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:10.401848 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdf6f1a-3829-430c-a2a6-06b65a7bcf1a None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:10.402177 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdf6f1a-3829-430c-a2a6-06b65a7bcf1a None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:10.402481 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdf6f1a-3829-430c-a2a6-06b65a7bcf1a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:10.403589 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 303/606] 10.222.0.70 () {56 vars in 1148 bytes} [Tue Aug 2 21:28:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:10.404787 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fd77da-a5e8-4c69-a022-06c462cfc602 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:10.410421 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdf6f1a-3829-430c-a2a6-06b65a7bcf1a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:10.411942 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdf6f1a-3829-430c-a2a6-06b65a7bcf1a None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:10.416688 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:10.426177 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-dcdf6f1a-3829-430c-a2a6-06b65a7bcf1a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:28:10.426177 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:10.426177 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:10.426177 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:10.426177 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:10.426177 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:10.426177 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:10.426177 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:10.426177 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:10.426177 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:10.426177 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:10.426177 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:10.426177 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 21:28:10.426177 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 21:28:10.426177 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 21:28:10.427200 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 21:28:10.427200 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:10.427200 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:10.427200 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:10.427200 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:10.427200 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:10.427200 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:10.427200 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:10.427200 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:10.427200 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:10.427200 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:10.427200 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:10.427200 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:10.427200 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:10.427200 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:10.427200 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:10.427200 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:10.428104 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 21:28:10.428104 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 21:28:10.428104 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 21:28:10.428104 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 21:28:10.428104 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 21:28:10.428104 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 21:28:10.428104 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:28:10.428104 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:28:10.430227 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 304/607] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Aug 2 21:28:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:10.431581 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdf6f1a-3829-430c-a2a6-06b65a7bcf1a None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:10.524072 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fd77da-a5e8-4c69-a022-06c462cfc602 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:10.549212 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:10.562808 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97df86e6-5feb-4143-ad89-5cc499afaf61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:10.563772 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df86e6-5feb-4143-ad89-5cc499afaf61 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:10.564160 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df86e6-5feb-4143-ad89-5cc499afaf61 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:10.564567 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df86e6-5feb-4143-ad89-5cc499afaf61 None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:10.565877 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97df86e6-5feb-4143-ad89-5cc499afaf61 None admin] RBAC: Adding query filter params (name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:10.566358 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97df86e6-5feb-4143-ad89-5cc499afaf61 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:10.568013 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97df86e6-5feb-4143-ad89-5cc499afaf61 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:10.572037 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdf6f1a-3829-430c-a2a6-06b65a7bcf1a None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:10.584292 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 304/608] 10.222.0.70 () {56 vars in 1103 bytes} [Tue Aug 2 21:28:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:10.584292 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97df86e6-5feb-4143-ad89-5cc499afaf61 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:10.615916 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6346da2-a917-4610-ae25-f917937dc863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:10.616617 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6346da2-a917-4610-ae25-f917937dc863 None admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:10.616920 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6346da2-a917-4610-ae25-f917937dc863 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:10.617216 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6346da2-a917-4610-ae25-f917937dc863 None admin] PATH_INFO: `/v3/projects/42672e04d6ce4b0ab5f7eccfb0cc946c/users/accb7ab8b4f447389ed394a48fc27619/roles/59a4c9a6a22d4bdb966856a28c4aabaf` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:10.632516 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6346da2-a917-4610-ae25-f917937dc863 None admin] RBAC: Authorizing `identity:create_grant(project_id=42672e04d6ce4b0ab5f7eccfb0cc946c, user_id=accb7ab8b4f447389ed394a48fc27619, role_id=59a4c9a6a22d4bdb966856a28c4aabaf)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:10.634734 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6346da2-a917-4610-ae25-f917937dc863 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:10.652113 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 305/609] 10.222.0.70 () {58 vars in 1439 bytes} [Tue Aug 2 21:28:10 2022] PUT /identity/v3/projects/42672e04d6ce4b0ab5f7eccfb0cc946c/users/accb7ab8b4f447389ed394a48fc27619/roles/59a4c9a6a22d4bdb966856a28c4aabaf => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:28:10.652929 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6346da2-a917-4610-ae25-f917937dc863 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:10.665894 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:10.712593 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97df86e6-5feb-4143-ad89-5cc499afaf61 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:10.771692 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5ff543-fd9e-45dd-afc6-54631026334e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:10.773050 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ff543-fd9e-45dd-afc6-54631026334e None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:10.774013 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ff543-fd9e-45dd-afc6-54631026334e None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:10.774832 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ff543-fd9e-45dd-afc6-54631026334e None admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:10.776667 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5ff543-fd9e-45dd-afc6-54631026334e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:10.777192 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5ff543-fd9e-45dd-afc6-54631026334e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:10.779636 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5ff543-fd9e-45dd-afc6-54631026334e None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:10.783973 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6346da2-a917-4610-ae25-f917937dc863 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:10.798658 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 305/610] 10.222.0.70 () {56 vars in 1148 bytes} [Tue Aug 2 21:28:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:10.800264 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bae484-d1c0-4640-802d-f5ac3a1fa827 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:10.800715 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bae484-d1c0-4640-802d-f5ac3a1fa827 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:10.801177 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bae484-d1c0-4640-802d-f5ac3a1fa827 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:10.807193 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 306/611] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:28:10 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:28:10.809066 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bae484-d1c0-4640-802d-f5ac3a1fa827 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:10.837676 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0203afd0-a3e6-4e9c-9822-22f88ae60220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:10.839374 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0203afd0-a3e6-4e9c-9822-22f88ae60220 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:10.839855 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0203afd0-a3e6-4e9c-9822-22f88ae60220 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:10.840327 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0203afd0-a3e6-4e9c-9822-22f88ae60220 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:10.843911 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:10.855383 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0203afd0-a3e6-4e9c-9822-22f88ae60220 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:10.856897 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0203afd0-a3e6-4e9c-9822-22f88ae60220 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:10.876846 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-0203afd0-a3e6-4e9c-9822-22f88ae60220 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:10.876846 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:10.876846 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:10.876846 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:10.876846 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:10.876846 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:10.876846 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:10.876846 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:10.876846 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:10.876846 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:10.876846 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:10.876846 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:10.876846 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:28:10.876846 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:28:10.876846 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:28:10.877833 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:28:10.877833 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:10.877833 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:10.877833 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:10.877833 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:10.877833 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:10.877833 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:10.877833 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:10.877833 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:10.877833 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:10.877833 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:10.877833 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:10.877833 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:10.877833 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:10.877833 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:10.877833 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:10.877833 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:10.878710 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:28:10.878710 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:28:10.878710 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:10.878710 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:28:10.881008 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 306/612] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 2 21:28:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:10.882338 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0518041b-22ce-42c4-9f10-e2a49bd56b4b None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:10.882751 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0518041b-22ce-42c4-9f10-e2a49bd56b4b None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:10.883156 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0518041b-22ce-42c4-9f10-e2a49bd56b4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:10.908514 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-0518041b-22ce-42c4-9f10-e2a49bd56b4b None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:28:10.910209 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-0518041b-22ce-42c4-9f10-e2a49bd56b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:28:10.960584 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bae484-d1c0-4640-802d-f5ac3a1fa827 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:11.002376 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 307/613] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:28:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:28:11.008346 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0518041b-22ce-42c4-9f10-e2a49bd56b4b None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:11.014949 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:11.024965 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dc196e-a7a3-44b4-ad05-2c78f4af4e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:11.025653 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc196e-a7a3-44b4-ad05-2c78f4af4e8f None admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:11.025938 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc196e-a7a3-44b4-ad05-2c78f4af4e8f None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:11.026793 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dc196e-a7a3-44b4-ad05-2c78f4af4e8f None admin] PATH_INFO: `/v3/projects/42672e04d6ce4b0ab5f7eccfb0cc946c/users/723f5f43572a493dae0349070a2adb5e/roles/59a4c9a6a22d4bdb966856a28c4aabaf` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:11.044793 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dc196e-a7a3-44b4-ad05-2c78f4af4e8f None admin] RBAC: Authorizing `identity:create_grant(project_id=42672e04d6ce4b0ab5f7eccfb0cc946c, user_id=723f5f43572a493dae0349070a2adb5e, role_id=59a4c9a6a22d4bdb966856a28c4aabaf)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:11.046521 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dc196e-a7a3-44b4-ad05-2c78f4af4e8f None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:11.066153 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 307/614] 10.222.0.70 () {58 vars in 1439 bytes} [Tue Aug 2 21:28:10 2022] PUT /identity/v3/projects/42672e04d6ce4b0ab5f7eccfb0cc946c/users/723f5f43572a493dae0349070a2adb5e/roles/59a4c9a6a22d4bdb966856a28c4aabaf => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:28:11.072660 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dc196e-a7a3-44b4-ad05-2c78f4af4e8f None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:11.209629 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0518041b-22ce-42c4-9f10-e2a49bd56b4b None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:11.240316 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:11.251477 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dc196e-a7a3-44b4-ad05-2c78f4af4e8f None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:11.274361 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c014609e-0667-4357-9db8-ee72ddfe8a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:11.275072 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c014609e-0667-4357-9db8-ee72ddfe8a12 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:11.275357 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c014609e-0667-4357-9db8-ee72ddfe8a12 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:11.275635 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c014609e-0667-4357-9db8-ee72ddfe8a12 None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:11.276945 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c014609e-0667-4357-9db8-ee72ddfe8a12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:11.277255 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c014609e-0667-4357-9db8-ee72ddfe8a12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:11.278632 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c014609e-0667-4357-9db8-ee72ddfe8a12 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:11.304265 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 308/615] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 2 21:28:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:11.304265 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c014609e-0667-4357-9db8-ee72ddfe8a12 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:11.324527 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bc9489-166e-425c-b940-1941a217032b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:11.325387 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bc9489-166e-425c-b940-1941a217032b None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:11.325680 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bc9489-166e-425c-b940-1941a217032b None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:11.325965 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bc9489-166e-425c-b940-1941a217032b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:11.373192 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bc9489-166e-425c-b940-1941a217032b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:28:11.378221 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-31bc9489-166e-425c-b940-1941a217032b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 21:28:11.378221 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:11.378221 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:11.378221 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:11.378221 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:11.378221 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:11.378221 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:11.378221 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:11.378221 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:11.378221 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:11.378221 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:11.378221 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:11.378221 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:28:11.378221 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:28:11.378221 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:28:11.378221 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:28:11.379169 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:28:11.379169 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:28:11.379169 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:28:11.379169 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:28:11.379169 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:11.379169 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:11.379169 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:11.379169 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:11.379169 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:11.379169 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:11.379169 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:11.379169 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:11.379169 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:11.379169 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:11.379169 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:11.379169 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:11.379999 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:11.379999 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:11.379999 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:11.379999 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:11.379999 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:28:11.379999 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:28:11.379999 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:28:11.379999 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:28:11.379999 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:28:11.379999 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:28:11.379999 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 21:28:11.379999 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:11.388746 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 308/616] 10.222.0.70 () {56 vars in 1102 bytes} [Tue Aug 2 21:28:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:11.394303 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bc9489-166e-425c-b940-1941a217032b None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:11.417728 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c014609e-0667-4357-9db8-ee72ddfe8a12 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:11.455507 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc780b0-a71d-4b16-a013-fe78b2640ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:11.456260 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc780b0-a71d-4b16-a013-fe78b2640ea0 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:11.456542 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc780b0-a71d-4b16-a013-fe78b2640ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:11.456907 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc780b0-a71d-4b16-a013-fe78b2640ea0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:11.471662 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc780b0-a71d-4b16-a013-fe78b2640ea0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:11.473143 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc780b0-a71d-4b16-a013-fe78b2640ea0 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:11.485757 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-1bc780b0-a71d-4b16-a013-fe78b2640ea0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 02 21:28:11.485757 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:11.485757 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:11.485757 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:11.485757 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:11.485757 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:11.485757 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:11.485757 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:11.485757 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:11.485757 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:11.485757 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:11.485757 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:11.485757 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 21:28:11.485757 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 21:28:11.485757 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 21:28:11.485757 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 21:28:11.488194 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:11.488194 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:11.488194 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 21:28:11.488194 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:28:11.488194 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 21:28:11.488194 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:28:11.488194 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:11.488194 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:11.488194 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:11.488194 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:11.488194 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:11.488194 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:11.488194 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:11.488194 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:11.488194 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:11.488194 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:11.488194 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:11.488194 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:11.490932 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:11.490932 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:11.490932 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 21:28:11.490932 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 21:28:11.490932 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 21:28:11.490932 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 21:28:11.490932 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 21:28:11.490932 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 21:28:11.490932 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 02 21:28:11.490932 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:28:11.490932 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 309/617] 10.222.0.70 () {56 vars in 1096 bytes} [Tue Aug 2 21:28:11 2022] GET /identity/v3/users/swift => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 21:28:11.500258 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc780b0-a71d-4b16-a013-fe78b2640ea0 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:11.505272 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:11.534692 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:11.609042 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc780b0-a71d-4b16-a013-fe78b2640ea0 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:11.643321 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bc9489-166e-425c-b940-1941a217032b None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:11.647063 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f12d59-6be2-49b5-8abd-8991594e8c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:11.647696 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f12d59-6be2-49b5-8abd-8991594e8c9c None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:11.647983 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f12d59-6be2-49b5-8abd-8991594e8c9c None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:11.648280 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f12d59-6be2-49b5-8abd-8991594e8c9c None admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:11.649206 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f12d59-6be2-49b5-8abd-8991594e8c9c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:11.649520 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f12d59-6be2-49b5-8abd-8991594e8c9c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:11.650963 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f12d59-6be2-49b5-8abd-8991594e8c9c None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:11.670570 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 310/618] 10.222.0.70 () {56 vars in 1135 bytes} [Tue Aug 2 21:28:11 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:11.676294 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f12d59-6be2-49b5-8abd-8991594e8c9c None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:11.706294 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dadc27a-e8b1-405a-9672-a9d5edff2451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:11.707034 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dadc27a-e8b1-405a-9672-a9d5edff2451 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:11.707320 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dadc27a-e8b1-405a-9672-a9d5edff2451 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:11.707593 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dadc27a-e8b1-405a-9672-a9d5edff2451 None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:11.708341 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dadc27a-e8b1-405a-9672-a9d5edff2451 None admin] RBAC: Adding query filter params (name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:11.708658 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dadc27a-e8b1-405a-9672-a9d5edff2451 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:11.710241 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dadc27a-e8b1-405a-9672-a9d5edff2451 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:11.733458 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 309/619] 10.222.0.70 () {56 vars in 1103 bytes} [Tue Aug 2 21:28:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:28:11.737214 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dadc27a-e8b1-405a-9672-a9d5edff2451 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:11.796850 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:11.806209 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f12d59-6be2-49b5-8abd-8991594e8c9c None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:11.848090 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf649a4c-340b-4c83-9303-8ac854ce7d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:11.848906 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf649a4c-340b-4c83-9303-8ac854ce7d30 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:11.849196 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf649a4c-340b-4c83-9303-8ac854ce7d30 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:11.849476 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf649a4c-340b-4c83-9303-8ac854ce7d30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:11.860966 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf649a4c-340b-4c83-9303-8ac854ce7d30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:11.862433 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf649a4c-340b-4c83-9303-8ac854ce7d30 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:11.871377 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dadc27a-e8b1-405a-9672-a9d5edff2451 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:11.873953 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:11.879309 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-cf649a4c-340b-4c83-9303-8ac854ce7d30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:11.879309 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:11.879309 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:11.879309 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:11.879309 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:11.879309 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:11.879309 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:11.879309 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:11.879309 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:11.879309 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:11.879309 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:11.879309 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:11.879309 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:28:11.879309 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:28:11.879309 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:28:11.880590 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:28:11.880590 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:11.880590 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:11.880590 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:11.880590 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:11.880590 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:11.880590 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:11.880590 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:11.880590 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:11.880590 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:11.880590 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:11.880590 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:11.880590 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:11.880590 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:11.880590 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:11.880590 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:11.880590 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:11.881470 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:28:11.881470 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:28:11.881470 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:11.881470 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:28:11.889158 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 311/620] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 2 21:28:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:11.890628 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed54ca1-a146-444f-8835-1c9d0a095288 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:11.891104 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed54ca1-a146-444f-8835-1c9d0a095288 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:11.891676 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed54ca1-a146-444f-8835-1c9d0a095288 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:11.893517 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 312/621] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:28:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:28:11.894389 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed54ca1-a146-444f-8835-1c9d0a095288 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:11.919348 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0350c8c-fdc4-4895-af21-57199b942149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:11.920003 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0350c8c-fdc4-4895-af21-57199b942149 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:11.920316 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0350c8c-fdc4-4895-af21-57199b942149 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:11.920597 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0350c8c-fdc4-4895-af21-57199b942149 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:11.934516 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0350c8c-fdc4-4895-af21-57199b942149 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:11.935972 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0350c8c-fdc4-4895-af21-57199b942149 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:11.952257 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-a0350c8c-fdc4-4895-af21-57199b942149 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:11.952257 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:11.952257 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:11.952257 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:11.952257 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:11.952257 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:11.952257 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:11.952257 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:11.952257 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:11.952257 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:11.952257 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:11.952257 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:11.952257 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:28:11.952257 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:28:11.952257 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:28:11.953212 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:28:11.953212 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:11.953212 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:11.953212 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:11.953212 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:11.953212 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:11.953212 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:11.953212 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:11.953212 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:11.953212 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:11.953212 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:11.953212 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:11.953212 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:11.953212 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:11.953212 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:11.953212 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:11.953212 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:11.954099 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:28:11.954099 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:28:11.954099 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:11.954099 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:11.954099 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 310/622] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 2 21:28:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 21:28:11.955036 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e47a9b-0410-42f0-a6b0-1d543fb0bcf5 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:11.955325 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e47a9b-0410-42f0-a6b0-1d543fb0bcf5 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:11.955659 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e47a9b-0410-42f0-a6b0-1d543fb0bcf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:11.975664 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-f8e47a9b-0410-42f0-a6b0-1d543fb0bcf5 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:28:11.976909 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-f8e47a9b-0410-42f0-a6b0-1d543fb0bcf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:28:12.036375 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed54ca1-a146-444f-8835-1c9d0a095288 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:12.062399 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 311/623] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:28:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:28:12.063327 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e47a9b-0410-42f0-a6b0-1d543fb0bcf5 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:12.084071 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f8e354-6f63-45fa-885c-826ae1c1f1c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:12.084981 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f8e354-6f63-45fa-885c-826ae1c1f1c3 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:12.085445 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f8e354-6f63-45fa-885c-826ae1c1f1c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:12.086406 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f8e354-6f63-45fa-885c-826ae1c1f1c3 None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:12.087565 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f8e354-6f63-45fa-885c-826ae1c1f1c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:12.088082 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f8e354-6f63-45fa-885c-826ae1c1f1c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:12.090525 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f8e354-6f63-45fa-885c-826ae1c1f1c3 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:12.107458 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 313/624] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 2 21:28:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:12.113360 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f8e354-6f63-45fa-885c-826ae1c1f1c3 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:12.125036 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:12.172065 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:12.195136 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e47a9b-0410-42f0-a6b0-1d543fb0bcf5 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:12.232175 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eab753-78de-4bff-8336-d4b77255d1e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:12.232966 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eab753-78de-4bff-8336-d4b77255d1e1 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:12.233373 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eab753-78de-4bff-8336-d4b77255d1e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:12.233752 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eab753-78de-4bff-8336-d4b77255d1e1 None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:12.234544 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eab753-78de-4bff-8336-d4b77255d1e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:12.234951 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eab753-78de-4bff-8336-d4b77255d1e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:12.235797 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f8e354-6f63-45fa-885c-826ae1c1f1c3 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:12.236543 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eab753-78de-4bff-8336-d4b77255d1e1 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:12.251829 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 312/625] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 2 21:28:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:12.253486 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eab753-78de-4bff-8336-d4b77255d1e1 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:12.276938 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c7672a-5030-4e99-a2eb-bdfe707aefc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:12.277794 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c7672a-5030-4e99-a2eb-bdfe707aefc7 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:12.278171 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c7672a-5030-4e99-a2eb-bdfe707aefc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:12.278549 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c7672a-5030-4e99-a2eb-bdfe707aefc7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:12.294610 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c7672a-5030-4e99-a2eb-bdfe707aefc7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:28:12.301809 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-81c7672a-5030-4e99-a2eb-bdfe707aefc7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 21:28:12.301809 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:12.301809 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:12.301809 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:12.301809 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:12.301809 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:12.301809 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:12.301809 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:12.301809 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:12.301809 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:12.301809 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:12.301809 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:12.301809 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:28:12.301809 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:28:12.301809 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:28:12.301809 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:28:12.302847 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:28:12.302847 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:28:12.302847 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:28:12.302847 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:28:12.302847 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:12.302847 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:12.302847 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:12.302847 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:12.302847 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:12.302847 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:12.302847 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:12.302847 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:12.302847 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:12.302847 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:12.302847 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:12.302847 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:12.303689 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:12.303689 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:12.303689 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:12.303689 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:12.303689 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:28:12.303689 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:28:12.303689 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:28:12.303689 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:28:12.303689 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:28:12.303689 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:28:12.303689 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 21:28:12.303689 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:28:12.304367 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 314/626] 10.222.0.70 () {56 vars in 1102 bytes} [Tue Aug 2 21:28:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:12.305216 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c7672a-5030-4e99-a2eb-bdfe707aefc7 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:12.379655 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eab753-78de-4bff-8336-d4b77255d1e1 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:12.398693 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:12.421083 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64752f4a-fa89-434c-8379-9fbe734fd3d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:12.422543 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64752f4a-fa89-434c-8379-9fbe734fd3d5 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:12.423129 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64752f4a-fa89-434c-8379-9fbe734fd3d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:12.423552 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64752f4a-fa89-434c-8379-9fbe734fd3d5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:12.433985 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64752f4a-fa89-434c-8379-9fbe734fd3d5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:12.436604 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64752f4a-fa89-434c-8379-9fbe734fd3d5 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:12.441514 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c7672a-5030-4e99-a2eb-bdfe707aefc7 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:12.452745 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-64752f4a-fa89-434c-8379-9fbe734fd3d5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:28:12.452745 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:12.452745 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:12.452745 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:12.452745 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:12.452745 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:12.452745 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:12.452745 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:12.452745 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:12.452745 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:12.452745 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:12.452745 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:12.452745 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 21:28:12.452745 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 21:28:12.452745 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 21:28:12.453819 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 21:28:12.453819 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:12.453819 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:12.453819 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:12.453819 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:12.453819 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:12.453819 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:12.453819 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:12.453819 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:12.453819 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:12.453819 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:12.453819 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:12.453819 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:12.453819 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:12.453819 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:12.453819 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:12.453819 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:12.454906 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 21:28:12.454906 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 21:28:12.454906 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 21:28:12.454906 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 21:28:12.454906 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 21:28:12.454906 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 21:28:12.454906 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:28:12.454906 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:12.457739 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 313/627] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Aug 2 21:28:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:12.459014 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64752f4a-fa89-434c-8379-9fbe734fd3d5 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:12.464556 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:12.483017 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9275016f-bdc7-4e58-9cf7-4abbd34bc10c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:12.483575 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9275016f-bdc7-4e58-9cf7-4abbd34bc10c None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:12.483957 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9275016f-bdc7-4e58-9cf7-4abbd34bc10c None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:12.484516 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9275016f-bdc7-4e58-9cf7-4abbd34bc10c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:12.495901 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9275016f-bdc7-4e58-9cf7-4abbd34bc10c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:12.497628 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9275016f-bdc7-4e58-9cf7-4abbd34bc10c None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:12.509589 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-9275016f-bdc7-4e58-9cf7-4abbd34bc10c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 02 21:28:12.509589 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:12.509589 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:12.509589 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:12.509589 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:12.509589 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:12.509589 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:12.509589 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:12.509589 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:12.509589 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:12.509589 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:12.509589 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:12.509589 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 21:28:12.509589 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 21:28:12.509589 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 21:28:12.509589 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 21:28:12.510871 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:12.510871 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:12.510871 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 21:28:12.510871 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:28:12.510871 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 21:28:12.510871 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:28:12.510871 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:12.510871 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:12.510871 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:12.510871 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:12.510871 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:12.510871 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:12.510871 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:12.510871 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:12.510871 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:12.510871 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:12.510871 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:12.510871 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:12.512039 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:12.512039 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:12.512039 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 21:28:12.512039 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 21:28:12.512039 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 21:28:12.512039 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 21:28:12.512039 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 21:28:12.512039 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 21:28:12.512039 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 02 21:28:12.512039 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:28:12.513788 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 315/628] 10.222.0.70 () {56 vars in 1093 bytes} [Tue Aug 2 21:28:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:12.514674 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9275016f-bdc7-4e58-9cf7-4abbd34bc10c None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:12.600713 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64752f4a-fa89-434c-8379-9fbe734fd3d5 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:12.622458 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9275016f-bdc7-4e58-9cf7-4abbd34bc10c None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:12.637766 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a8e61e-5f5b-4516-8df6-2b2e6e4f00d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:12.638663 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a8e61e-5f5b-4516-8df6-2b2e6e4f00d6 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:12.639157 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a8e61e-5f5b-4516-8df6-2b2e6e4f00d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:12.639630 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a8e61e-5f5b-4516-8df6-2b2e6e4f00d6 None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:12.640573 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a8e61e-5f5b-4516-8df6-2b2e6e4f00d6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:12.641110 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a8e61e-5f5b-4516-8df6-2b2e6e4f00d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:12.642676 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a8e61e-5f5b-4516-8df6-2b2e6e4f00d6 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:12.648945 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:12.652040 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 314/629] 10.222.0.70 () {56 vars in 1103 bytes} [Tue Aug 2 21:28:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:12.653527 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a8e61e-5f5b-4516-8df6-2b2e6e4f00d6 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:12.664261 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2090e9b7-c54e-4315-a81a-a92088600b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:12.664964 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2090e9b7-c54e-4315-a81a-a92088600b02 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:12.665251 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2090e9b7-c54e-4315-a81a-a92088600b02 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:12.665530 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2090e9b7-c54e-4315-a81a-a92088600b02 None admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:12.666342 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2090e9b7-c54e-4315-a81a-a92088600b02 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:12.666653 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2090e9b7-c54e-4315-a81a-a92088600b02 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:12.668691 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2090e9b7-c54e-4315-a81a-a92088600b02 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:12.682073 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 316/630] 10.222.0.70 () {56 vars in 1148 bytes} [Tue Aug 2 21:28:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:12.683605 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2090e9b7-c54e-4315-a81a-a92088600b02 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:12.726382 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:12.765349 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a8e61e-5f5b-4516-8df6-2b2e6e4f00d6 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:12.795718 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2090e9b7-c54e-4315-a81a-a92088600b02 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:12.802044 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6314c63-4345-4dce-be4e-20afd9564458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:12.802904 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6314c63-4345-4dce-be4e-20afd9564458 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:12.803385 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6314c63-4345-4dce-be4e-20afd9564458 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:12.803857 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6314c63-4345-4dce-be4e-20afd9564458 None admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:12.804889 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6314c63-4345-4dce-be4e-20afd9564458 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:12.805469 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6314c63-4345-4dce-be4e-20afd9564458 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:12.807095 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6314c63-4345-4dce-be4e-20afd9564458 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:12.827505 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 315/631] 10.222.0.70 () {56 vars in 1133 bytes} [Tue Aug 2 21:28:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:12.828783 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6314c63-4345-4dce-be4e-20afd9564458 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:12.840306 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf01b6e-2891-459d-9092-bb7ce5edb433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:12.841261 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf01b6e-2891-459d-9092-bb7ce5edb433 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:12.841549 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf01b6e-2891-459d-9092-bb7ce5edb433 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:12.841826 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf01b6e-2891-459d-9092-bb7ce5edb433 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:12.853417 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf01b6e-2891-459d-9092-bb7ce5edb433 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:12.855482 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf01b6e-2891-459d-9092-bb7ce5edb433 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:12.873587 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-baf01b6e-2891-459d-9092-bb7ce5edb433 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:12.873587 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:12.873587 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:12.873587 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:12.873587 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:12.873587 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:12.873587 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:12.873587 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:12.873587 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:12.873587 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:12.873587 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:12.873587 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:12.873587 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:28:12.873587 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:28:12.873587 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:28:12.874532 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:28:12.874532 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:12.874532 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:12.874532 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:12.874532 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:12.874532 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:12.874532 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:12.874532 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:12.874532 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:12.874532 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:12.874532 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:12.874532 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:12.874532 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:12.874532 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:12.874532 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:12.874532 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:12.874532 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:12.875416 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:28:12.875416 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:28:12.875416 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:12.875416 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:28:12.880762 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 317/632] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 2 21:28:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:12.881712 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf01b6e-2891-459d-9092-bb7ce5edb433 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:12.931409 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:12.944482 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6314c63-4345-4dce-be4e-20afd9564458 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:12.971915 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:12.984313 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d576293-4b2f-4fd9-ba79-99d8f2263c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:12.984985 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d576293-4b2f-4fd9-ba79-99d8f2263c5c None admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:12.985274 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d576293-4b2f-4fd9-ba79-99d8f2263c5c None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:12.985562 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d576293-4b2f-4fd9-ba79-99d8f2263c5c None admin] PATH_INFO: `/v3/projects/42672e04d6ce4b0ab5f7eccfb0cc946c/users/2ee7ebf40212465aac997b461a2d10fc/roles/59a4c9a6a22d4bdb966856a28c4aabaf` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:13.004735 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d576293-4b2f-4fd9-ba79-99d8f2263c5c None admin] RBAC: Authorizing `identity:create_grant(project_id=42672e04d6ce4b0ab5f7eccfb0cc946c, user_id=2ee7ebf40212465aac997b461a2d10fc, role_id=59a4c9a6a22d4bdb966856a28c4aabaf)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:13.006298 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d576293-4b2f-4fd9-ba79-99d8f2263c5c None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:13.007604 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf01b6e-2891-459d-9092-bb7ce5edb433 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:13.020844 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 316/633] 10.222.0.70 () {58 vars in 1439 bytes} [Tue Aug 2 21:28:12 2022] PUT /identity/v3/projects/42672e04d6ce4b0ab5f7eccfb0cc946c/users/2ee7ebf40212465aac997b461a2d10fc/roles/59a4c9a6a22d4bdb966856a28c4aabaf => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:28:13.021752 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d576293-4b2f-4fd9-ba79-99d8f2263c5c None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:13.070176 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdef756d-251a-42f6-902b-a798865c7577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:13.071222 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdef756d-251a-42f6-902b-a798865c7577 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:13.071767 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdef756d-251a-42f6-902b-a798865c7577 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:13.072309 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdef756d-251a-42f6-902b-a798865c7577 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:13.163980 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d576293-4b2f-4fd9-ba79-99d8f2263c5c None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:13.170177 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdef756d-251a-42f6-902b-a798865c7577 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:13.172041 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdef756d-251a-42f6-902b-a798865c7577 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:13.214698 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8763fc35-fb14-4c4a-aa84-2b851391abf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:13.215378 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8763fc35-fb14-4c4a-aa84-2b851391abf9 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:13.215884 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8763fc35-fb14-4c4a-aa84-2b851391abf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:13.216464 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8763fc35-fb14-4c4a-aa84-2b851391abf9 None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:13.217407 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8763fc35-fb14-4c4a-aa84-2b851391abf9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:13.217722 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8763fc35-fb14-4c4a-aa84-2b851391abf9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:13.219984 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8763fc35-fb14-4c4a-aa84-2b851391abf9 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:13.227985 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:13.241656 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 317/634] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 2 21:28:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:13.244031 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6b2309-221f-42bf-a3d4-de9581e70427 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:13.244500 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6b2309-221f-42bf-a3d4-de9581e70427 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:13.244817 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6b2309-221f-42bf-a3d4-de9581e70427 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:13.246220 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 318/635] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:28:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:28:13.251441 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6b2309-221f-42bf-a3d4-de9581e70427 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:13.301429 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:13.306214 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 318/636] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 2 21:28:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 21:28:13.308363 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4997bf69-9d1e-483e-85c6-466991f1a06d None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:13.308652 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4997bf69-9d1e-483e-85c6-466991f1a06d None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:13.308935 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4997bf69-9d1e-483e-85c6-466991f1a06d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:13.328103 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-4997bf69-9d1e-483e-85c6-466991f1a06d None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:28:13.330419 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-4997bf69-9d1e-483e-85c6-466991f1a06d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:28:13.384102 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6b2309-221f-42bf-a3d4-de9581e70427 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:13.406199 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 319/637] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:28:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:28:13.407405 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e8a3a4-8a24-42e1-a53d-b4db077d8c03 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:13.407701 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e8a3a4-8a24-42e1-a53d-b4db077d8c03 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:13.407981 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e8a3a4-8a24-42e1-a53d-b4db077d8c03 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:13.413617 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 320/638] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:28:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:28:13.413617 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e8a3a4-8a24-42e1-a53d-b4db077d8c03 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:13.439573 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743103e3-3ea2-425b-a571-71f059321311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:13.440156 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743103e3-3ea2-425b-a571-71f059321311 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:13.440456 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743103e3-3ea2-425b-a571-71f059321311 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:13.440741 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743103e3-3ea2-425b-a571-71f059321311 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:13.448790 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743103e3-3ea2-425b-a571-71f059321311 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:13.450252 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743103e3-3ea2-425b-a571-71f059321311 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:13.465762 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-743103e3-3ea2-425b-a571-71f059321311 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 02 21:28:13.465762 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:13.465762 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:13.465762 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:13.465762 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:13.465762 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:13.465762 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:13.465762 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:13.465762 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:13.465762 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:13.465762 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:13.465762 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:13.465762 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 21:28:13.465762 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 21:28:13.465762 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 21:28:13.465762 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 21:28:13.467004 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:13.467004 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:13.467004 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 21:28:13.467004 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:28:13.467004 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 21:28:13.467004 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:28:13.467004 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:13.467004 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:13.467004 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:13.467004 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:13.467004 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:13.467004 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:13.467004 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:13.467004 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:13.467004 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:13.467004 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:13.467004 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:13.467004 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:13.469460 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:13.469460 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:13.469460 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 21:28:13.469460 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 21:28:13.469460 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 21:28:13.469460 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 21:28:13.469460 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 21:28:13.469460 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 21:28:13.469460 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 02 21:28:13.469460 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:13.469460 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 319/639] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 2 21:28:13 2022] GET /identity/v3/users/cinder => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:13.469460 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a2816-8eb8-4495-8a37-bad3f4472c99 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:13.469460 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a2816-8eb8-4495-8a37-bad3f4472c99 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:13.470336 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a2816-8eb8-4495-8a37-bad3f4472c99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:13.491039 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-876a2816-8eb8-4495-8a37-bad3f4472c99 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:28:13.492522 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-876a2816-8eb8-4495-8a37-bad3f4472c99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:28:13.498801 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:13.539082 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e8a3a4-8a24-42e1-a53d-b4db077d8c03 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:13.569210 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 320/640] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:28:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:28:13.570052 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876a2816-8eb8-4495-8a37-bad3f4472c99 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:13.594411 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627c2aff-6883-436b-9bc8-8758421126e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:13.595070 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627c2aff-6883-436b-9bc8-8758421126e7 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:13.595387 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627c2aff-6883-436b-9bc8-8758421126e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:13.596175 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627c2aff-6883-436b-9bc8-8758421126e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:13.599501 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:13.610766 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627c2aff-6883-436b-9bc8-8758421126e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:13.612276 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627c2aff-6883-436b-9bc8-8758421126e7 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:13.627816 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-627c2aff-6883-436b-9bc8-8758421126e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:13.627816 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:13.627816 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:13.627816 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:13.627816 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:13.627816 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:13.627816 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:13.627816 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:13.627816 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:13.627816 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:13.627816 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:13.627816 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:13.627816 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:28:13.627816 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:28:13.627816 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:28:13.628858 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:28:13.628858 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:13.628858 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:13.628858 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:13.628858 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:13.628858 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:13.628858 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:13.628858 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:13.628858 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:13.628858 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:13.628858 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:13.628858 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:13.628858 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:13.628858 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:13.628858 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:13.628858 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:13.628858 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:13.629783 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:28:13.629783 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:28:13.629783 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:13.629783 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:28:13.629783 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 321/641] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 2 21:28:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:13.629783 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627c2aff-6883-436b-9bc8-8758421126e7 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:13.693127 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876a2816-8eb8-4495-8a37-bad3f4472c99 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:13.731231 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d28b70-2c44-4a7a-b06b-2b752e0dc9de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:13.732155 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d28b70-2c44-4a7a-b06b-2b752e0dc9de None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:13.732617 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d28b70-2c44-4a7a-b06b-2b752e0dc9de None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:13.732900 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d28b70-2c44-4a7a-b06b-2b752e0dc9de None admin] PATH_INFO: `/v3/roles/service` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:13.744377 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d28b70-2c44-4a7a-b06b-2b752e0dc9de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:28:13.747596 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627c2aff-6883-436b-9bc8-8758421126e7 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:13.749316 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-82d28b70-2c44-4a7a-b06b-2b752e0dc9de None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 21:28:13.749316 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:13.749316 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:13.749316 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:13.749316 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:13.749316 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:13.749316 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:13.749316 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:13.749316 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:13.749316 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:13.749316 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:13.749316 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:13.749316 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:28:13.749316 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:28:13.749316 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:28:13.749316 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:28:13.750282 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:28:13.750282 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:28:13.750282 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:28:13.750282 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:28:13.750282 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:13.750282 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:13.750282 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:13.750282 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:13.750282 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:13.750282 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:13.750282 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:13.750282 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:13.750282 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:13.750282 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:13.750282 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:13.750282 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:13.751117 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:13.751117 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:13.751117 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:13.751117 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:13.751117 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:28:13.751117 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:28:13.751117 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:28:13.751117 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:28:13.751117 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:28:13.751117 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:28:13.751117 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 21:28:13.751117 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:13.751117 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 321/642] 10.222.0.70 () {56 vars in 1102 bytes} [Tue Aug 2 21:28:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:13.751807 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d28b70-2c44-4a7a-b06b-2b752e0dc9de None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:13.774559 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:13.792748 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6750163d-4ddf-4bfa-a158-b8dd5f2cc47e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:13.793417 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6750163d-4ddf-4bfa-a158-b8dd5f2cc47e None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:13.793704 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6750163d-4ddf-4bfa-a158-b8dd5f2cc47e None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:13.793979 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6750163d-4ddf-4bfa-a158-b8dd5f2cc47e None admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:13.794925 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6750163d-4ddf-4bfa-a158-b8dd5f2cc47e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:13.795235 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6750163d-4ddf-4bfa-a158-b8dd5f2cc47e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:13.796822 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6750163d-4ddf-4bfa-a158-b8dd5f2cc47e None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:13.816006 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 322/643] 10.222.0.70 () {56 vars in 1137 bytes} [Tue Aug 2 21:28:13 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:13.816865 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6750163d-4ddf-4bfa-a158-b8dd5f2cc47e None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:13.849532 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:13.870041 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d28b70-2c44-4a7a-b06b-2b752e0dc9de None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:13.906324 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb707493-8a15-46f5-ade9-0f7c0c063c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:13.906971 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb707493-8a15-46f5-ade9-0f7c0c063c16 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:13.907255 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb707493-8a15-46f5-ade9-0f7c0c063c16 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:13.907533 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb707493-8a15-46f5-ade9-0f7c0c063c16 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:13.918558 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb707493-8a15-46f5-ade9-0f7c0c063c16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:28:13.923445 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-bb707493-8a15-46f5-ade9-0f7c0c063c16 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 21:28:13.923445 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:13.923445 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:13.923445 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:13.923445 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:13.923445 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:13.923445 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:13.923445 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:13.923445 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:13.923445 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:13.923445 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:13.923445 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:13.923445 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:28:13.923445 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:28:13.923445 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:28:13.923445 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:28:13.924489 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:28:13.924489 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:28:13.924489 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:28:13.924489 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:28:13.924489 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:13.924489 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:13.924489 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:13.924489 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:13.924489 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:13.924489 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:13.924489 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:13.924489 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:13.924489 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:13.924489 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:13.924489 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:13.924489 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:13.925436 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:13.925436 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:13.925436 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:13.925436 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:13.925436 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:28:13.925436 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:28:13.925436 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:28:13.925436 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:28:13.925436 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:28:13.925436 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:28:13.925436 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 21:28:13.925436 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:13.929464 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 322/644] 10.222.0.70 () {56 vars in 1102 bytes} [Tue Aug 2 21:28:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:13.930157 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb707493-8a15-46f5-ade9-0f7c0c063c16 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:13.938421 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6750163d-4ddf-4bfa-a158-b8dd5f2cc47e None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:13.976404 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dc6fdd-052d-415f-9fe8-f9cb15824a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:13.977025 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc6fdd-052d-415f-9fe8-f9cb15824a6f None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:13.977309 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc6fdd-052d-415f-9fe8-f9cb15824a6f None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:13.977585 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc6fdd-052d-415f-9fe8-f9cb15824a6f None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:13.978284 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dc6fdd-052d-415f-9fe8-f9cb15824a6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:13.978589 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dc6fdd-052d-415f-9fe8-f9cb15824a6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:13.979952 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dc6fdd-052d-415f-9fe8-f9cb15824a6f None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:13.991804 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 323/645] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 2 21:28:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:13.992693 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dc6fdd-052d-415f-9fe8-f9cb15824a6f None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:14.035840 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:14.040644 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb707493-8a15-46f5-ade9-0f7c0c063c16 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:14.079416 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185620f7-1068-45d8-be0f-fe5c0dfcdebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:14.080037 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185620f7-1068-45d8-be0f-fe5c0dfcdebb None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:14.080354 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185620f7-1068-45d8-be0f-fe5c0dfcdebb None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:14.080641 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185620f7-1068-45d8-be0f-fe5c0dfcdebb None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:14.081339 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185620f7-1068-45d8-be0f-fe5c0dfcdebb None admin] RBAC: Adding query filter params (name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:14.081652 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185620f7-1068-45d8-be0f-fe5c0dfcdebb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:14.083012 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185620f7-1068-45d8-be0f-fe5c0dfcdebb None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:14.095793 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 323/646] 10.222.0.70 () {56 vars in 1103 bytes} [Tue Aug 2 21:28:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:14.095793 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185620f7-1068-45d8-be0f-fe5c0dfcdebb None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:14.103578 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:14.107305 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dc6fdd-052d-415f-9fe8-f9cb15824a6f None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:14.142789 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec201c2-e712-439d-95e3-388299062567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:14.143382 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec201c2-e712-439d-95e3-388299062567 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:14.143666 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec201c2-e712-439d-95e3-388299062567 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:14.143946 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec201c2-e712-439d-95e3-388299062567 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:14.205927 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185620f7-1068-45d8-be0f-fe5c0dfcdebb None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:14.222319 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec201c2-e712-439d-95e3-388299062567 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:14.223809 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec201c2-e712-439d-95e3-388299062567 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:14.243511 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525489bc-2636-42de-8d55-fb4f116e1cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:14.244063 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525489bc-2636-42de-8d55-fb4f116e1cac None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:14.244385 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525489bc-2636-42de-8d55-fb4f116e1cac None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:14.244665 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525489bc-2636-42de-8d55-fb4f116e1cac None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:14.246065 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525489bc-2636-42de-8d55-fb4f116e1cac None admin] RBAC: Adding query filter params (name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:14.246376 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525489bc-2636-42de-8d55-fb4f116e1cac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:14.247738 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525489bc-2636-42de-8d55-fb4f116e1cac None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:14.261013 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 324/647] 10.222.0.70 () {56 vars in 1103 bytes} [Tue Aug 2 21:28:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:14.261013 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525489bc-2636-42de-8d55-fb4f116e1cac None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:14.267524 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:14.336099 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:14.343823 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 324/648] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 2 21:28:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 21:28:14.343823 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec201c2-e712-439d-95e3-388299062567 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:14.374077 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525489bc-2636-42de-8d55-fb4f116e1cac None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:14.410017 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9c827f-caeb-4b6c-9f0b-ac7cf3025b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:14.410669 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c827f-caeb-4b6c-9f0b-ac7cf3025b72 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:14.410953 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c827f-caeb-4b6c-9f0b-ac7cf3025b72 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:14.411220 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c827f-caeb-4b6c-9f0b-ac7cf3025b72 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:14.418655 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9c827f-caeb-4b6c-9f0b-ac7cf3025b72 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:14.420097 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9c827f-caeb-4b6c-9f0b-ac7cf3025b72 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:14.431533 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-bc9c827f-caeb-4b6c-9f0b-ac7cf3025b72 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:28:14.431533 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:14.431533 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:14.431533 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:14.431533 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:14.431533 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:14.431533 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:14.431533 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:14.431533 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:14.431533 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:14.431533 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:14.431533 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:14.431533 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 21:28:14.431533 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 21:28:14.431533 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 21:28:14.432508 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 21:28:14.432508 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:14.432508 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:14.432508 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:14.432508 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:14.432508 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:14.432508 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:14.432508 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:14.432508 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:14.432508 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:14.432508 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:14.432508 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:14.432508 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:14.432508 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:14.432508 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:14.432508 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:14.432508 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:14.433433 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 21:28:14.433433 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 21:28:14.433433 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 21:28:14.433433 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 21:28:14.433433 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 21:28:14.433433 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 21:28:14.433433 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:28:14.433433 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:14.433433 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 325/649] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Aug 2 21:28:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:14.433945 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9c827f-caeb-4b6c-9f0b-ac7cf3025b72 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:14.455932 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec201c2-e712-439d-95e3-388299062567 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:14.493660 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f865ac98-0cd4-4e2f-a185-36edb6d673e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:14.494233 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f865ac98-0cd4-4e2f-a185-36edb6d673e8 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:14.494522 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f865ac98-0cd4-4e2f-a185-36edb6d673e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:14.494819 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f865ac98-0cd4-4e2f-a185-36edb6d673e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:14.502610 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:14.506688 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f865ac98-0cd4-4e2f-a185-36edb6d673e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:14.508986 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f865ac98-0cd4-4e2f-a185-36edb6d673e8 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:14.524441 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-f865ac98-0cd4-4e2f-a185-36edb6d673e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:14.524441 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:14.524441 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:14.524441 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:14.524441 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:14.524441 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:14.524441 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:14.524441 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:14.524441 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:14.524441 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:14.524441 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:14.524441 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:14.524441 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:28:14.524441 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:28:14.524441 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:28:14.525393 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:28:14.525393 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:14.525393 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:14.525393 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:14.525393 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:14.525393 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:14.525393 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:14.525393 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:14.525393 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:14.525393 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:14.525393 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:14.525393 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:14.525393 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:14.525393 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:14.525393 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:14.525393 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:14.525393 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:14.526828 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:28:14.526828 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:28:14.526828 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:14.526828 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:28:14.526828 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 325/650] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 2 21:28:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:14.527123 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f865ac98-0cd4-4e2f-a185-36edb6d673e8 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:14.553192 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9c827f-caeb-4b6c-9f0b-ac7cf3025b72 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:14.585031 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:14.594315 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c4715b-5c7c-42bd-8b11-531b23431dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:14.594963 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c4715b-5c7c-42bd-8b11-531b23431dd3 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:14.595249 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c4715b-5c7c-42bd-8b11-531b23431dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:14.595528 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c4715b-5c7c-42bd-8b11-531b23431dd3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:14.607766 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c4715b-5c7c-42bd-8b11-531b23431dd3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:14.609407 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c4715b-5c7c-42bd-8b11-531b23431dd3 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:14.624305 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-26c4715b-5c7c-42bd-8b11-531b23431dd3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:14.624305 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:14.624305 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:14.624305 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:14.624305 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:14.624305 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:14.624305 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:14.624305 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:14.624305 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:14.624305 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:14.624305 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:14.624305 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:14.624305 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:28:14.624305 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:28:14.624305 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:28:14.625272 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:28:14.625272 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:14.625272 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:14.625272 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:14.625272 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:14.625272 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:14.625272 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:14.625272 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:14.625272 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:14.625272 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:14.625272 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:14.625272 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:14.625272 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:14.625272 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:14.625272 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:14.625272 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:14.625272 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:14.626164 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:28:14.626164 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:28:14.626164 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:14.626164 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:14.626164 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 326/651] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 2 21:28:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:14.626463 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c4715b-5c7c-42bd-8b11-531b23431dd3 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:14.643141 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f865ac98-0cd4-4e2f-a185-36edb6d673e8 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:14.680663 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aff5cb3-87fc-479a-81f7-4d18bb076a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:14.681310 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aff5cb3-87fc-479a-81f7-4d18bb076a12 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:14.681598 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aff5cb3-87fc-479a-81f7-4d18bb076a12 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:14.681901 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aff5cb3-87fc-479a-81f7-4d18bb076a12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:14.693203 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aff5cb3-87fc-479a-81f7-4d18bb076a12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:14.694695 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aff5cb3-87fc-479a-81f7-4d18bb076a12 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:14.709710 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-1aff5cb3-87fc-479a-81f7-4d18bb076a12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:14.709710 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:14.709710 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:14.709710 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:14.709710 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:14.709710 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:14.709710 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:14.709710 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:14.709710 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:14.709710 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:14.709710 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:14.709710 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:14.709710 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:28:14.709710 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:28:14.709710 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:28:14.710649 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:28:14.710649 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:14.710649 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:14.710649 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:14.710649 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:14.710649 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:14.710649 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:14.710649 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:14.710649 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:14.710649 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:14.710649 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:14.710649 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:14.710649 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:14.710649 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:14.710649 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:14.710649 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:14.710649 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:14.711569 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:28:14.711569 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:28:14.711569 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:14.711569 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:28:14.711569 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 326/652] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 2 21:28:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:14.711855 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aff5cb3-87fc-479a-81f7-4d18bb076a12 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:14.739025 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c4715b-5c7c-42bd-8b11-531b23431dd3 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:14.758695 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:14.775403 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2ce46d-7501-4c69-b479-2eb4cbaa6e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:14.776029 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2ce46d-7501-4c69-b479-2eb4cbaa6e41 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:14.776904 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2ce46d-7501-4c69-b479-2eb4cbaa6e41 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:14.777190 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2ce46d-7501-4c69-b479-2eb4cbaa6e41 None admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:14.777939 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2ce46d-7501-4c69-b479-2eb4cbaa6e41 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:14.778260 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2ce46d-7501-4c69-b479-2eb4cbaa6e41 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:14.779680 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2ce46d-7501-4c69-b479-2eb4cbaa6e41 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:14.793078 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 327/653] 10.222.0.70 () {56 vars in 1148 bytes} [Tue Aug 2 21:28:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:14.798511 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2ce46d-7501-4c69-b479-2eb4cbaa6e41 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:14.823523 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aff5cb3-87fc-479a-81f7-4d18bb076a12 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:14.842755 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:14.862000 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b65bebc-d639-4dea-bee3-d849113e1d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:14.862644 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b65bebc-d639-4dea-bee3-d849113e1d07 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:14.863183 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b65bebc-d639-4dea-bee3-d849113e1d07 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:14.863464 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b65bebc-d639-4dea-bee3-d849113e1d07 None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:14.864162 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b65bebc-d639-4dea-bee3-d849113e1d07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:14.864502 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b65bebc-d639-4dea-bee3-d849113e1d07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:14.865909 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b65bebc-d639-4dea-bee3-d849113e1d07 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:14.878398 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 327/654] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 2 21:28:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:14.879219 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b65bebc-d639-4dea-bee3-d849113e1d07 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:14.915698 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2ce46d-7501-4c69-b479-2eb4cbaa6e41 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:14.956253 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd49d46d-7a6b-4e85-af00-9039fd82bd86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:14.956880 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd49d46d-7a6b-4e85-af00-9039fd82bd86 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:14.957165 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd49d46d-7a6b-4e85-af00-9039fd82bd86 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:14.957633 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd49d46d-7a6b-4e85-af00-9039fd82bd86 None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:14.958131 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd49d46d-7a6b-4e85-af00-9039fd82bd86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:14.958509 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd49d46d-7a6b-4e85-af00-9039fd82bd86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:14.959825 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd49d46d-7a6b-4e85-af00-9039fd82bd86 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:14.972314 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 328/655] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 2 21:28:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:14.972989 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd49d46d-7a6b-4e85-af00-9039fd82bd86 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:15.004706 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b65bebc-d639-4dea-bee3-d849113e1d07 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:15.006743 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:15.044370 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b3deba-cc95-42b0-a95c-08671bfd5d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:15.044905 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b3deba-cc95-42b0-a95c-08671bfd5d9d None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:15.045188 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b3deba-cc95-42b0-a95c-08671bfd5d9d None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:15.045512 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b3deba-cc95-42b0-a95c-08671bfd5d9d None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:15.046204 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b3deba-cc95-42b0-a95c-08671bfd5d9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:15.046510 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b3deba-cc95-42b0-a95c-08671bfd5d9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:15.047942 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b3deba-cc95-42b0-a95c-08671bfd5d9d None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:15.062022 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 328/656] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 2 21:28:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:15.063113 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b3deba-cc95-42b0-a95c-08671bfd5d9d None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:15.082535 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:15.086463 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd49d46d-7a6b-4e85-af00-9039fd82bd86 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:15.123863 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a246ac81-3226-414a-8b30-7a7ca8e2c34e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:15.124501 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a246ac81-3226-414a-8b30-7a7ca8e2c34e None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:15.124785 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a246ac81-3226-414a-8b30-7a7ca8e2c34e None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:15.125062 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a246ac81-3226-414a-8b30-7a7ca8e2c34e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:15.125841 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a246ac81-3226-414a-8b30-7a7ca8e2c34e None admin] RBAC: Adding query filter params (role.id=59a4c9a6a22d4bdb966856a28c4aabaf, scope.project.id=42672e04d6ce4b0ab5f7eccfb0cc946c, user.id=87dd5c1c5e854d4b96e0b7dad6aa3719) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:15.126149 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a246ac81-3226-414a-8b30-7a7ca8e2c34e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:15.127563 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a246ac81-3226-414a-8b30-7a7ca8e2c34e None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:15.133170 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 329/657] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Aug 2 21:28:14 2022] GET /identity/v3/role_assignments?user.id=87dd5c1c5e854d4b96e0b7dad6aa3719&scope.project.id=42672e04d6ce4b0ab5f7eccfb0cc946c&role.id=59a4c9a6a22d4bdb966856a28c4aabaf => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:15.133996 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a246ac81-3226-414a-8b30-7a7ca8e2c34e None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:15.170574 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b3deba-cc95-42b0-a95c-08671bfd5d9d None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:15.208617 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06df888-7c0d-493b-a121-3dcb3819769b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:15.209342 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06df888-7c0d-493b-a121-3dcb3819769b None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:15.209633 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06df888-7c0d-493b-a121-3dcb3819769b None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:15.209913 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06df888-7c0d-493b-a121-3dcb3819769b None admin] PATH_INFO: `/v3/users/glance` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:15.219586 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06df888-7c0d-493b-a121-3dcb3819769b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:15.221112 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06df888-7c0d-493b-a121-3dcb3819769b None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:15.234111 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-c06df888-7c0d-493b-a121-3dcb3819769b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 02 21:28:15.234111 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:15.234111 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:15.234111 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:15.234111 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:15.234111 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:15.234111 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:15.234111 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:15.234111 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:15.234111 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:15.234111 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:15.234111 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:15.234111 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 21:28:15.234111 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 21:28:15.234111 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 21:28:15.234111 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 21:28:15.235326 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:15.235326 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:15.235326 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 21:28:15.235326 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:28:15.235326 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 21:28:15.235326 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:28:15.235326 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:15.235326 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:15.235326 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:15.235326 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:15.235326 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:15.235326 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:15.235326 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:15.235326 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:15.235326 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:15.235326 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:15.235326 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:15.235326 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:15.236458 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:15.236458 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:15.236458 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 21:28:15.236458 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 21:28:15.236458 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 21:28:15.236458 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 21:28:15.236458 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 21:28:15.236458 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 21:28:15.236458 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 02 21:28:15.236458 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:28:15.236458 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 329/658] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 2 21:28:15 2022] GET /identity/v3/users/glance => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:15.236458 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06df888-7c0d-493b-a121-3dcb3819769b None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:15.252912 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a246ac81-3226-414a-8b30-7a7ca8e2c34e None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:15.266600 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:15.303626 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ddf6fc-35d7-4eef-a6cd-06e60a7af0a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:15.304670 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ddf6fc-35d7-4eef-a6cd-06e60a7af0a6 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:15.304951 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ddf6fc-35d7-4eef-a6cd-06e60a7af0a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:15.305247 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ddf6fc-35d7-4eef-a6cd-06e60a7af0a6 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:15.313223 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ddf6fc-35d7-4eef-a6cd-06e60a7af0a6 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:15.314650 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ddf6fc-35d7-4eef-a6cd-06e60a7af0a6 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:15.327025 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-85ddf6fc-35d7-4eef-a6cd-06e60a7af0a6 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 02 21:28:15.327025 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:15.327025 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:15.327025 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:15.327025 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:15.327025 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:15.327025 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:15.327025 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:15.327025 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:15.327025 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:15.327025 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:15.327025 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:15.327025 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 21:28:15.327025 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 21:28:15.327025 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 21:28:15.327025 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 21:28:15.328008 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:15.328008 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:15.328008 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 21:28:15.328008 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:28:15.328008 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 21:28:15.328008 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:28:15.328008 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:15.328008 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:15.328008 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:15.328008 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:15.328008 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:15.328008 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:15.328008 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:15.328008 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:15.328008 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:15.328008 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:15.328008 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:15.328008 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:15.329121 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:15.329121 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:15.329121 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 21:28:15.329121 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 21:28:15.329121 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 21:28:15.329121 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 21:28:15.329121 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 21:28:15.329121 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 21:28:15.329121 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 02 21:28:15.329121 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:15.329121 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 330/659] 10.222.0.70 () {56 vars in 1102 bytes} [Tue Aug 2 21:28:15 2022] GET /identity/v3/users/neutron => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:15.330417 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2f0da6-64bf-4b0f-a6fe-61e7624b27b4 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:15.330699 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2f0da6-64bf-4b0f-a6fe-61e7624b27b4 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:15.330966 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2f0da6-64bf-4b0f-a6fe-61e7624b27b4 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:15.332218 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 331/660] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:28:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:28:15.337161 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2f0da6-64bf-4b0f-a6fe-61e7624b27b4 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:15.366747 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06df888-7c0d-493b-a121-3dcb3819769b None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:15.368006 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:15.405462 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9860d819-ee95-4e73-9757-3c7890ad5902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:15.406114 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9860d819-ee95-4e73-9757-3c7890ad5902 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:15.406402 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9860d819-ee95-4e73-9757-3c7890ad5902 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:15.406681 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9860d819-ee95-4e73-9757-3c7890ad5902 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:15.413455 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9860d819-ee95-4e73-9757-3c7890ad5902 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:15.414912 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9860d819-ee95-4e73-9757-3c7890ad5902 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:15.427020 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-9860d819-ee95-4e73-9757-3c7890ad5902 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:28:15.427020 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:15.427020 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:15.427020 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:15.427020 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:15.427020 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:15.427020 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:15.427020 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:15.427020 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:15.427020 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:15.427020 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:15.427020 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:15.427020 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 21:28:15.427020 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 21:28:15.427020 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 21:28:15.428114 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 21:28:15.428114 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:15.428114 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:15.428114 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:15.428114 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:15.428114 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:15.428114 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:15.428114 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:15.428114 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:15.428114 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:15.428114 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:15.428114 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:15.428114 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:15.428114 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:15.428114 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:15.428114 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:15.428114 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:15.430110 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 21:28:15.430110 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 21:28:15.430110 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 21:28:15.430110 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 21:28:15.430110 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 21:28:15.430110 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 21:28:15.430110 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:28:15.430110 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:28:15.430110 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 330/661] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Aug 2 21:28:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:15.430589 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9860d819-ee95-4e73-9757-3c7890ad5902 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:15.457127 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2f0da6-64bf-4b0f-a6fe-61e7624b27b4 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:15.500781 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981f663b-7d55-4d94-862e-7b6e45043b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:15.501409 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981f663b-7d55-4d94-862e-7b6e45043b3e None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:15.501692 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981f663b-7d55-4d94-862e-7b6e45043b3e None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:15.501973 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981f663b-7d55-4d94-862e-7b6e45043b3e None admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:15.502772 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981f663b-7d55-4d94-862e-7b6e45043b3e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:15.503072 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981f663b-7d55-4d94-862e-7b6e45043b3e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:15.504526 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981f663b-7d55-4d94-862e-7b6e45043b3e None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:15.522507 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 332/662] 10.222.0.70 () {56 vars in 1137 bytes} [Tue Aug 2 21:28:15 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:15.523535 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d75c1e-a6a9-4db9-b93b-987ded618f38 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:15.523821 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d75c1e-a6a9-4db9-b93b-987ded618f38 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:15.524097 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d75c1e-a6a9-4db9-b93b-987ded618f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:15.530382 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:15.543880 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-05d75c1e-a6a9-4db9-b93b-987ded618f38 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:28:15.545105 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-05d75c1e-a6a9-4db9-b93b-987ded618f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:28:15.550404 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9860d819-ee95-4e73-9757-3c7890ad5902 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:15.587508 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3edc452-d1e6-45cc-93fc-01a85ba1a6b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:15.588043 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3edc452-d1e6-45cc-93fc-01a85ba1a6b6 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:15.588365 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3edc452-d1e6-45cc-93fc-01a85ba1a6b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:15.589200 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3edc452-d1e6-45cc-93fc-01a85ba1a6b6 None admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:15.589996 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3edc452-d1e6-45cc-93fc-01a85ba1a6b6 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:15.590321 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3edc452-d1e6-45cc-93fc-01a85ba1a6b6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:15.591745 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3edc452-d1e6-45cc-93fc-01a85ba1a6b6 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:15.614970 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 331/663] 10.222.0.70 () {56 vars in 1139 bytes} [Tue Aug 2 21:28:15 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:15.614970 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3edc452-d1e6-45cc-93fc-01a85ba1a6b6 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:15.622700 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 333/664] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:28:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:28:15.628269 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d75c1e-a6a9-4db9-b93b-987ded618f38 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:15.644467 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:15.723501 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3edc452-d1e6-45cc-93fc-01a85ba1a6b6 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:15.738545 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d75c1e-a6a9-4db9-b93b-987ded618f38 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:15.765660 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd6bb10-7c21-4588-9e13-df05a28246d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:15.766594 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd6bb10-7c21-4588-9e13-df05a28246d6 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:15.767021 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd6bb10-7c21-4588-9e13-df05a28246d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:15.767306 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd6bb10-7c21-4588-9e13-df05a28246d6 None admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:15.768053 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd6bb10-7c21-4588-9e13-df05a28246d6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:15.768398 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd6bb10-7c21-4588-9e13-df05a28246d6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:15.769852 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd6bb10-7c21-4588-9e13-df05a28246d6 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:15.774488 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d626172c-689a-467b-94f6-823024d3d81b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:15.775109 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d626172c-689a-467b-94f6-823024d3d81b None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:15.775447 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d626172c-689a-467b-94f6-823024d3d81b None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:15.775729 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d626172c-689a-467b-94f6-823024d3d81b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:15.778888 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:15.787773 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 332/665] 10.222.0.70 () {56 vars in 1148 bytes} [Tue Aug 2 21:28:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:15.789183 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd6bb10-7c21-4588-9e13-df05a28246d6 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:15.860063 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d626172c-689a-467b-94f6-823024d3d81b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:15.861734 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d626172c-689a-467b-94f6-823024d3d81b None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:15.878031 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:15.900892 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd6bb10-7c21-4588-9e13-df05a28246d6 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:15.936946 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d858a4f8-d20d-4b49-aa85-aeb3328960f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:15.937562 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d858a4f8-d20d-4b49-aa85-aeb3328960f8 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:15.937849 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d858a4f8-d20d-4b49-aa85-aeb3328960f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:15.938125 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d858a4f8-d20d-4b49-aa85-aeb3328960f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:15.977301 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 334/666] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 2 21:28:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 21:28:15.978293 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d626172c-689a-467b-94f6-823024d3d81b None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:16.010379 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:16.013545 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d858a4f8-d20d-4b49-aa85-aeb3328960f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:16.015010 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d858a4f8-d20d-4b49-aa85-aeb3328960f8 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:16.088888 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d626172c-689a-467b-94f6-823024d3d81b None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:16.104116 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:16.121166 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 333/667] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 2 21:28:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 21:28:16.122194 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d858a4f8-d20d-4b49-aa85-aeb3328960f8 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:16.129809 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121f2865-230c-4643-9d4f-379e3c2de190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:16.130458 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121f2865-230c-4643-9d4f-379e3c2de190 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:16.130730 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121f2865-230c-4643-9d4f-379e3c2de190 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:16.131005 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121f2865-230c-4643-9d4f-379e3c2de190 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:16.143095 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121f2865-230c-4643-9d4f-379e3c2de190 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:28:16.147909 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-121f2865-230c-4643-9d4f-379e3c2de190 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 21:28:16.147909 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:16.147909 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:16.147909 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:16.147909 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:16.147909 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:16.147909 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:16.147909 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:16.147909 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:16.147909 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:16.147909 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:16.147909 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:16.147909 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:28:16.147909 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:28:16.147909 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:28:16.147909 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:28:16.148912 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:28:16.148912 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:28:16.148912 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:28:16.148912 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:28:16.148912 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:16.148912 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:16.148912 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:16.148912 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:16.148912 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:16.148912 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:16.148912 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:16.148912 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:16.148912 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:16.148912 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:16.148912 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:16.148912 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:16.149775 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:16.149775 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:16.149775 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:16.149775 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:16.149775 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:28:16.149775 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:28:16.149775 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:28:16.149775 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:28:16.149775 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:28:16.149775 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:28:16.149775 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 21:28:16.149775 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:16.149775 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 335/668] 10.222.0.70 () {56 vars in 1102 bytes} [Tue Aug 2 21:28:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:16.151183 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121f2865-230c-4643-9d4f-379e3c2de190 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:16.231160 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:16.234243 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d858a4f8-d20d-4b49-aa85-aeb3328960f8 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:16.258826 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121f2865-230c-4643-9d4f-379e3c2de190 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:16.276068 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a16d8b6-95dd-461e-a19f-77726a93b5d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:16.277036 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a16d8b6-95dd-461e-a19f-77726a93b5d5 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:16.277324 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a16d8b6-95dd-461e-a19f-77726a93b5d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:16.277599 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a16d8b6-95dd-461e-a19f-77726a93b5d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:16.278393 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a16d8b6-95dd-461e-a19f-77726a93b5d5 None admin] RBAC: Adding query filter params (role.id=59a4c9a6a22d4bdb966856a28c4aabaf, scope.project.id=42672e04d6ce4b0ab5f7eccfb0cc946c, user.id=123eb76f95ee4e39905944da701c712d) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:16.278703 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a16d8b6-95dd-461e-a19f-77726a93b5d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:16.280770 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a16d8b6-95dd-461e-a19f-77726a93b5d5 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:16.293213 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 334/669] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Aug 2 21:28:16 2022] GET /identity/v3/role_assignments?user.id=123eb76f95ee4e39905944da701c712d&scope.project.id=42672e04d6ce4b0ab5f7eccfb0cc946c&role.id=59a4c9a6a22d4bdb966856a28c4aabaf => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:16.294142 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a16d8b6-95dd-461e-a19f-77726a93b5d5 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:16.313328 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0929c45-7651-424e-95a6-b9641ae2fc43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:16.314373 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0929c45-7651-424e-95a6-b9641ae2fc43 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:16.314869 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0929c45-7651-424e-95a6-b9641ae2fc43 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:16.315485 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0929c45-7651-424e-95a6-b9641ae2fc43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:16.327357 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0929c45-7651-424e-95a6-b9641ae2fc43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:16.328932 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0929c45-7651-424e-95a6-b9641ae2fc43 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:16.347948 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-a0929c45-7651-424e-95a6-b9641ae2fc43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:16.347948 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:16.347948 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:16.347948 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:16.347948 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:16.347948 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:16.347948 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:16.347948 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:16.347948 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:16.347948 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:16.347948 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:16.347948 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:16.347948 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:28:16.347948 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:28:16.347948 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:28:16.348959 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:28:16.348959 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:16.348959 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:16.348959 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:16.348959 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:16.348959 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:16.348959 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:16.348959 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:16.348959 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:16.348959 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:16.348959 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:16.348959 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:16.348959 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:16.348959 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:16.348959 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:16.348959 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:16.348959 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:16.349885 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:28:16.349885 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:28:16.349885 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:16.349885 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:16.352934 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 336/670] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 2 21:28:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:16.355149 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0929c45-7651-424e-95a6-b9641ae2fc43 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:16.389722 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:16.443374 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a16d8b6-95dd-461e-a19f-77726a93b5d5 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:16.481327 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0929c45-7651-424e-95a6-b9641ae2fc43 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:16.490426 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce469032-1817-475b-871e-54bff00e7262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:16.491073 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce469032-1817-475b-871e-54bff00e7262 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:16.491355 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce469032-1817-475b-871e-54bff00e7262 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:16.491631 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce469032-1817-475b-871e-54bff00e7262 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:16.504859 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce469032-1817-475b-871e-54bff00e7262 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:16.506373 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce469032-1817-475b-871e-54bff00e7262 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:16.523440 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-ce469032-1817-475b-871e-54bff00e7262 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:16.523440 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:16.523440 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:16.523440 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:16.523440 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:16.523440 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:16.523440 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:16.523440 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:16.523440 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:16.523440 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:16.523440 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:16.523440 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:16.523440 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:28:16.523440 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:28:16.523440 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:28:16.524479 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:28:16.524479 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:16.524479 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:16.524479 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:16.524479 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:16.524479 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:16.524479 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:16.524479 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:16.524479 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:16.524479 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:16.524479 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:16.524479 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:16.524479 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:16.524479 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:16.524479 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:16.524479 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:16.524479 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:16.525372 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:28:16.525372 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:28:16.525372 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:16.525372 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:28:16.525372 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 335/671] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 2 21:28:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:16.526108 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce469032-1817-475b-871e-54bff00e7262 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:16.528269 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7c32eb-dd68-469e-ba9f-6a1266c0be53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:16.529121 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7c32eb-dd68-469e-ba9f-6a1266c0be53 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:16.529588 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7c32eb-dd68-469e-ba9f-6a1266c0be53 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:16.530049 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7c32eb-dd68-469e-ba9f-6a1266c0be53 None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:16.530974 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7c32eb-dd68-469e-ba9f-6a1266c0be53 None admin] RBAC: Adding query filter params (name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:16.531462 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7c32eb-dd68-469e-ba9f-6a1266c0be53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:16.533072 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7c32eb-dd68-469e-ba9f-6a1266c0be53 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:16.546440 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 337/672] 10.222.0.70 () {56 vars in 1103 bytes} [Tue Aug 2 21:28:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:16.547312 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7c32eb-dd68-469e-ba9f-6a1266c0be53 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:16.551178 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:16.641874 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:16.659817 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce469032-1817-475b-871e-54bff00e7262 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:16.660381 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7c32eb-dd68-469e-ba9f-6a1266c0be53 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:16.697025 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d128bb89-cca3-43ad-b614-0dd181bf96bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:16.698268 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d128bb89-cca3-43ad-b614-0dd181bf96bf None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:16.698858 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d128bb89-cca3-43ad-b614-0dd181bf96bf None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:16.699391 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d128bb89-cca3-43ad-b614-0dd181bf96bf None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:16.700393 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d128bb89-cca3-43ad-b614-0dd181bf96bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:16.700895 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d128bb89-cca3-43ad-b614-0dd181bf96bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:16.701084 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7145f9-5a93-4928-addc-d033e7b9f73e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:16.701686 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7145f9-5a93-4928-addc-d033e7b9f73e None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:16.701973 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7145f9-5a93-4928-addc-d033e7b9f73e None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:16.702247 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7145f9-5a93-4928-addc-d033e7b9f73e None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:16.702937 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7145f9-5a93-4928-addc-d033e7b9f73e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:16.703244 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7145f9-5a93-4928-addc-d033e7b9f73e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:16.703779 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d128bb89-cca3-43ad-b614-0dd181bf96bf None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:16.704634 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7145f9-5a93-4928-addc-d033e7b9f73e None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:16.722223 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 336/674] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 2 21:28:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:16.722223 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7145f9-5a93-4928-addc-d033e7b9f73e None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:16.722668 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 338/674] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 2 21:28:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:16.723999 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d128bb89-cca3-43ad-b614-0dd181bf96bf None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:16.811620 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:16.841539 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7145f9-5a93-4928-addc-d033e7b9f73e None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:16.845346 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d128bb89-cca3-43ad-b614-0dd181bf96bf None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:16.883790 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabd6a4a-932c-4adc-bb4c-4f330d20f46b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:16.884437 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4194acfa-39d2-4fdd-8563-d038b9e983c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:16.884573 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabd6a4a-932c-4adc-bb4c-4f330d20f46b None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:16.884745 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabd6a4a-932c-4adc-bb4c-4f330d20f46b None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:16.884986 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabd6a4a-932c-4adc-bb4c-4f330d20f46b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:16.885987 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4194acfa-39d2-4fdd-8563-d038b9e983c3 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:16.886460 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4194acfa-39d2-4fdd-8563-d038b9e983c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:16.887025 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4194acfa-39d2-4fdd-8563-d038b9e983c3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:16.894806 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4194acfa-39d2-4fdd-8563-d038b9e983c3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:16.896366 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabd6a4a-932c-4adc-bb4c-4f330d20f46b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:16.896839 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4194acfa-39d2-4fdd-8563-d038b9e983c3 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:16.898098 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabd6a4a-932c-4adc-bb4c-4f330d20f46b None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:16.910242 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-4194acfa-39d2-4fdd-8563-d038b9e983c3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:28:16.910242 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:16.910242 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:16.910242 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:16.910242 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:16.910242 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:16.910242 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:16.910242 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:16.910242 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:16.910242 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:16.910242 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:16.910242 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:16.910242 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 21:28:16.910242 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 21:28:16.910242 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 21:28:16.911172 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 21:28:16.911172 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:16.911172 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:16.911172 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:16.911172 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:16.911172 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:16.911172 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:16.911172 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:16.911172 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:16.911172 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:16.911172 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:16.911172 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:16.911172 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:16.911172 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:16.911172 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:16.911172 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:16.911172 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:16.912036 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 21:28:16.912036 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 21:28:16.912036 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 21:28:16.912036 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 21:28:16.912036 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 21:28:16.912036 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 21:28:16.912036 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:28:16.912036 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:16.919313 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-aabd6a4a-932c-4adc-bb4c-4f330d20f46b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:16.919313 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:16.919313 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:16.919313 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:16.919313 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:16.919313 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:16.919313 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:16.919313 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:16.919313 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:16.919313 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:16.919313 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:16.919313 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:16.919313 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:28:16.919313 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:28:16.919313 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:28:16.920217 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:28:16.920217 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:16.920217 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:16.920217 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:16.920217 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:16.920217 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:16.920217 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:16.920217 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:16.920217 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:16.920217 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:16.920217 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:16.920217 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:16.920217 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:16.920217 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:16.920217 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:16.920217 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:16.920217 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:16.921139 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:28:16.921139 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:28:16.921139 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:16.921139 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:28:16.921139 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 337/675] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 2 21:28:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:16.921139 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabd6a4a-932c-4adc-bb4c-4f330d20f46b None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:16.922437 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 339/676] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Aug 2 21:28:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:16.923517 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4194acfa-39d2-4fdd-8563-d038b9e983c3 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:16.934207 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:17.042037 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4194acfa-39d2-4fdd-8563-d038b9e983c3 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:17.047829 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabd6a4a-932c-4adc-bb4c-4f330d20f46b None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:17.080604 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:17.081882 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a877380-7842-423c-8614-483ac5283b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:17.082858 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a877380-7842-423c-8614-483ac5283b0f None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:17.083364 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a877380-7842-423c-8614-483ac5283b0f None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:17.083858 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a877380-7842-423c-8614-483ac5283b0f None admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:17.084933 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a877380-7842-423c-8614-483ac5283b0f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:17.085529 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a877380-7842-423c-8614-483ac5283b0f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:17.087368 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a877380-7842-423c-8614-483ac5283b0f None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:17.089439 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c15132-45bc-4475-8002-81e5417d908c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:17.090120 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c15132-45bc-4475-8002-81e5417d908c None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:17.090773 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c15132-45bc-4475-8002-81e5417d908c None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:17.091474 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c15132-45bc-4475-8002-81e5417d908c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:17.099812 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c15132-45bc-4475-8002-81e5417d908c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:17.102130 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c15132-45bc-4475-8002-81e5417d908c None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:17.109567 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 340/677] 10.222.0.70 () {56 vars in 1148 bytes} [Tue Aug 2 21:28:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:17.110697 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a877380-7842-423c-8614-483ac5283b0f None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:17.114555 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-b9c15132-45bc-4475-8002-81e5417d908c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:28:17.114555 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:17.114555 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:17.114555 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:17.114555 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:17.114555 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:17.114555 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:17.114555 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:17.114555 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:17.114555 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:17.114555 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:17.114555 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:17.114555 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 21:28:17.114555 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 21:28:17.114555 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 21:28:17.115464 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 21:28:17.115464 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:17.115464 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:17.115464 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:17.115464 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:17.115464 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:17.115464 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:17.115464 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:17.115464 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:17.115464 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:17.115464 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:17.115464 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:17.115464 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:17.115464 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:17.115464 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:17.115464 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:17.115464 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:17.116368 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 21:28:17.116368 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 21:28:17.116368 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 21:28:17.116368 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 21:28:17.116368 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 21:28:17.116368 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 21:28:17.116368 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:28:17.116368 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:28:17.116368 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 338/678] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Aug 2 21:28:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:17.116887 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c15132-45bc-4475-8002-81e5417d908c None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:17.196785 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:17.238178 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a877380-7842-423c-8614-483ac5283b0f None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:17.245165 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c15132-45bc-4475-8002-81e5417d908c None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:17.273517 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ffa0c0-16f5-4e1d-8ff2-e4f7f13c709f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:17.274140 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ffa0c0-16f5-4e1d-8ff2-e4f7f13c709f None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:17.274448 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ffa0c0-16f5-4e1d-8ff2-e4f7f13c709f None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:17.274767 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ffa0c0-16f5-4e1d-8ff2-e4f7f13c709f None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:17.275449 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ffa0c0-16f5-4e1d-8ff2-e4f7f13c709f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:17.275756 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ffa0c0-16f5-4e1d-8ff2-e4f7f13c709f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:17.277792 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ffa0c0-16f5-4e1d-8ff2-e4f7f13c709f None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:17.294057 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 341/679] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 2 21:28:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:17.294177 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d092316-5b18-43f3-82a8-b657f22a26f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:17.294640 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d092316-5b18-43f3-82a8-b657f22a26f7 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:17.294750 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ffa0c0-16f5-4e1d-8ff2-e4f7f13c709f None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:17.294987 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d092316-5b18-43f3-82a8-b657f22a26f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:17.295268 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d092316-5b18-43f3-82a8-b657f22a26f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:17.296055 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d092316-5b18-43f3-82a8-b657f22a26f7 None admin] RBAC: Adding query filter params (role.id=59a4c9a6a22d4bdb966856a28c4aabaf, scope.project.id=42672e04d6ce4b0ab5f7eccfb0cc946c, user.id=723f5f43572a493dae0349070a2adb5e) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:17.296388 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d092316-5b18-43f3-82a8-b657f22a26f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:17.299020 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d092316-5b18-43f3-82a8-b657f22a26f7 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:17.311811 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 339/680] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Aug 2 21:28:17 2022] GET /identity/v3/role_assignments?user.id=723f5f43572a493dae0349070a2adb5e&scope.project.id=42672e04d6ce4b0ab5f7eccfb0cc946c&role.id=59a4c9a6a22d4bdb966856a28c4aabaf => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:17.311811 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd55b97-80a9-4d23-b0ad-d1237e6ed2aa None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:17.311811 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd55b97-80a9-4d23-b0ad-d1237e6ed2aa None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:17.311811 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd55b97-80a9-4d23-b0ad-d1237e6ed2aa None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:17.311811 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 340/681] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:28:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:28:17.312633 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd55b97-80a9-4d23-b0ad-d1237e6ed2aa None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:17.388114 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:17.438192 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ffa0c0-16f5-4e1d-8ff2-e4f7f13c709f None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:17.449795 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd55b97-80a9-4d23-b0ad-d1237e6ed2aa None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:17.475512 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:17.492379 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60cf70a-ea56-49c0-a812-860f04cebabc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:17.493013 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60cf70a-ea56-49c0-a812-860f04cebabc None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:17.493292 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60cf70a-ea56-49c0-a812-860f04cebabc None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:17.493565 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60cf70a-ea56-49c0-a812-860f04cebabc None admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:17.493920 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84decf6e-b6f1-4156-b8be-c63feed0fea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:17.494327 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60cf70a-ea56-49c0-a812-860f04cebabc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:17.494574 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84decf6e-b6f1-4156-b8be-c63feed0fea7 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:17.494678 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60cf70a-ea56-49c0-a812-860f04cebabc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:17.494901 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84decf6e-b6f1-4156-b8be-c63feed0fea7 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:17.495174 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84decf6e-b6f1-4156-b8be-c63feed0fea7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:17.496122 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60cf70a-ea56-49c0-a812-860f04cebabc None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:17.506219 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84decf6e-b6f1-4156-b8be-c63feed0fea7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:17.508355 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84decf6e-b6f1-4156-b8be-c63feed0fea7 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:17.512773 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 342/682] 10.222.0.70 () {56 vars in 1148 bytes} [Tue Aug 2 21:28:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:17.513920 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c571fb0a-45d3-4d6c-963f-908abf5da721 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:17.514215 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c571fb0a-45d3-4d6c-963f-908abf5da721 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:17.514493 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c571fb0a-45d3-4d6c-963f-908abf5da721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:17.523167 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-84decf6e-b6f1-4156-b8be-c63feed0fea7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 02 21:28:17.523167 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:17.523167 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:17.523167 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:17.523167 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:17.523167 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:17.523167 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:17.523167 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:17.523167 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:17.523167 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:17.523167 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:17.523167 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:17.523167 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 21:28:17.523167 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 21:28:17.523167 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 21:28:17.523167 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 21:28:17.524099 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:17.524099 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:17.524099 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 21:28:17.524099 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:28:17.524099 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 21:28:17.524099 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:28:17.524099 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:17.524099 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:17.524099 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:17.524099 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:17.524099 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:17.524099 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:17.524099 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:17.524099 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:17.524099 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:17.524099 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:17.524099 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:17.524099 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:17.525104 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:17.525104 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:17.525104 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 21:28:17.525104 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 21:28:17.525104 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 21:28:17.525104 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 21:28:17.525104 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 21:28:17.525104 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 21:28:17.525104 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 02 21:28:17.525104 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:28:17.525104 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 341/683] 10.222.0.70 () {56 vars in 1096 bytes} [Tue Aug 2 21:28:17 2022] GET /identity/v3/users/swift => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:17.525695 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84decf6e-b6f1-4156-b8be-c63feed0fea7 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:17.539863 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-c571fb0a-45d3-4d6c-963f-908abf5da721 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:28:17.541231 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-c571fb0a-45d3-4d6c-963f-908abf5da721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:28:17.620178 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 343/684] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:28:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:28:17.621473 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c571fb0a-45d3-4d6c-963f-908abf5da721 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:17.732294 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c571fb0a-45d3-4d6c-963f-908abf5da721 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:17.748913 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:17.759367 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84decf6e-b6f1-4156-b8be-c63feed0fea7 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:17.768968 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97ac5d6-856a-47fd-ad28-e007cb8fdc6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:17.769862 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97ac5d6-856a-47fd-ad28-e007cb8fdc6f None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:17.770306 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97ac5d6-856a-47fd-ad28-e007cb8fdc6f None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:17.770730 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97ac5d6-856a-47fd-ad28-e007cb8fdc6f None admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:17.771670 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97ac5d6-856a-47fd-ad28-e007cb8fdc6f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:17.772128 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97ac5d6-856a-47fd-ad28-e007cb8fdc6f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:17.773816 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97ac5d6-856a-47fd-ad28-e007cb8fdc6f None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:17.781593 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:17.793634 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 344/685] 10.222.0.70 () {56 vars in 1135 bytes} [Tue Aug 2 21:28:17 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:17.794758 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97ac5d6-856a-47fd-ad28-e007cb8fdc6f None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:17.800870 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017c1a13-e3c3-44f5-ac6e-9c082c3fad8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:17.801611 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017c1a13-e3c3-44f5-ac6e-9c082c3fad8a None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:17.801993 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017c1a13-e3c3-44f5-ac6e-9c082c3fad8a None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:17.802365 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017c1a13-e3c3-44f5-ac6e-9c082c3fad8a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:17.803248 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017c1a13-e3c3-44f5-ac6e-9c082c3fad8a None admin] RBAC: Adding query filter params (role.id=59a4c9a6a22d4bdb966856a28c4aabaf, scope.project.id=42672e04d6ce4b0ab5f7eccfb0cc946c, user.id=accb7ab8b4f447389ed394a48fc27619) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:17.803665 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017c1a13-e3c3-44f5-ac6e-9c082c3fad8a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:17.805224 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017c1a13-e3c3-44f5-ac6e-9c082c3fad8a None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:17.816857 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 342/686] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Aug 2 21:28:17 2022] GET /identity/v3/role_assignments?user.id=accb7ab8b4f447389ed394a48fc27619&scope.project.id=42672e04d6ce4b0ab5f7eccfb0cc946c&role.id=59a4c9a6a22d4bdb966856a28c4aabaf => generated 608 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:17.816857 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017c1a13-e3c3-44f5-ac6e-9c082c3fad8a None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:17.993497 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97ac5d6-856a-47fd-ad28-e007cb8fdc6f None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:18.025133 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017c1a13-e3c3-44f5-ac6e-9c082c3fad8a None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:18.037804 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02921d71-486f-4b42-ae65-b3272630319a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:18.038696 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02921d71-486f-4b42-ae65-b3272630319a None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:18.039130 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02921d71-486f-4b42-ae65-b3272630319a None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:18.039565 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02921d71-486f-4b42-ae65-b3272630319a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:18.052475 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02921d71-486f-4b42-ae65-b3272630319a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:28:18.058937 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-02921d71-486f-4b42-ae65-b3272630319a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 21:28:18.058937 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:18.058937 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:18.058937 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:18.058937 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:18.058937 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:18.058937 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:18.058937 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:18.058937 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:18.058937 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:18.058937 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:18.058937 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:18.058937 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:28:18.058937 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:28:18.058937 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:28:18.058937 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:28:18.060090 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:28:18.060090 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:28:18.060090 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:28:18.060090 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:28:18.060090 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:18.060090 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:18.060090 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:18.060090 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:18.060090 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:18.060090 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:18.060090 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:18.060090 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:18.060090 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:18.060090 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:18.060090 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:18.060090 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:18.061042 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:18.061042 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:18.061042 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:18.061042 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:18.061042 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:28:18.061042 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:28:18.061042 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:28:18.061042 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:28:18.061042 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:28:18.061042 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:28:18.061042 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 21:28:18.061042 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:18.063441 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 345/687] 10.222.0.70 () {56 vars in 1096 bytes} [Tue Aug 2 21:28:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:18.069450 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02921d71-486f-4b42-ae65-b3272630319a None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:18.070289 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1718e7c4-9f8e-4709-993a-5de5c581ed09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:18.072062 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1718e7c4-9f8e-4709-993a-5de5c581ed09 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:18.072525 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1718e7c4-9f8e-4709-993a-5de5c581ed09 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:18.072930 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1718e7c4-9f8e-4709-993a-5de5c581ed09 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:18.116170 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:18.140634 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:18.171700 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1718e7c4-9f8e-4709-993a-5de5c581ed09 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:18.173506 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1718e7c4-9f8e-4709-993a-5de5c581ed09 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:18.216739 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02921d71-486f-4b42-ae65-b3272630319a None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:18.256413 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d68cd41-27f7-45f0-9431-d1aa7a145152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:18.257269 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d68cd41-27f7-45f0-9431-d1aa7a145152 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:18.257715 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d68cd41-27f7-45f0-9431-d1aa7a145152 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:18.258154 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d68cd41-27f7-45f0-9431-d1aa7a145152 None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:18.259030 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d68cd41-27f7-45f0-9431-d1aa7a145152 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:18.259485 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d68cd41-27f7-45f0-9431-d1aa7a145152 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:18.261069 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d68cd41-27f7-45f0-9431-d1aa7a145152 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:18.271235 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 346/688] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 2 21:28:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:28:18.278921 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d68cd41-27f7-45f0-9431-d1aa7a145152 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:18.312862 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 343/689] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 2 21:28:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 21:28:18.319000 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1718e7c4-9f8e-4709-993a-5de5c581ed09 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:18.406877 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:18.414295 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d68cd41-27f7-45f0-9431-d1aa7a145152 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:18.415768 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:18.461494 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1718e7c4-9f8e-4709-993a-5de5c581ed09 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:18.462757 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151a773a-76e4-46fd-94ac-26ac5a37be66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:18.463413 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151a773a-76e4-46fd-94ac-26ac5a37be66 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:18.464268 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151a773a-76e4-46fd-94ac-26ac5a37be66 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:18.464566 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151a773a-76e4-46fd-94ac-26ac5a37be66 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:18.479886 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151a773a-76e4-46fd-94ac-26ac5a37be66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:18.481656 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151a773a-76e4-46fd-94ac-26ac5a37be66 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:18.499855 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8809c457-58fd-4d70-9d02-b95d652f2979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:18.500767 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8809c457-58fd-4d70-9d02-b95d652f2979 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:18.501198 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8809c457-58fd-4d70-9d02-b95d652f2979 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:18.501615 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-151a773a-76e4-46fd-94ac-26ac5a37be66 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:18.501615 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:18.501615 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:18.501615 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:18.501615 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:18.501615 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:18.501615 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:18.501615 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:18.501615 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:18.501615 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:18.501615 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:18.501615 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:18.501615 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:28:18.501615 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:28:18.501615 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:28:18.502646 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:28:18.502646 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:18.502646 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:18.502646 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:18.502646 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:18.502646 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:18.502646 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:18.502646 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:18.502646 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:18.502646 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:18.502646 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:18.502646 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:18.502646 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:18.502646 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:18.502646 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:18.502646 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:18.502646 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:18.503767 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:28:18.503767 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:28:18.503767 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:18.503767 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:18.503767 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 347/690] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 2 21:28:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:18.504348 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8809c457-58fd-4d70-9d02-b95d652f2979 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:18.504462 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fd69f0-d3ba-4a37-a28a-5a023bb10421 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:18.504637 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fd69f0-d3ba-4a37-a28a-5a023bb10421 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:18.504919 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fd69f0-d3ba-4a37-a28a-5a023bb10421 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:18.506650 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 348/691] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:28:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:28:18.511711 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fd69f0-d3ba-4a37-a28a-5a023bb10421 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:18.518833 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8809c457-58fd-4d70-9d02-b95d652f2979 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:18.520636 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8809c457-58fd-4d70-9d02-b95d652f2979 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:18.537544 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-8809c457-58fd-4d70-9d02-b95d652f2979 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:18.537544 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:18.537544 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:18.537544 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:18.537544 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:18.537544 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:18.537544 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:18.537544 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:18.537544 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:18.537544 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:18.537544 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:18.537544 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:18.537544 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:28:18.537544 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:28:18.537544 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:28:18.538538 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:28:18.538538 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:18.538538 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:18.538538 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:18.538538 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:18.538538 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:18.538538 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:18.538538 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:18.538538 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:18.538538 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:18.538538 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:18.538538 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:18.538538 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:18.538538 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:18.538538 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:18.538538 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:18.538538 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:18.539442 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:28:18.539442 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:28:18.539442 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:18.539442 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:28:18.541824 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 344/692] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 2 21:28:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:18.543319 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4dc254-6042-4f90-bfa9-c603f7f8b901 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:18.543807 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4dc254-6042-4f90-bfa9-c603f7f8b901 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:18.544332 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4dc254-6042-4f90-bfa9-c603f7f8b901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:18.563265 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-4e4dc254-6042-4f90-bfa9-c603f7f8b901 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:28:18.565664 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-4e4dc254-6042-4f90-bfa9-c603f7f8b901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:28:18.622892 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fd69f0-d3ba-4a37-a28a-5a023bb10421 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:18.647249 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 345/693] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:28:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:28:18.648866 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4dc254-6042-4f90-bfa9-c603f7f8b901 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:18.673005 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b8a261-b82b-4706-a401-7342d3b5423e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:18.673638 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b8a261-b82b-4706-a401-7342d3b5423e None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:18.673947 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b8a261-b82b-4706-a401-7342d3b5423e None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:18.674293 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b8a261-b82b-4706-a401-7342d3b5423e None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:18.674913 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b8a261-b82b-4706-a401-7342d3b5423e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:18.675223 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b8a261-b82b-4706-a401-7342d3b5423e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:18.676636 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b8a261-b82b-4706-a401-7342d3b5423e None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:18.696470 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 349/694] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 2 21:28:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:18.697310 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b8a261-b82b-4706-a401-7342d3b5423e None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:18.715818 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:18.716420 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:18.766609 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4dc254-6042-4f90-bfa9-c603f7f8b901 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:18.801487 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b8a261-b82b-4706-a401-7342d3b5423e None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:18.815394 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f045d94-71b5-43e7-be4c-5afde0037a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:18.816512 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f045d94-71b5-43e7-be4c-5afde0037a6d None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:18.817361 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f045d94-71b5-43e7-be4c-5afde0037a6d None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:18.818137 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f045d94-71b5-43e7-be4c-5afde0037a6d None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:18.819046 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f045d94-71b5-43e7-be4c-5afde0037a6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:18.819739 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f045d94-71b5-43e7-be4c-5afde0037a6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:18.821632 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f045d94-71b5-43e7-be4c-5afde0037a6d None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:18.837274 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936b203d-55fd-47f0-b248-456d53500350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:18.837871 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 346/695] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 2 21:28:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:18.837998 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b203d-55fd-47f0-b248-456d53500350 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:18.838232 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b203d-55fd-47f0-b248-456d53500350 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:18.838491 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936b203d-55fd-47f0-b248-456d53500350 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:18.839131 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936b203d-55fd-47f0-b248-456d53500350 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:18.839770 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f045d94-71b5-43e7-be4c-5afde0037a6d None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:18.840644 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936b203d-55fd-47f0-b248-456d53500350 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:18.852174 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-936b203d-55fd-47f0-b248-456d53500350 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 02 21:28:18.852174 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:18.852174 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 21:28:18.852174 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 21:28:18.852174 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 21:28:18.852174 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 21:28:18.852174 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 21:28:18.852174 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 21:28:18.852174 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 02 21:28:18.852174 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:18.852174 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 21:28:18.852174 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:18.852174 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:18.852174 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:18.852174 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:18.852174 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:18.853235 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:18.853235 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:18.853235 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:18.853235 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:18.853235 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:18.853235 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:18.853235 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:18.853235 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 21:28:18.853235 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 21:28:18.853235 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 21:28:18.853235 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 21:28:18.853235 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:18.853235 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:18.853235 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:18.853235 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:18.853235 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:18.854147 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:18.854147 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:18.854147 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:18.854147 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:18.854147 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:18.854147 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:18.854147 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:18.854147 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:18.854147 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:18.854147 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:18.854147 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:18.854147 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 21:28:18.854147 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 21:28:18.854147 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 02 21:28:18.854147 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:18.858342 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 350/696] 10.222.0.70 () {56 vars in 1129 bytes} [Tue Aug 2 21:28:18 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:18.859198 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936b203d-55fd-47f0-b248-456d53500350 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:18.935874 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:18.959022 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f045d94-71b5-43e7-be4c-5afde0037a6d None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:18.966982 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936b203d-55fd-47f0-b248-456d53500350 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:18.992405 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:19.006507 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c447cee7-cba2-40dc-a5ae-27b8af1155c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:19.007274 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c447cee7-cba2-40dc-a5ae-27b8af1155c9 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:19.007559 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c447cee7-cba2-40dc-a5ae-27b8af1155c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:19.007837 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c447cee7-cba2-40dc-a5ae-27b8af1155c9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:19.010163 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cf5a09-1a4d-45bb-a45d-69929f02e3e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:19.012018 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cf5a09-1a4d-45bb-a45d-69929f02e3e8 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:19.012567 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cf5a09-1a4d-45bb-a45d-69929f02e3e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:19.013069 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cf5a09-1a4d-45bb-a45d-69929f02e3e8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:19.018794 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c447cee7-cba2-40dc-a5ae-27b8af1155c9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:19.022168 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c447cee7-cba2-40dc-a5ae-27b8af1155c9 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:19.022684 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cf5a09-1a4d-45bb-a45d-69929f02e3e8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:19.024396 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cf5a09-1a4d-45bb-a45d-69929f02e3e8 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:19.035293 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-c447cee7-cba2-40dc-a5ae-27b8af1155c9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 02 21:28:19.035293 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:19.035293 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:19.035293 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:19.035293 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:19.035293 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:19.035293 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:19.035293 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:19.035293 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:19.035293 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:19.035293 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:19.035293 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:19.035293 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 21:28:19.035293 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 21:28:19.035293 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 21:28:19.035293 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 21:28:19.036267 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:19.036267 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:19.036267 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 21:28:19.036267 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:28:19.036267 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 21:28:19.036267 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:28:19.036267 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:19.036267 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:19.036267 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:19.036267 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:19.036267 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:19.036267 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:19.036267 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:19.036267 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:19.036267 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:19.036267 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:19.036267 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:19.036267 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:19.038313 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:19.038313 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:19.038313 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 21:28:19.038313 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 21:28:19.038313 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 21:28:19.038313 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 21:28:19.038313 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 21:28:19.038313 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 21:28:19.038313 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 02 21:28:19.038313 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:28:19.038313 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 347/697] 10.222.0.70 () {56 vars in 1093 bytes} [Tue Aug 2 21:28:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:19.038313 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c447cee7-cba2-40dc-a5ae-27b8af1155c9 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:19.041470 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-c9cf5a09-1a4d-45bb-a45d-69929f02e3e8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:28:19.041470 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:19.041470 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:19.041470 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:19.041470 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:19.041470 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:19.041470 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:19.041470 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:19.041470 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:19.041470 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:19.041470 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:19.041470 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:19.041470 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 21:28:19.041470 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 21:28:19.041470 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 21:28:19.042387 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 21:28:19.042387 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:19.042387 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:19.042387 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:19.042387 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:19.042387 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:19.042387 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:19.042387 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:19.042387 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:19.042387 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:19.042387 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:19.042387 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:19.042387 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:19.042387 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:19.042387 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:19.042387 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:19.042387 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:19.043268 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 21:28:19.043268 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 21:28:19.043268 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 21:28:19.043268 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 21:28:19.043268 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 21:28:19.043268 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 21:28:19.043268 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:28:19.043268 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:19.046218 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 351/698] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Aug 2 21:28:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:19.047359 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cf5a09-1a4d-45bb-a45d-69929f02e3e8 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:19.160508 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cf5a09-1a4d-45bb-a45d-69929f02e3e8 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:19.173016 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c447cee7-cba2-40dc-a5ae-27b8af1155c9 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:19.199725 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:19.207830 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be46a546-aafb-4492-9deb-51b5a8ca427d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:19.209236 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be46a546-aafb-4492-9deb-51b5a8ca427d None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:19.209527 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be46a546-aafb-4492-9deb-51b5a8ca427d None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:19.209808 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be46a546-aafb-4492-9deb-51b5a8ca427d None admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:19.210615 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be46a546-aafb-4492-9deb-51b5a8ca427d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:19.211186 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be46a546-aafb-4492-9deb-51b5a8ca427d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:19.213323 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be46a546-aafb-4492-9deb-51b5a8ca427d None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:19.217822 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837da94e-b455-4fd2-a1e0-69b24ae8fbab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:19.218689 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837da94e-b455-4fd2-a1e0-69b24ae8fbab None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:19.219181 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837da94e-b455-4fd2-a1e0-69b24ae8fbab None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:19.219677 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837da94e-b455-4fd2-a1e0-69b24ae8fbab None admin] PATH_INFO: `/v3/services` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:19.220611 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837da94e-b455-4fd2-a1e0-69b24ae8fbab None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:19.221147 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837da94e-b455-4fd2-a1e0-69b24ae8fbab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:19.222809 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837da94e-b455-4fd2-a1e0-69b24ae8fbab None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:19.228140 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 348/699] 10.222.0.70 () {56 vars in 1124 bytes} [Tue Aug 2 21:28:19 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:19.229779 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837da94e-b455-4fd2-a1e0-69b24ae8fbab None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:19.239400 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 352/700] 10.222.0.70 () {56 vars in 1133 bytes} [Tue Aug 2 21:28:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:19.240611 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be46a546-aafb-4492-9deb-51b5a8ca427d None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:19.287275 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:19.357942 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be46a546-aafb-4492-9deb-51b5a8ca427d None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:19.360661 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837da94e-b455-4fd2-a1e0-69b24ae8fbab None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:19.398084 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f810a55f-5316-4049-9c2b-a5f5244bd27d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:19.399017 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f810a55f-5316-4049-9c2b-a5f5244bd27d None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:19.399131 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f810a55f-5316-4049-9c2b-a5f5244bd27d None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:19.399356 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f810a55f-5316-4049-9c2b-a5f5244bd27d None admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:19.400155 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f810a55f-5316-4049-9c2b-a5f5244bd27d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:19.400445 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f810a55f-5316-4049-9c2b-a5f5244bd27d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:19.401908 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f810a55f-5316-4049-9c2b-a5f5244bd27d None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:19.405793 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106d71f4-9b11-4bc1-8cfb-ff73d2a57c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:19.406683 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d71f4-9b11-4bc1-8cfb-ff73d2a57c0b None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:19.407174 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d71f4-9b11-4bc1-8cfb-ff73d2a57c0b None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:19.407807 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106d71f4-9b11-4bc1-8cfb-ff73d2a57c0b None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:19.408723 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106d71f4-9b11-4bc1-8cfb-ff73d2a57c0b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:19.409858 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106d71f4-9b11-4bc1-8cfb-ff73d2a57c0b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:19.412001 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106d71f4-9b11-4bc1-8cfb-ff73d2a57c0b None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:19.419659 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 353/702] 10.222.0.70 () {56 vars in 1124 bytes} [Tue Aug 2 21:28:19 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:19.420374 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 349/702] 10.222.0.70 () {56 vars in 1148 bytes} [Tue Aug 2 21:28:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:19.421331 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f810a55f-5316-4049-9c2b-a5f5244bd27d None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:19.421693 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106d71f4-9b11-4bc1-8cfb-ff73d2a57c0b None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:19.506615 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:19.555676 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f810a55f-5316-4049-9c2b-a5f5244bd27d None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:19.558706 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:19.560730 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106d71f4-9b11-4bc1-8cfb-ff73d2a57c0b None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:19.598557 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cdef1c-33d7-4416-bdab-fbe9cd764534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:19.599001 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6328d8e-c4c3-42e5-975d-3eae2af6ac3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:19.599449 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cdef1c-33d7-4416-bdab-fbe9cd764534 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:19.599760 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6328d8e-c4c3-42e5-975d-3eae2af6ac3f None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:19.599881 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cdef1c-33d7-4416-bdab-fbe9cd764534 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:19.600163 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6328d8e-c4c3-42e5-975d-3eae2af6ac3f None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:19.600287 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cdef1c-33d7-4416-bdab-fbe9cd764534 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:19.600576 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6328d8e-c4c3-42e5-975d-3eae2af6ac3f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:19.601441 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6328d8e-c4c3-42e5-975d-3eae2af6ac3f None admin] RBAC: Adding query filter params (role.id=59a4c9a6a22d4bdb966856a28c4aabaf, scope.project.id=42672e04d6ce4b0ab5f7eccfb0cc946c, user.id=2ee7ebf40212465aac997b461a2d10fc) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:19.601821 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6328d8e-c4c3-42e5-975d-3eae2af6ac3f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:19.603460 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6328d8e-c4c3-42e5-975d-3eae2af6ac3f None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:19.611005 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 354/703] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Aug 2 21:28:19 2022] GET /identity/v3/role_assignments?user.id=2ee7ebf40212465aac997b461a2d10fc&scope.project.id=42672e04d6ce4b0ab5f7eccfb0cc946c&role.id=59a4c9a6a22d4bdb966856a28c4aabaf => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:19.612663 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf27e7c8-dac2-427f-b379-4dbcfbdfd6f8 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:19.613263 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf27e7c8-dac2-427f-b379-4dbcfbdfd6f8 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:19.613590 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf27e7c8-dac2-427f-b379-4dbcfbdfd6f8 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:19.619464 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 355/704] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:28:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:28:19.621159 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce2c8dc-2437-456a-acd1-71eaf886f6da None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:19.621522 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce2c8dc-2437-456a-acd1-71eaf886f6da None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:19.621971 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce2c8dc-2437-456a-acd1-71eaf886f6da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:19.644648 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-2ce2c8dc-2437-456a-acd1-71eaf886f6da None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:28:19.646021 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-2ce2c8dc-2437-456a-acd1-71eaf886f6da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:28:19.702236 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cdef1c-33d7-4416-bdab-fbe9cd764534 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:19.703876 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4cdef1c-33d7-4416-bdab-fbe9cd764534 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:19.746236 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 356/705] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:28:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:28:19.769316 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce2c8dc-2437-456a-acd1-71eaf886f6da None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:19.824764 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:19.842334 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 350/706] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 2 21:28:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 02 21:28:19.847826 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cdef1c-33d7-4416-bdab-fbe9cd764534 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:19.849858 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:19.889071 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce2c8dc-2437-456a-acd1-71eaf886f6da None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:19.927033 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7370b4-fdbc-4950-9472-373726049b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:19.927936 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7370b4-fdbc-4950-9472-373726049b3b None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:19.928443 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7370b4-fdbc-4950-9472-373726049b3b None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:19.928920 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7370b4-fdbc-4950-9472-373726049b3b None admin] PATH_INFO: `/v3/services/network` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:19.929718 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7370b4-fdbc-4950-9472-373726049b3b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:19.931412 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7370b4-fdbc-4950-9472-373726049b3b None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:19.941585 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-bf7370b4-fdbc-4950-9472-373726049b3b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 02 21:28:19.941585 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:19.941585 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 21:28:19.941585 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 21:28:19.941585 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 21:28:19.941585 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 21:28:19.941585 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 21:28:19.941585 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 21:28:19.941585 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 02 21:28:19.941585 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:19.941585 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 21:28:19.941585 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:19.941585 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:19.941585 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:19.941585 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:19.941585 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:19.941585 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:19.942797 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:19.942797 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:19.942797 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:19.942797 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:19.942797 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:19.942797 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:19.942797 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 21:28:19.942797 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 21:28:19.942797 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 21:28:19.942797 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 21:28:19.942797 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:19.942797 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:19.942797 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:19.942797 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:19.942797 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:19.942797 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:19.943804 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:19.943804 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:19.943804 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:19.943804 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:19.943804 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:19.943804 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:19.943804 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:19.943804 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:19.943804 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:19.943804 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:19.943804 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 21:28:19.943804 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 21:28:19.943804 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 02 21:28:19.943804 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:19.946402 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 357/707] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Aug 2 21:28:19 2022] GET /identity/v3/services/network => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:19.953183 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7370b4-fdbc-4950-9472-373726049b3b None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:19.964667 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cdef1c-33d7-4416-bdab-fbe9cd764534 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:20.012958 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaccb0f8-637e-45ff-86b8-a7fac0d7f073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:20.014196 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaccb0f8-637e-45ff-86b8-a7fac0d7f073 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:20.014633 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaccb0f8-637e-45ff-86b8-a7fac0d7f073 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:20.015195 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaccb0f8-637e-45ff-86b8-a7fac0d7f073 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:20.029165 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaccb0f8-637e-45ff-86b8-a7fac0d7f073 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:20.032390 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaccb0f8-637e-45ff-86b8-a7fac0d7f073 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:20.052641 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-aaccb0f8-637e-45ff-86b8-a7fac0d7f073 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:20.052641 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:20.052641 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:20.052641 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:20.052641 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:20.052641 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:20.052641 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:20.052641 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:20.052641 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:20.052641 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:20.052641 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:20.052641 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:20.052641 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:28:20.052641 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:28:20.052641 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:28:20.053742 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:28:20.053742 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:20.053742 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:20.053742 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:20.053742 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:20.053742 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:20.053742 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:20.053742 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:20.053742 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:20.053742 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:20.053742 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:20.053742 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:20.053742 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:20.053742 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:20.053742 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:20.053742 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:20.053742 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:20.054815 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:28:20.054815 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:28:20.054815 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:20.054815 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:28:20.057740 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 351/708] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 2 21:28:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 21:28:20.064361 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaccb0f8-637e-45ff-86b8-a7fac0d7f073 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:20.097012 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7370b4-fdbc-4950-9472-373726049b3b None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:20.111849 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:20.136584 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcabf5a4-5d7f-49e5-b5d3-0932b49d1de8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:20.137334 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcabf5a4-5d7f-49e5-b5d3-0932b49d1de8 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:20.137692 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcabf5a4-5d7f-49e5-b5d3-0932b49d1de8 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:20.138045 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcabf5a4-5d7f-49e5-b5d3-0932b49d1de8 None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:20.138808 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcabf5a4-5d7f-49e5-b5d3-0932b49d1de8 None admin] RBAC: Adding query filter params (name=network) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:20.139239 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcabf5a4-5d7f-49e5-b5d3-0932b49d1de8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:20.139356 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:20.140813 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcabf5a4-5d7f-49e5-b5d3-0932b49d1de8 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:20.146073 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 358/709] 10.222.0.70 () {56 vars in 1112 bytes} [Tue Aug 2 21:28:19 2022] GET /identity/v3/services?name=network => generated 124 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:20.151997 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcabf5a4-5d7f-49e5-b5d3-0932b49d1de8 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:20.195061 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaccb0f8-637e-45ff-86b8-a7fac0d7f073 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:20.285176 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5565f832-878e-484a-9855-5e7e3dbb80cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:20.285945 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5565f832-878e-484a-9855-5e7e3dbb80cc None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:20.286307 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5565f832-878e-484a-9855-5e7e3dbb80cc None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:20.286658 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5565f832-878e-484a-9855-5e7e3dbb80cc None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:20.287468 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5565f832-878e-484a-9855-5e7e3dbb80cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:20.287857 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5565f832-878e-484a-9855-5e7e3dbb80cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:20.290297 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5565f832-878e-484a-9855-5e7e3dbb80cc None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:20.328663 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 352/710] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 2 21:28:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:20.334463 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5565f832-878e-484a-9855-5e7e3dbb80cc None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:20.404458 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcabf5a4-5d7f-49e5-b5d3-0932b49d1de8 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:20.443291 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b1d380-75ca-4bee-8f6a-9d6af149e602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:20.444069 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b1d380-75ca-4bee-8f6a-9d6af149e602 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:20.444575 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b1d380-75ca-4bee-8f6a-9d6af149e602 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:20.444934 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b1d380-75ca-4bee-8f6a-9d6af149e602 None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:20.445734 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b1d380-75ca-4bee-8f6a-9d6af149e602 None admin] RBAC: Adding query filter params (type=network) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:20.446117 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b1d380-75ca-4bee-8f6a-9d6af149e602 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:20.447567 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b1d380-75ca-4bee-8f6a-9d6af149e602 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:20.453577 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 359/711] 10.222.0.70 () {56 vars in 1112 bytes} [Tue Aug 2 21:28:20 2022] GET /identity/v3/services?type=network => generated 124 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:28:20.489158 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e018bb5-a9bf-4382-a0a8-41f7befffcd6 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:20.489469 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e018bb5-a9bf-4382-a0a8-41f7befffcd6 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:20.489740 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e018bb5-a9bf-4382-a0a8-41f7befffcd6 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:20.491187 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 360/712] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:28:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:28:20.497548 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4ef79d-16b9-4c89-8825-bc292a4f4209 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:20.498232 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4ef79d-16b9-4c89-8825-bc292a4f4209 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:20.498850 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4ef79d-16b9-4c89-8825-bc292a4f4209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:20.517970 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-ca4ef79d-16b9-4c89-8825-bc292a4f4209 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:28:20.519534 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-ca4ef79d-16b9-4c89-8825-bc292a4f4209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:28:20.558349 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:20.593662 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 361/713] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:28:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 02 21:28:20.618451 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5565f832-878e-484a-9855-5e7e3dbb80cc None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:20.620469 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4ef79d-16b9-4c89-8825-bc292a4f4209 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:20.660271 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:20.694855 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84befa14-32b1-4d43-86b3-dceb15f9b6f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:20.695504 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84befa14-32b1-4d43-86b3-dceb15f9b6f1 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:20.695844 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84befa14-32b1-4d43-86b3-dceb15f9b6f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:20.696119 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84befa14-32b1-4d43-86b3-dceb15f9b6f1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:20.703904 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84befa14-32b1-4d43-86b3-dceb15f9b6f1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:20.705438 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84befa14-32b1-4d43-86b3-dceb15f9b6f1 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:20.718744 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-84befa14-32b1-4d43-86b3-dceb15f9b6f1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:28:20.718744 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:20.718744 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:20.718744 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:20.718744 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:20.718744 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:20.718744 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:20.718744 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:20.718744 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:20.718744 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:20.718744 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:20.718744 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:20.718744 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 21:28:20.718744 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 21:28:20.718744 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 21:28:20.719712 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 21:28:20.719712 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:20.719712 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:20.719712 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:20.719712 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:20.719712 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:20.719712 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:20.719712 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:20.719712 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:20.719712 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:20.719712 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:20.719712 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:20.719712 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:20.719712 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:20.719712 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:20.719712 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:20.719712 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:20.720778 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 21:28:20.720778 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 21:28:20.720778 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 21:28:20.720778 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 21:28:20.720778 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 21:28:20.720778 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 21:28:20.720778 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:28:20.720778 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:28:20.720778 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 353/714] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Aug 2 21:28:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 386 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 21:28:20.725856 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84befa14-32b1-4d43-86b3-dceb15f9b6f1 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:20.782231 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4ef79d-16b9-4c89-8825-bc292a4f4209 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:20.831520 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42007e7d-2154-4d6a-ab41-6492c25039ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:20.832198 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42007e7d-2154-4d6a-ab41-6492c25039ce None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:20.832511 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42007e7d-2154-4d6a-ab41-6492c25039ce None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:20.832789 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42007e7d-2154-4d6a-ab41-6492c25039ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:20.855222 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42007e7d-2154-4d6a-ab41-6492c25039ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:20.857859 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42007e7d-2154-4d6a-ab41-6492c25039ce None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:20.886531 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-42007e7d-2154-4d6a-ab41-6492c25039ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:20.886531 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:20.886531 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:20.886531 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:20.886531 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:20.886531 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:20.886531 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:20.886531 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:20.886531 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:20.886531 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:20.886531 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:20.886531 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:20.886531 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:28:20.886531 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:28:20.886531 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:28:20.887485 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:28:20.887485 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:20.887485 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:20.887485 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:20.887485 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:20.887485 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:20.887485 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:20.887485 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:20.887485 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:20.887485 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:20.887485 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:20.887485 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:20.887485 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:20.887485 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:20.887485 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:20.887485 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:20.887485 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:20.888457 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:28:20.888457 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:28:20.888457 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:20.888457 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:20.891125 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84befa14-32b1-4d43-86b3-dceb15f9b6f1 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:20.894193 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 362/715] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 2 21:28:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 21:28:20.905326 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42007e7d-2154-4d6a-ab41-6492c25039ce None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:20.953160 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:20.960910 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbf9e45-8339-4f50-989b-0b2c8b1ad0e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:20.962320 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbf9e45-8339-4f50-989b-0b2c8b1ad0e9 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:20.962800 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbf9e45-8339-4f50-989b-0b2c8b1ad0e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:20.963265 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbf9e45-8339-4f50-989b-0b2c8b1ad0e9 None admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:20.964226 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbf9e45-8339-4f50-989b-0b2c8b1ad0e9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:20.964803 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbf9e45-8339-4f50-989b-0b2c8b1ad0e9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:20.966425 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbf9e45-8339-4f50-989b-0b2c8b1ad0e9 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:20.981146 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 354/716] 10.222.0.70 () {56 vars in 1148 bytes} [Tue Aug 2 21:28:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:20.986762 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbf9e45-8339-4f50-989b-0b2c8b1ad0e9 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:21.024682 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:21.107602 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbf9e45-8339-4f50-989b-0b2c8b1ad0e9 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:21.134372 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42007e7d-2154-4d6a-ab41-6492c25039ce None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:21.149338 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95131d7a-b81d-484c-b577-dd5b96e283e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:21.150253 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95131d7a-b81d-484c-b577-dd5b96e283e1 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:21.150734 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95131d7a-b81d-484c-b577-dd5b96e283e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:21.151759 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95131d7a-b81d-484c-b577-dd5b96e283e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:21.152787 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95131d7a-b81d-484c-b577-dd5b96e283e1 None admin] RBAC: Adding query filter params (role.id=3e32dbf75f9b41f5adb9fe59851267bb, scope.project.id=42672e04d6ce4b0ab5f7eccfb0cc946c, user.id=87dd5c1c5e854d4b96e0b7dad6aa3719) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:21.153317 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95131d7a-b81d-484c-b577-dd5b96e283e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:21.155404 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95131d7a-b81d-484c-b577-dd5b96e283e1 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:21.162356 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 355/717] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Aug 2 21:28:20 2022] GET /identity/v3/role_assignments?user.id=87dd5c1c5e854d4b96e0b7dad6aa3719&scope.project.id=42672e04d6ce4b0ab5f7eccfb0cc946c&role.id=3e32dbf75f9b41f5adb9fe59851267bb => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:21.207887 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16789701-b7d5-4f17-b3bb-8f12b67cbf3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:21.208472 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16789701-b7d5-4f17-b3bb-8f12b67cbf3d None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:21.208759 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16789701-b7d5-4f17-b3bb-8f12b67cbf3d None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:21.209036 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16789701-b7d5-4f17-b3bb-8f12b67cbf3d None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:21.209744 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16789701-b7d5-4f17-b3bb-8f12b67cbf3d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:21.210051 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16789701-b7d5-4f17-b3bb-8f12b67cbf3d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:21.211426 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16789701-b7d5-4f17-b3bb-8f12b67cbf3d None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:21.231521 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 363/718] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 2 21:28:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:21.236882 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95131d7a-b81d-484c-b577-dd5b96e283e1 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:21.365689 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:21.371567 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95131d7a-b81d-484c-b577-dd5b96e283e1 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:21.408702 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f7271e-7361-48e9-872f-615779d4b6b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:21.409683 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f7271e-7361-48e9-872f-615779d4b6b3 None admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:21.410179 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f7271e-7361-48e9-872f-615779d4b6b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:21.410683 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f7271e-7361-48e9-872f-615779d4b6b3 None admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:21.411558 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f7271e-7361-48e9-872f-615779d4b6b3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:21.413226 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f7271e-7361-48e9-872f-615779d4b6b3 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:21.438034 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 356/719] 10.222.0.70 () {60 vars in 1132 bytes} [Tue Aug 2 21:28:21 2022] POST /identity/v3/users => generated 254 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:28:21.861816 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40724e2d-50cd-4899-b4c0-52f1f8f3eae3 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:21.862182 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40724e2d-50cd-4899-b4c0-52f1f8f3eae3 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:21.862384 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40724e2d-50cd-4899-b4c0-52f1f8f3eae3 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:21.864303 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 364/720] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:28:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:28:21.869600 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe19ec5-82ef-47ff-9c14-24a50884f6b5 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:21.870604 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe19ec5-82ef-47ff-9c14-24a50884f6b5 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:21.870719 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe19ec5-82ef-47ff-9c14-24a50884f6b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:21.894381 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-bbe19ec5-82ef-47ff-9c14-24a50884f6b5 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:28:21.895596 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-bbe19ec5-82ef-47ff-9c14-24a50884f6b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:28:21.970416 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 357/721] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:28:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:28:21.992920 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40724e2d-50cd-4899-b4c0-52f1f8f3eae3 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:22.098781 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:22.129665 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40724e2d-50cd-4899-b4c0-52f1f8f3eae3 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:22.176670 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45face9b-3f82-4cc2-9307-4ce6e3ca02a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:22.177983 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45face9b-3f82-4cc2-9307-4ce6e3ca02a7 None admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:22.178511 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45face9b-3f82-4cc2-9307-4ce6e3ca02a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:22.178939 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45face9b-3f82-4cc2-9307-4ce6e3ca02a7 None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:22.179835 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45face9b-3f82-4cc2-9307-4ce6e3ca02a7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:22.181381 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45face9b-3f82-4cc2-9307-4ce6e3ca02a7 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:22.221376 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 365/722] 10.222.0.70 () {60 vars in 1141 bytes} [Tue Aug 2 21:28:21 2022] POST /identity/v3/services => generated 251 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:28:22.638336 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e25160-53bc-4bb1-b110-f5354cdaed10 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:22.638682 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e25160-53bc-4bb1-b110-f5354cdaed10 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:22.638885 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e25160-53bc-4bb1-b110-f5354cdaed10 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:22.640589 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 358/723] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:28:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:28:22.645864 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe30ea36-11db-4328-be23-c9238d57336f None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:22.646161 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe30ea36-11db-4328-be23-c9238d57336f None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:22.646445 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe30ea36-11db-4328-be23-c9238d57336f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:22.670447 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-fe30ea36-11db-4328-be23-c9238d57336f None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:28:22.671647 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-fe30ea36-11db-4328-be23-c9238d57336f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:28:22.784350 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 366/724] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:28:22 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:28:22.804574 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e25160-53bc-4bb1-b110-f5354cdaed10 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:22.930431 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:22.956913 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e25160-53bc-4bb1-b110-f5354cdaed10 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:22.978393 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f612d1f5-830c-41d6-a06d-3661e93bda69 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:22.978691 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f612d1f5-830c-41d6-a06d-3661e93bda69 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:22.978950 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f612d1f5-830c-41d6-a06d-3661e93bda69 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:22.980645 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 367/725] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:28:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 21:28:22.988260 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2d2b1b-2ced-45e6-bd29-73814cc173ee None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:22.988260 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2d2b1b-2ced-45e6-bd29-73814cc173ee None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:22.988260 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2d2b1b-2ced-45e6-bd29-73814cc173ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:22.999556 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c832e835-d1a7-4b2b-ad85-4dba78df9c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:23.000204 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c832e835-d1a7-4b2b-ad85-4dba78df9c03 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:23.000520 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c832e835-d1a7-4b2b-ad85-4dba78df9c03 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:23.000799 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c832e835-d1a7-4b2b-ad85-4dba78df9c03 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:23.012814 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c832e835-d1a7-4b2b-ad85-4dba78df9c03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:28:23.018299 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-c832e835-d1a7-4b2b-ad85-4dba78df9c03 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 21:28:23.018299 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:23.018299 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:23.018299 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:23.018299 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:23.018299 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:23.018299 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:23.018299 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:23.018299 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:23.018299 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:23.018299 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:23.018299 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:23.018299 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:28:23.018299 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:28:23.018299 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:28:23.018299 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:28:23.019238 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:28:23.019238 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:28:23.019238 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:28:23.019238 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:28:23.019238 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:23.019238 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:23.019238 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:23.019238 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:23.019238 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:23.019238 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:23.019238 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:23.019238 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:23.019238 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:23.019238 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:23.019238 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:23.019238 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:23.020065 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:23.020065 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:23.020065 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:23.020065 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:23.020065 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:28:23.020065 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:28:23.020065 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:28:23.020065 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:28:23.020065 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:28:23.020065 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:28:23.020065 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 21:28:23.020065 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:28:23.022177 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-6c2d2b1b-2ced-45e6-bd29-73814cc173ee None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:28:23.023647 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-6c2d2b1b-2ced-45e6-bd29-73814cc173ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:28:23.024418 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 359/726] 10.222.0.70 () {56 vars in 1096 bytes} [Tue Aug 2 21:28:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:23.025596 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c832e835-d1a7-4b2b-ad85-4dba78df9c03 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:23.159671 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:23.167796 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 368/727] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:28:22 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 02 21:28:23.196313 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c832e835-d1a7-4b2b-ad85-4dba78df9c03 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:23.214646 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2d2b1b-2ced-45e6-bd29-73814cc173ee None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:23.256460 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa083d7-eb8f-400a-8656-93e6987f80d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:23.257084 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa083d7-eb8f-400a-8656-93e6987f80d9 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:23.257364 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa083d7-eb8f-400a-8656-93e6987f80d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:23.257634 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa083d7-eb8f-400a-8656-93e6987f80d9 None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:23.258352 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa083d7-eb8f-400a-8656-93e6987f80d9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:23.258656 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa083d7-eb8f-400a-8656-93e6987f80d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:23.260111 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa083d7-eb8f-400a-8656-93e6987f80d9 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:23.269729 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 360/728] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 2 21:28:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:28:23.289303 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa083d7-eb8f-400a-8656-93e6987f80d9 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:23.304811 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:23.352758 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2d2b1b-2ced-45e6-bd29-73814cc173ee None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:23.389615 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21964706-21b6-4422-9961-b465b606f197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:23.390284 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21964706-21b6-4422-9961-b465b606f197 None admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:23.390573 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21964706-21b6-4422-9961-b465b606f197 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:23.390850 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21964706-21b6-4422-9961-b465b606f197 None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:23.391541 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21964706-21b6-4422-9961-b465b606f197 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:23.392936 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21964706-21b6-4422-9961-b465b606f197 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:23.409339 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 369/729] 10.222.0.70 () {60 vars in 1141 bytes} [Tue Aug 2 21:28:23 2022] POST /identity/v3/services => generated 240 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 21:28:23.410636 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419a96da-bc29-41a5-af72-3b58a7197bd4 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:23.411037 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419a96da-bc29-41a5-af72-3b58a7197bd4 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:23.411365 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419a96da-bc29-41a5-af72-3b58a7197bd4 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:23.413006 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 370/730] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:28:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:28:23.418268 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec85859b-bdd6-48c0-aff0-caa48a58f7bc None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:23.418552 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec85859b-bdd6-48c0-aff0-caa48a58f7bc None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:23.418826 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec85859b-bdd6-48c0-aff0-caa48a58f7bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:23.449990 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-ec85859b-bdd6-48c0-aff0-caa48a58f7bc None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:28:23.451137 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-ec85859b-bdd6-48c0-aff0-caa48a58f7bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:28:23.459013 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa083d7-eb8f-400a-8656-93e6987f80d9 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:23.540549 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ae9c3b-db8c-40d2-9f84-a2073fd2ebb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:23.541214 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ae9c3b-db8c-40d2-9f84-a2073fd2ebb5 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:23.541529 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ae9c3b-db8c-40d2-9f84-a2073fd2ebb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:23.541810 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ae9c3b-db8c-40d2-9f84-a2073fd2ebb5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:23.562039 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ae9c3b-db8c-40d2-9f84-a2073fd2ebb5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:23.563512 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ae9c3b-db8c-40d2-9f84-a2073fd2ebb5 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:23.570904 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:23.593683 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 371/731] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:28:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 21:28:23.602919 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-55ae9c3b-db8c-40d2-9f84-a2073fd2ebb5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:23.602919 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:23.602919 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:23.602919 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:23.602919 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:23.602919 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:23.602919 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:23.602919 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:23.602919 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:23.602919 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:23.602919 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:23.602919 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:23.602919 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:28:23.602919 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:28:23.602919 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:28:23.604806 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:28:23.604806 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:23.604806 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:23.604806 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:23.604806 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:23.604806 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:23.604806 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:23.604806 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:23.604806 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:23.604806 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:23.604806 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:23.604806 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:23.604806 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:23.604806 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:23.604806 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:23.604806 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:23.604806 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:23.605997 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:28:23.605997 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:28:23.605997 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:23.605997 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:28:23.605997 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 361/732] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 2 21:28:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:23.611823 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec85859b-bdd6-48c0-aff0-caa48a58f7bc None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:23.624932 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ae9c3b-db8c-40d2-9f84-a2073fd2ebb5 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:23.690153 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:23.739173 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec85859b-bdd6-48c0-aff0-caa48a58f7bc None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:23.742594 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ae9c3b-db8c-40d2-9f84-a2073fd2ebb5 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:23.782697 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a2727d-e30e-48f9-b8a3-25cdaadf4c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:23.783634 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a2727d-e30e-48f9-b8a3-25cdaadf4c8f None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:23.784098 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a2727d-e30e-48f9-b8a3-25cdaadf4c8f None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:23.784691 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a2727d-e30e-48f9-b8a3-25cdaadf4c8f None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:23.785716 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a2727d-e30e-48f9-b8a3-25cdaadf4c8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:23.786223 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a2727d-e30e-48f9-b8a3-25cdaadf4c8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:23.787765 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a2727d-e30e-48f9-b8a3-25cdaadf4c8f None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:23.793149 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca930c4-7002-40ba-b08c-c064e5da45d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:23.794091 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca930c4-7002-40ba-b08c-c064e5da45d3 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:23.797498 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca930c4-7002-40ba-b08c-c064e5da45d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:23.797970 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca930c4-7002-40ba-b08c-c064e5da45d3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:23.809790 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 372/733] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 2 21:28:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:23.815352 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a2727d-e30e-48f9-b8a3-25cdaadf4c8f None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:23.820330 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca930c4-7002-40ba-b08c-c064e5da45d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:28:23.826570 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-aca930c4-7002-40ba-b08c-c064e5da45d3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 21:28:23.826570 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:23.826570 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:23.826570 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:23.826570 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:23.826570 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:23.826570 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:23.826570 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:23.826570 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:23.826570 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:23.826570 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:23.826570 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:23.826570 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:28:23.826570 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:28:23.826570 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:28:23.826570 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:28:23.827526 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:28:23.827526 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:28:23.827526 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:28:23.827526 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:28:23.827526 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:23.827526 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:23.827526 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:23.827526 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:23.827526 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:23.827526 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:23.827526 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:23.827526 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:23.827526 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:23.827526 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:23.827526 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:23.827526 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:23.828407 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:23.828407 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:23.828407 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:23.828407 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:23.828407 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:28:23.828407 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:28:23.828407 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:28:23.828407 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:28:23.828407 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:28:23.828407 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:28:23.828407 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 21:28:23.828407 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:28:23.830823 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 362/734] 10.222.0.70 () {56 vars in 1096 bytes} [Tue Aug 2 21:28:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:23.836604 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca930c4-7002-40ba-b08c-c064e5da45d3 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:23.918094 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:23.948570 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca930c4-7002-40ba-b08c-c064e5da45d3 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:23.964355 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:23.986380 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65696ceb-59cc-431b-b4a7-d764b0dedd86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:23.987239 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65696ceb-59cc-431b-b4a7-d764b0dedd86 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:23.987676 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65696ceb-59cc-431b-b4a7-d764b0dedd86 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:23.988479 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65696ceb-59cc-431b-b4a7-d764b0dedd86 None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:23.989455 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65696ceb-59cc-431b-b4a7-d764b0dedd86 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:23.989912 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65696ceb-59cc-431b-b4a7-d764b0dedd86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:23.991430 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65696ceb-59cc-431b-b4a7-d764b0dedd86 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:24.000611 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 363/735] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 2 21:28:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:28:24.006075 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a2727d-e30e-48f9-b8a3-25cdaadf4c8f None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:24.006523 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65696ceb-59cc-431b-b4a7-d764b0dedd86 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:24.052896 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8c7a2d-1e84-4ece-9c35-e2915fb03dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:24.053827 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c7a2d-1e84-4ece-9c35-e2915fb03dcc None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:24.058313 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c7a2d-1e84-4ece-9c35-e2915fb03dcc None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:24.058779 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8c7a2d-1e84-4ece-9c35-e2915fb03dcc None admin] PATH_INFO: `/v3/users/swift` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:24.071877 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8c7a2d-1e84-4ece-9c35-e2915fb03dcc None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:24.076021 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8c7a2d-1e84-4ece-9c35-e2915fb03dcc None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:24.096668 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-fd8c7a2d-1e84-4ece-9c35-e2915fb03dcc None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 02 21:28:24.096668 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:24.096668 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:24.096668 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:24.096668 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:24.096668 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:24.096668 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:24.096668 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:24.096668 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:24.096668 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:24.096668 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:24.096668 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:24.096668 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 21:28:24.096668 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 21:28:24.096668 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 21:28:24.096668 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 21:28:24.097877 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:24.097877 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:24.097877 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 21:28:24.097877 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:28:24.097877 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 21:28:24.097877 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:28:24.097877 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:24.097877 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:24.097877 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:24.097877 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:24.097877 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:24.097877 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:24.097877 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:24.097877 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:24.097877 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:24.097877 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:24.097877 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:24.097877 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:24.099027 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:24.099027 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:24.099027 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 21:28:24.099027 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 21:28:24.099027 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 21:28:24.099027 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 21:28:24.099027 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 21:28:24.099027 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 21:28:24.099027 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 02 21:28:24.099027 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:24.102200 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 373/736] 10.222.0.70 () {56 vars in 1096 bytes} [Tue Aug 2 21:28:23 2022] GET /identity/v3/users/swift => generated 83 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 21:28:24.107841 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8c7a2d-1e84-4ece-9c35-e2915fb03dcc None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:24.183456 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65696ceb-59cc-431b-b4a7-d764b0dedd86 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:24.222746 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e640cc-c4a2-46fa-9cc2-7817721ffa34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:24.222972 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e640cc-c4a2-46fa-9cc2-7817721ffa34 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:24.223258 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e640cc-c4a2-46fa-9cc2-7817721ffa34 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:24.223538 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e640cc-c4a2-46fa-9cc2-7817721ffa34 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:24.234801 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e640cc-c4a2-46fa-9cc2-7817721ffa34 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:24.236284 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e640cc-c4a2-46fa-9cc2-7817721ffa34 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:24.252399 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-55e640cc-c4a2-46fa-9cc2-7817721ffa34 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:24.252399 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:24.252399 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:24.252399 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:24.252399 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:24.252399 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:24.252399 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:24.252399 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:24.252399 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:24.252399 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:24.252399 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:24.252399 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:24.252399 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:28:24.252399 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:28:24.252399 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:28:24.253317 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:28:24.253317 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:24.253317 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:24.253317 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:24.253317 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:24.253317 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:24.253317 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:24.253317 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:24.253317 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:24.253317 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:24.253317 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:24.253317 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:24.253317 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:24.253317 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:24.253317 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:24.253317 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:24.253317 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:24.254314 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:28:24.254314 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:28:24.254314 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:24.254314 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:28:24.254314 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 364/737] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 2 21:28:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 21:28:24.255031 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034d6988-4fb5-4246-af9e-ed794f599c72 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:24.255199 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034d6988-4fb5-4246-af9e-ed794f599c72 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:24.255473 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034d6988-4fb5-4246-af9e-ed794f599c72 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:24.262315 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 365/738] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:28:24 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:28:24.266971 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034d6988-4fb5-4246-af9e-ed794f599c72 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:24.267106 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8c7a2d-1e84-4ece-9c35-e2915fb03dcc None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:24.280144 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:24.298340 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:24.325352 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8927aa01-5ee2-4eaa-8c8a-bb5af83302d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:24.325352 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8927aa01-5ee2-4eaa-8c8a-bb5af83302d3 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:24.326125 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8927aa01-5ee2-4eaa-8c8a-bb5af83302d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:24.326659 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8927aa01-5ee2-4eaa-8c8a-bb5af83302d3 None admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:24.327870 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8927aa01-5ee2-4eaa-8c8a-bb5af83302d3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:24.328344 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8927aa01-5ee2-4eaa-8c8a-bb5af83302d3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:24.331308 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8927aa01-5ee2-4eaa-8c8a-bb5af83302d3 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:24.359666 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 374/739] 10.222.0.70 () {56 vars in 1135 bytes} [Tue Aug 2 21:28:24 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:28:24.361406 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bb3603-5682-416c-9129-d33c089626bb None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:24.361704 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bb3603-5682-416c-9129-d33c089626bb None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:24.362035 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bb3603-5682-416c-9129-d33c089626bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:24.387714 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-05bb3603-5682-416c-9129-d33c089626bb None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:28:24.388524 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034d6988-4fb5-4246-af9e-ed794f599c72 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:24.388965 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-05bb3603-5682-416c-9129-d33c089626bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:28:24.424891 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa170bb-5f48-4514-9015-5de8f3ff7a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:24.425703 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa170bb-5f48-4514-9015-5de8f3ff7a02 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:24.426091 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa170bb-5f48-4514-9015-5de8f3ff7a02 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:24.426472 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa170bb-5f48-4514-9015-5de8f3ff7a02 None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:24.427273 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa170bb-5f48-4514-9015-5de8f3ff7a02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:24.427684 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa170bb-5f48-4514-9015-5de8f3ff7a02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:24.429211 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa170bb-5f48-4514-9015-5de8f3ff7a02 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:24.447812 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 366/740] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 2 21:28:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:24.448792 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa170bb-5f48-4514-9015-5de8f3ff7a02 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:24.474149 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 375/741] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:28:24 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 21:28:24.475150 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bb3603-5682-416c-9129-d33c089626bb None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:24.561640 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:24.575999 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa170bb-5f48-4514-9015-5de8f3ff7a02 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:24.611512 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11437a8a-acb4-4952-8d3a-94b7049a7d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:24.611747 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:24.612417 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11437a8a-acb4-4952-8d3a-94b7049a7d72 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:24.612802 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11437a8a-acb4-4952-8d3a-94b7049a7d72 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:24.613428 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11437a8a-acb4-4952-8d3a-94b7049a7d72 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:24.620353 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bb3603-5682-416c-9129-d33c089626bb None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:24.668341 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1267ba-1cd3-4ce0-9a64-255f3649053e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:24.668997 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1267ba-1cd3-4ce0-9a64-255f3649053e None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:24.669468 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1267ba-1cd3-4ce0-9a64-255f3649053e None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:24.669745 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1267ba-1cd3-4ce0-9a64-255f3649053e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:24.680850 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1267ba-1cd3-4ce0-9a64-255f3649053e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:24.683212 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1267ba-1cd3-4ce0-9a64-255f3649053e None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:24.692996 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11437a8a-acb4-4952-8d3a-94b7049a7d72 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:24.694460 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11437a8a-acb4-4952-8d3a-94b7049a7d72 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:24.704453 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-ba1267ba-1cd3-4ce0-9a64-255f3649053e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 02 21:28:24.704453 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:24.704453 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:24.704453 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:24.704453 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:24.704453 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:24.704453 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:24.704453 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:24.704453 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:24.704453 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:24.704453 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:24.704453 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:24.704453 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 21:28:24.704453 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 21:28:24.704453 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 21:28:24.704453 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 21:28:24.705417 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:24.705417 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:24.705417 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 21:28:24.705417 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:28:24.705417 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 21:28:24.705417 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:28:24.705417 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:24.705417 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:24.705417 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:24.705417 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:24.705417 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:24.705417 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:24.705417 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:24.705417 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:24.705417 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:24.705417 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:24.705417 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:24.705417 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:24.706637 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:24.706637 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:24.706637 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 21:28:24.706637 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 21:28:24.706637 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 21:28:24.706637 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 21:28:24.706637 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 21:28:24.706637 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 21:28:24.706637 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 02 21:28:24.706637 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:24.711005 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 376/742] 10.222.0.70 () {56 vars in 1093 bytes} [Tue Aug 2 21:28:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:24.712156 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1267ba-1cd3-4ce0-9a64-255f3649053e None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:24.816595 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:24.831114 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1267ba-1cd3-4ce0-9a64-255f3649053e None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:24.835049 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 367/743] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 2 21:28:24 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 21:28:24.836039 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11437a8a-acb4-4952-8d3a-94b7049a7d72 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:24.878585 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea56bfef-c4a7-499c-8225-3020c5cee075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:24.879778 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea56bfef-c4a7-499c-8225-3020c5cee075 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:24.880250 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea56bfef-c4a7-499c-8225-3020c5cee075 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:24.880671 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea56bfef-c4a7-499c-8225-3020c5cee075 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:24.896868 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea56bfef-c4a7-499c-8225-3020c5cee075 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:28:24.906402 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-ea56bfef-c4a7-499c-8225-3020c5cee075 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 21:28:24.906402 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:24.906402 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:24.906402 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:24.906402 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:24.906402 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:24.906402 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:24.906402 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:24.906402 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:24.906402 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:24.906402 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:24.906402 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:24.906402 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:28:24.906402 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:28:24.906402 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:28:24.906402 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:28:24.907514 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:28:24.907514 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:28:24.907514 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:28:24.907514 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:28:24.907514 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:24.907514 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:24.907514 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:24.907514 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:24.907514 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:24.907514 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:24.907514 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:24.907514 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:24.907514 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:24.907514 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:24.907514 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:24.907514 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:24.908566 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:24.908566 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:24.908566 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:24.908566 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:24.908566 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:28:24.908566 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:28:24.908566 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:28:24.908566 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:28:24.908566 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:28:24.908566 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:28:24.908566 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 21:28:24.908566 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:24.917283 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 377/744] 10.222.0.70 () {56 vars in 1102 bytes} [Tue Aug 2 21:28:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:24.917283 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea56bfef-c4a7-499c-8225-3020c5cee075 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:24.937238 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:24.979855 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11437a8a-acb4-4952-8d3a-94b7049a7d72 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:25.023733 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea56bfef-c4a7-499c-8225-3020c5cee075 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:25.027707 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a20d5d9-2a91-4794-b8dd-385c62221907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:25.028806 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a20d5d9-2a91-4794-b8dd-385c62221907 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:25.029293 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a20d5d9-2a91-4794-b8dd-385c62221907 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:25.029781 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a20d5d9-2a91-4794-b8dd-385c62221907 None admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:25.030775 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a20d5d9-2a91-4794-b8dd-385c62221907 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:25.031282 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a20d5d9-2a91-4794-b8dd-385c62221907 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:25.033335 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a20d5d9-2a91-4794-b8dd-385c62221907 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:25.054087 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 368/745] 10.222.0.70 () {56 vars in 1133 bytes} [Tue Aug 2 21:28:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:25.054885 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a20d5d9-2a91-4794-b8dd-385c62221907 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:25.062189 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef99eac-b0f1-4036-80f4-c70dc15efbe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:25.062832 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef99eac-b0f1-4036-80f4-c70dc15efbe6 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:25.063111 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef99eac-b0f1-4036-80f4-c70dc15efbe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:25.063385 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef99eac-b0f1-4036-80f4-c70dc15efbe6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:25.075118 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef99eac-b0f1-4036-80f4-c70dc15efbe6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:25.076515 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef99eac-b0f1-4036-80f4-c70dc15efbe6 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:25.091106 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-4ef99eac-b0f1-4036-80f4-c70dc15efbe6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:25.091106 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:25.091106 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:25.091106 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:25.091106 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:25.091106 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:25.091106 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:25.091106 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:25.091106 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:25.091106 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:25.091106 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:25.091106 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:25.091106 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:28:25.091106 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:28:25.091106 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:28:25.092026 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:28:25.092026 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:25.092026 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:25.092026 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:25.092026 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:25.092026 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:25.092026 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:25.092026 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:25.092026 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:25.092026 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:25.092026 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:25.092026 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:25.092026 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:25.092026 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:25.092026 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:25.092026 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:25.092026 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:25.092971 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:28:25.092971 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:28:25.092971 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:25.092971 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:25.092971 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 378/746] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 2 21:28:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:25.094744 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a669f6-a3d2-4011-8e3b-ac7d03b35fb8 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:25.094744 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a669f6-a3d2-4011-8e3b-ac7d03b35fb8 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:25.094744 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a669f6-a3d2-4011-8e3b-ac7d03b35fb8 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:25.099147 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 379/747] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:28:25 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:28:25.099147 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a669f6-a3d2-4011-8e3b-ac7d03b35fb8 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:25.110731 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:25.168195 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a20d5d9-2a91-4794-b8dd-385c62221907 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:25.176896 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:25.204025 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01c6b33-b2f7-4598-934c-0684cab4611f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:25.204606 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c6b33-b2f7-4598-934c-0684cab4611f None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:25.204887 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c6b33-b2f7-4598-934c-0684cab4611f None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:25.205357 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01c6b33-b2f7-4598-934c-0684cab4611f None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:25.205859 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01c6b33-b2f7-4598-934c-0684cab4611f None admin] RBAC: Adding query filter params (name=service) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:25.206161 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01c6b33-b2f7-4598-934c-0684cab4611f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:25.207618 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01c6b33-b2f7-4598-934c-0684cab4611f None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:25.216055 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a669f6-a3d2-4011-8e3b-ac7d03b35fb8 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:25.221679 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 369/748] 10.222.0.70 () {56 vars in 1103 bytes} [Tue Aug 2 21:28:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:25.222554 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01c6b33-b2f7-4598-934c-0684cab4611f None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:25.250638 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b98008-b728-4a58-9821-81ff38dea6b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:25.251267 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b98008-b728-4a58-9821-81ff38dea6b4 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:25.251558 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b98008-b728-4a58-9821-81ff38dea6b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:25.251838 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b98008-b728-4a58-9821-81ff38dea6b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:25.263820 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b98008-b728-4a58-9821-81ff38dea6b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:25.265881 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b98008-b728-4a58-9821-81ff38dea6b4 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:25.292954 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-81b98008-b728-4a58-9821-81ff38dea6b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:25.292954 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:25.292954 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:25.292954 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:25.292954 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:25.292954 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:25.292954 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:25.292954 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:25.292954 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:25.292954 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:25.292954 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:25.292954 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:25.292954 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:28:25.292954 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:28:25.292954 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:28:25.294313 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:28:25.294313 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:25.294313 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:25.294313 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:25.294313 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:25.294313 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:25.294313 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:25.294313 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:25.294313 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:25.294313 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:25.294313 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:25.294313 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:25.294313 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:25.294313 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:25.294313 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:25.294313 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:25.294313 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:25.295204 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:28:25.295204 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:28:25.295204 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:25.295204 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:25.295204 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 380/749] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 2 21:28:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:25.295204 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc55cd06-0499-4f09-a74b-1cf68b0f27b5 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:25.295204 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc55cd06-0499-4f09-a74b-1cf68b0f27b5 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:25.295204 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc55cd06-0499-4f09-a74b-1cf68b0f27b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:25.312260 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-fc55cd06-0499-4f09-a74b-1cf68b0f27b5 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:28:25.313659 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-fc55cd06-0499-4f09-a74b-1cf68b0f27b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:28:25.329689 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01c6b33-b2f7-4598-934c-0684cab4611f None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:25.339929 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:25.367926 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef58af77-7b59-4b24-ab9b-3242eca0a10a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:25.368684 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef58af77-7b59-4b24-ab9b-3242eca0a10a None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:25.368972 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef58af77-7b59-4b24-ab9b-3242eca0a10a None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:25.369250 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef58af77-7b59-4b24-ab9b-3242eca0a10a None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:25.369948 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef58af77-7b59-4b24-ab9b-3242eca0a10a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:25.370257 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef58af77-7b59-4b24-ab9b-3242eca0a10a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:25.371628 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef58af77-7b59-4b24-ab9b-3242eca0a10a None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:25.388316 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 370/750] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 2 21:28:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:25.388316 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef58af77-7b59-4b24-ab9b-3242eca0a10a None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:25.396985 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 381/751] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:28:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 21:28:25.398550 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc55cd06-0499-4f09-a74b-1cf68b0f27b5 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:25.452106 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:25.492312 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef58af77-7b59-4b24-ab9b-3242eca0a10a None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:25.508951 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc55cd06-0499-4f09-a74b-1cf68b0f27b5 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:25.528920 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fa7943-76f9-4a9b-911b-9c8b63fbc232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:25.529561 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa7943-76f9-4a9b-911b-9c8b63fbc232 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:25.529852 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa7943-76f9-4a9b-911b-9c8b63fbc232 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:25.530130 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa7943-76f9-4a9b-911b-9c8b63fbc232 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:25.540382 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fa7943-76f9-4a9b-911b-9c8b63fbc232 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:25.541936 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fa7943-76f9-4a9b-911b-9c8b63fbc232 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:25.547213 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d7aa7b-ceb4-40a4-aeb4-07864c1f51b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:25.548080 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d7aa7b-ceb4-40a4-aeb4-07864c1f51b9 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:25.548543 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d7aa7b-ceb4-40a4-aeb4-07864c1f51b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:25.548975 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d7aa7b-ceb4-40a4-aeb4-07864c1f51b9 None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:25.549854 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d7aa7b-ceb4-40a4-aeb4-07864c1f51b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:25.550303 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d7aa7b-ceb4-40a4-aeb4-07864c1f51b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:25.551918 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d7aa7b-ceb4-40a4-aeb4-07864c1f51b9 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:25.557660 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-98fa7943-76f9-4a9b-911b-9c8b63fbc232 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:25.557660 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:25.557660 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:25.557660 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:25.557660 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:25.557660 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:25.557660 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:25.557660 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:25.557660 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:25.557660 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:25.557660 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:25.557660 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:25.557660 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:28:25.557660 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:28:25.557660 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:28:25.558759 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:28:25.558759 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:25.558759 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:25.558759 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:25.558759 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:25.558759 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:25.558759 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:25.558759 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:25.558759 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:25.558759 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:25.558759 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:25.558759 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:25.558759 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:25.558759 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:25.558759 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:25.558759 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:25.558759 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:25.559854 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:28:25.559854 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:28:25.559854 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:25.559854 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:28:25.559854 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 371/752] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 2 21:28:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:25.560128 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fa7943-76f9-4a9b-911b-9c8b63fbc232 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:25.573917 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 382/753] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 2 21:28:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:25.574457 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d7aa7b-ceb4-40a4-aeb4-07864c1f51b9 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:25.585279 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:25.669706 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fa7943-76f9-4a9b-911b-9c8b63fbc232 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:25.691460 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d7aa7b-ceb4-40a4-aeb4-07864c1f51b9 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:25.702483 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:25.710734 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9074672-7a17-402e-b0bc-3cc2fe202048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:25.711392 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9074672-7a17-402e-b0bc-3cc2fe202048 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:25.711675 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9074672-7a17-402e-b0bc-3cc2fe202048 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:25.711953 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9074672-7a17-402e-b0bc-3cc2fe202048 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:25.718839 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9074672-7a17-402e-b0bc-3cc2fe202048 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:25.720314 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9074672-7a17-402e-b0bc-3cc2fe202048 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:25.725838 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0d4d06-5bae-4219-b46b-d38306e723ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:25.726487 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0d4d06-5bae-4219-b46b-d38306e723ed None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:25.726770 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0d4d06-5bae-4219-b46b-d38306e723ed None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:25.727047 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0d4d06-5bae-4219-b46b-d38306e723ed None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:25.727672 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0d4d06-5bae-4219-b46b-d38306e723ed None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:25.729086 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0d4d06-5bae-4219-b46b-d38306e723ed None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:25.731484 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-d9074672-7a17-402e-b0bc-3cc2fe202048 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:28:25.731484 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:25.731484 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:25.731484 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:25.731484 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:25.731484 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:25.731484 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:25.731484 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:25.731484 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:25.731484 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:25.731484 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:25.731484 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:25.731484 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 21:28:25.731484 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 21:28:25.731484 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 21:28:25.732388 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 21:28:25.732388 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:25.732388 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:25.732388 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:25.732388 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:25.732388 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:25.732388 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:25.732388 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:25.732388 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:25.732388 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:25.732388 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:25.732388 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:25.732388 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:25.732388 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:25.732388 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:25.732388 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:25.732388 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:25.733290 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 21:28:25.733290 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 21:28:25.733290 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 21:28:25.733290 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 21:28:25.733290 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 21:28:25.733290 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 21:28:25.733290 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:28:25.733290 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:28:25.733290 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 372/754] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Aug 2 21:28:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:25.733776 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9074672-7a17-402e-b0bc-3cc2fe202048 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:25.741005 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-ac0d4d06-5bae-4219-b46b-d38306e723ed None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 02 21:28:25.741005 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:25.741005 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 21:28:25.741005 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 21:28:25.741005 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 21:28:25.741005 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 21:28:25.741005 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 21:28:25.741005 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 21:28:25.741005 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 02 21:28:25.741005 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:25.741005 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 21:28:25.741005 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:25.741005 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:25.741005 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:25.741005 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:25.741005 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:25.741919 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:25.741919 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:25.741919 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:25.741919 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:25.741919 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:25.741919 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:25.741919 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:25.741919 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 21:28:25.741919 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 21:28:25.741919 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 21:28:25.741919 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 21:28:25.741919 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:25.741919 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:25.741919 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:25.741919 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:25.741919 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:25.742733 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:25.742733 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:25.742733 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:25.742733 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:25.742733 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:25.742733 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:25.742733 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:25.742733 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:25.742733 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:25.742733 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:25.742733 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:25.742733 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 21:28:25.742733 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 21:28:25.742733 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 02 21:28:25.742733 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:25.742733 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 383/755] 10.222.0.70 () {56 vars in 1129 bytes} [Tue Aug 2 21:28:25 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:25.743661 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0d4d06-5bae-4219-b46b-d38306e723ed None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:25.814673 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:25.834201 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9074672-7a17-402e-b0bc-3cc2fe202048 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:25.843309 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0d4d06-5bae-4219-b46b-d38306e723ed None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:25.866638 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0192d1-2f85-46b0-a2c9-fb1c2fa92d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:25.867246 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0192d1-2f85-46b0-a2c9-fb1c2fa92d1e None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:25.867527 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0192d1-2f85-46b0-a2c9-fb1c2fa92d1e None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:25.867803 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0192d1-2f85-46b0-a2c9-fb1c2fa92d1e None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:25.868599 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0192d1-2f85-46b0-a2c9-fb1c2fa92d1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:25.868903 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0192d1-2f85-46b0-a2c9-fb1c2fa92d1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:25.870783 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0192d1-2f85-46b0-a2c9-fb1c2fa92d1e None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:25.876509 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1847fffd-49a0-43e5-b582-8c7371c35aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:25.877145 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1847fffd-49a0-43e5-b582-8c7371c35aea None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:25.877430 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1847fffd-49a0-43e5-b582-8c7371c35aea None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:25.877708 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1847fffd-49a0-43e5-b582-8c7371c35aea None admin] PATH_INFO: `/v3/projects/service` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:25.882986 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 373/756] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 2 21:28:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:25.884165 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429392c3-3c84-4ec1-b3e8-628079c2f7bc None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:25.884467 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1847fffd-49a0-43e5-b582-8c7371c35aea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:25.884569 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429392c3-3c84-4ec1-b3e8-628079c2f7bc None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:25.884748 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429392c3-3c84-4ec1-b3e8-628079c2f7bc None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:25.886461 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1847fffd-49a0-43e5-b582-8c7371c35aea None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:25.890473 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 374/757] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:28:25 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:28:25.891237 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429392c3-3c84-4ec1-b3e8-628079c2f7bc None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:25.899091 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-1847fffd-49a0-43e5-b582-8c7371c35aea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:28:25.899091 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:25.899091 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:25.899091 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:25.899091 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:25.899091 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:25.899091 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:25.899091 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:25.899091 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:25.899091 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:25.899091 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:25.899091 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:25.899091 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 21:28:25.899091 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 21:28:25.899091 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 21:28:25.900167 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 21:28:25.900167 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:25.900167 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:25.900167 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:25.900167 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:25.900167 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:25.900167 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:25.900167 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:25.900167 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:25.900167 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:25.900167 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:25.900167 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:25.900167 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:25.900167 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:25.900167 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:25.900167 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:25.900167 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:25.901720 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 21:28:25.901720 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 21:28:25.901720 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 21:28:25.901720 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 21:28:25.901720 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 21:28:25.901720 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 21:28:25.901720 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:28:25.901720 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:25.901720 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 384/758] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Aug 2 21:28:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:25.901720 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1847fffd-49a0-43e5-b582-8c7371c35aea None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:25.935577 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:25.994924 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429392c3-3c84-4ec1-b3e8-628079c2f7bc None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:26.000162 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1847fffd-49a0-43e5-b582-8c7371c35aea None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:26.030418 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ab04ff-ce34-403f-b33e-3906bab7308b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:26.031030 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ab04ff-ce34-403f-b33e-3906bab7308b None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:26.031316 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ab04ff-ce34-403f-b33e-3906bab7308b None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:26.031596 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ab04ff-ce34-403f-b33e-3906bab7308b None admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:26.032389 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ab04ff-ce34-403f-b33e-3906bab7308b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:26.032704 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ab04ff-ce34-403f-b33e-3906bab7308b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:26.033886 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cad09a-cc20-4c6e-b4f7-1bd74171e83a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:26.034132 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ab04ff-ce34-403f-b33e-3906bab7308b None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:26.034494 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cad09a-cc20-4c6e-b4f7-1bd74171e83a None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:26.034777 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cad09a-cc20-4c6e-b4f7-1bd74171e83a None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:26.035052 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cad09a-cc20-4c6e-b4f7-1bd74171e83a None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:26.035718 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cad09a-cc20-4c6e-b4f7-1bd74171e83a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:26.036022 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cad09a-cc20-4c6e-b4f7-1bd74171e83a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:26.037417 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cad09a-cc20-4c6e-b4f7-1bd74171e83a None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:26.044212 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 385/759] 10.222.0.70 () {56 vars in 1124 bytes} [Tue Aug 2 21:28:25 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:26.044212 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cad09a-cc20-4c6e-b4f7-1bd74171e83a None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:26.053625 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:26.053625 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 375/760] 10.222.0.70 () {56 vars in 1148 bytes} [Tue Aug 2 21:28:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:26.053625 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eee9c56-809e-48e8-a3dd-a07f67b60a7c None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:26.053625 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eee9c56-809e-48e8-a3dd-a07f67b60a7c None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:26.053625 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eee9c56-809e-48e8-a3dd-a07f67b60a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:26.069027 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-1eee9c56-809e-48e8-a3dd-a07f67b60a7c None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:28:26.070235 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-1eee9c56-809e-48e8-a3dd-a07f67b60a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:28:26.136006 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 376/761] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:28:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 21:28:26.136774 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eee9c56-809e-48e8-a3dd-a07f67b60a7c None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:26.156200 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:26.161191 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cad09a-cc20-4c6e-b4f7-1bd74171e83a None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:26.193777 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b823527c-2e78-4cb7-8185-ecceec98030b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:26.194409 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b823527c-2e78-4cb7-8185-ecceec98030b None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:26.194693 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b823527c-2e78-4cb7-8185-ecceec98030b None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:26.194967 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b823527c-2e78-4cb7-8185-ecceec98030b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:26.202845 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b823527c-2e78-4cb7-8185-ecceec98030b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:26.204299 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b823527c-2e78-4cb7-8185-ecceec98030b None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:26.215894 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-b823527c-2e78-4cb7-8185-ecceec98030b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 02 21:28:26.215894 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:26.215894 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:26.215894 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:26.215894 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:26.215894 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:26.215894 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:26.215894 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:26.215894 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:26.215894 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:26.215894 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:26.215894 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:26.215894 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 21:28:26.215894 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 21:28:26.215894 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 21:28:26.215894 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 21:28:26.216898 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:26.216898 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:26.216898 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 21:28:26.216898 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:28:26.216898 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 21:28:26.216898 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:28:26.216898 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:26.216898 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:26.216898 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:26.216898 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:26.216898 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:26.216898 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:26.216898 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:26.216898 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:26.216898 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:26.216898 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:26.216898 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:26.216898 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:26.217836 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:26.217836 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:26.217836 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 21:28:26.217836 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 21:28:26.217836 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 21:28:26.217836 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 21:28:26.217836 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 21:28:26.217836 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 21:28:26.217836 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 02 21:28:26.217836 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:26.217836 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 386/762] 10.222.0.70 () {56 vars in 1117 bytes} [Tue Aug 2 21:28:26 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:26.217836 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b823527c-2e78-4cb7-8185-ecceec98030b None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:26.244387 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eee9c56-809e-48e8-a3dd-a07f67b60a7c None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:26.272398 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:26.279862 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e75722-2249-4227-82c6-9c3cb927777d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:26.280570 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e75722-2249-4227-82c6-9c3cb927777d None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:26.280856 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e75722-2249-4227-82c6-9c3cb927777d None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:26.281133 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e75722-2249-4227-82c6-9c3cb927777d None admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:26.281890 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e75722-2249-4227-82c6-9c3cb927777d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:26.282205 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e75722-2249-4227-82c6-9c3cb927777d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:26.283652 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e75722-2249-4227-82c6-9c3cb927777d None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:26.295603 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 377/763] 10.222.0.70 () {56 vars in 1148 bytes} [Tue Aug 2 21:28:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:26.296449 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e75722-2249-4227-82c6-9c3cb927777d None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:26.322058 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b823527c-2e78-4cb7-8185-ecceec98030b None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:26.355414 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6b9046-d5e3-48b8-8c43-8752a91b00a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:26.356039 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6b9046-d5e3-48b8-8c43-8752a91b00a2 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:26.356356 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6b9046-d5e3-48b8-8c43-8752a91b00a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:26.356637 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6b9046-d5e3-48b8-8c43-8752a91b00a2 None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:26.357372 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6b9046-d5e3-48b8-8c43-8752a91b00a2 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:26.357687 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6b9046-d5e3-48b8-8c43-8752a91b00a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:26.359093 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6b9046-d5e3-48b8-8c43-8752a91b00a2 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:26.364274 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 387/764] 10.222.0.70 () {56 vars in 1124 bytes} [Tue Aug 2 21:28:26 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:26.365042 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6b9046-d5e3-48b8-8c43-8752a91b00a2 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:26.398538 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:26.399042 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e75722-2249-4227-82c6-9c3cb927777d None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:26.432917 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05896d7-c1df-4bf4-9b21-d0fa939bede7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:26.433537 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05896d7-c1df-4bf4-9b21-d0fa939bede7 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:26.433824 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05896d7-c1df-4bf4-9b21-d0fa939bede7 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:26.434098 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05896d7-c1df-4bf4-9b21-d0fa939bede7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:26.434881 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05896d7-c1df-4bf4-9b21-d0fa939bede7 None admin] RBAC: Adding query filter params (role.id=3e32dbf75f9b41f5adb9fe59851267bb, scope.project.id=42672e04d6ce4b0ab5f7eccfb0cc946c, user.id=2ee7ebf40212465aac997b461a2d10fc) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:26.435194 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05896d7-c1df-4bf4-9b21-d0fa939bede7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:26.436696 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05896d7-c1df-4bf4-9b21-d0fa939bede7 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:26.442116 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 378/765] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Aug 2 21:28:26 2022] GET /identity/v3/role_assignments?user.id=2ee7ebf40212465aac997b461a2d10fc&scope.project.id=42672e04d6ce4b0ab5f7eccfb0cc946c&role.id=3e32dbf75f9b41f5adb9fe59851267bb => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:26.442892 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05896d7-c1df-4bf4-9b21-d0fa939bede7 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:26.491329 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6b9046-d5e3-48b8-8c43-8752a91b00a2 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:26.507901 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:26.530748 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f555fb14-db56-4a80-8b58-4ad95a7d97bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:26.531407 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f555fb14-db56-4a80-8b58-4ad95a7d97bc None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:26.532131 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f555fb14-db56-4a80-8b58-4ad95a7d97bc None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:26.532131 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f555fb14-db56-4a80-8b58-4ad95a7d97bc None admin] PATH_INFO: `/v3/services/network` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:26.532609 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f555fb14-db56-4a80-8b58-4ad95a7d97bc None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:26.534009 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f555fb14-db56-4a80-8b58-4ad95a7d97bc None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:26.545667 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-f555fb14-db56-4a80-8b58-4ad95a7d97bc None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 02 21:28:26.545667 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:26.545667 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 21:28:26.545667 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 21:28:26.545667 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 21:28:26.545667 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 21:28:26.545667 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 21:28:26.545667 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 21:28:26.545667 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 02 21:28:26.545667 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:26.545667 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 21:28:26.545667 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:26.545667 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:26.545667 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:26.545667 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:26.545667 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:26.545667 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:26.546745 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:26.546745 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:26.546745 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:26.546745 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:26.546745 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:26.546745 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:26.546745 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 21:28:26.546745 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 21:28:26.546745 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 21:28:26.546745 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 21:28:26.546745 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:26.546745 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:26.546745 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:26.546745 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:26.546745 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:26.546745 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:26.547601 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:26.547601 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:26.547601 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:26.547601 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:26.547601 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:26.547601 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:26.547601 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:26.547601 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:26.547601 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:26.547601 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:26.547601 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 21:28:26.547601 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 21:28:26.547601 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 02 21:28:26.547601 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:26.547601 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 388/766] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Aug 2 21:28:26 2022] GET /identity/v3/services/network => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:26.548442 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f555fb14-db56-4a80-8b58-4ad95a7d97bc None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:26.564376 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05896d7-c1df-4bf4-9b21-d0fa939bede7 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:26.602748 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f740e16d-0a3a-4253-b016-95a1ff97a7a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:26.603373 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f740e16d-0a3a-4253-b016-95a1ff97a7a6 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:26.603656 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f740e16d-0a3a-4253-b016-95a1ff97a7a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:26.603929 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f740e16d-0a3a-4253-b016-95a1ff97a7a6 None admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:26.604746 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f740e16d-0a3a-4253-b016-95a1ff97a7a6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:26.605056 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f740e16d-0a3a-4253-b016-95a1ff97a7a6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:26.606484 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f740e16d-0a3a-4253-b016-95a1ff97a7a6 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:26.625292 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 379/767] 10.222.0.70 () {56 vars in 1149 bytes} [Tue Aug 2 21:28:26 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:26.626460 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f740e16d-0a3a-4253-b016-95a1ff97a7a6 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:26.653845 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:26.669925 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f555fb14-db56-4a80-8b58-4ad95a7d97bc None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:26.706270 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c682bfb5-2705-4544-be79-7d2070591170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:26.706946 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c682bfb5-2705-4544-be79-7d2070591170 None admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:26.707225 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c682bfb5-2705-4544-be79-7d2070591170 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:26.707499 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c682bfb5-2705-4544-be79-7d2070591170 None admin] PATH_INFO: `/v3/projects/42672e04d6ce4b0ab5f7eccfb0cc946c/users/87dd5c1c5e854d4b96e0b7dad6aa3719/roles/3e32dbf75f9b41f5adb9fe59851267bb` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:26.709582 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c682bfb5-2705-4544-be79-7d2070591170 None admin] RBAC: Authorizing `identity:create_grant(project_id=42672e04d6ce4b0ab5f7eccfb0cc946c, user_id=87dd5c1c5e854d4b96e0b7dad6aa3719, role_id=3e32dbf75f9b41f5adb9fe59851267bb)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:26.711130 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c682bfb5-2705-4544-be79-7d2070591170 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:26.724633 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 389/768] 10.222.0.70 () {58 vars in 1439 bytes} [Tue Aug 2 21:28:26 2022] PUT /identity/v3/projects/42672e04d6ce4b0ab5f7eccfb0cc946c/users/87dd5c1c5e854d4b96e0b7dad6aa3719/roles/3e32dbf75f9b41f5adb9fe59851267bb => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:28:26.725455 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c682bfb5-2705-4544-be79-7d2070591170 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:26.748947 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f740e16d-0a3a-4253-b016-95a1ff97a7a6 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:26.766496 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:26.795054 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3024213b-e4c5-4fef-84d2-d9ef0ac909f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:26.796342 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3024213b-e4c5-4fef-84d2-d9ef0ac909f5 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:26.796892 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3024213b-e4c5-4fef-84d2-d9ef0ac909f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:26.797368 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3024213b-e4c5-4fef-84d2-d9ef0ac909f5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:26.798334 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3024213b-e4c5-4fef-84d2-d9ef0ac909f5 None admin] RBAC: Adding query filter params (interface=public, service_id=5489042c511f4b5da25e1bebc26af668, region_id=RegionOne) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:26.798846 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3024213b-e4c5-4fef-84d2-d9ef0ac909f5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:26.800485 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3024213b-e4c5-4fef-84d2-d9ef0ac909f5 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:26.816572 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 380/769] 10.222.0.70 () {56 vars in 1251 bytes} [Tue Aug 2 21:28:26 2022] GET /identity/v3/endpoints?service_id=5489042c511f4b5da25e1bebc26af668&interface=public®ion_id=RegionOne => generated 194 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:26.817950 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3024213b-e4c5-4fef-84d2-d9ef0ac909f5 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:26.894866 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c682bfb5-2705-4544-be79-7d2070591170 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:26.935392 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0483948-9ec7-4b48-b443-4b96228a6131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:26.935938 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0483948-9ec7-4b48-b443-4b96228a6131 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:26.936223 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0483948-9ec7-4b48-b443-4b96228a6131 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:26.936604 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0483948-9ec7-4b48-b443-4b96228a6131 None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:26.937432 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0483948-9ec7-4b48-b443-4b96228a6131 None admin] RBAC: Adding query filter params (name=network) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:26.937720 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0483948-9ec7-4b48-b443-4b96228a6131 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:26.939090 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0483948-9ec7-4b48-b443-4b96228a6131 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:26.948603 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 390/770] 10.222.0.70 () {56 vars in 1112 bytes} [Tue Aug 2 21:28:26 2022] GET /identity/v3/services?name=network => generated 124 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:26.949461 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0483948-9ec7-4b48-b443-4b96228a6131 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:26.952687 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3024213b-e4c5-4fef-84d2-d9ef0ac909f5 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:26.963149 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:27.003792 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e906840-7a94-497f-8b96-701b4620cedd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:27.005292 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e906840-7a94-497f-8b96-701b4620cedd None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:27.005730 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e906840-7a94-497f-8b96-701b4620cedd None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:27.006632 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e906840-7a94-497f-8b96-701b4620cedd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:27.068759 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:27.070202 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0483948-9ec7-4b48-b443-4b96228a6131 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:27.100664 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e906840-7a94-497f-8b96-701b4620cedd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:27.103040 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e906840-7a94-497f-8b96-701b4620cedd None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:27.115019 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cec4d8-61ed-48d8-bf8a-672b10d38bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:27.115842 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cec4d8-61ed-48d8-bf8a-672b10d38bda None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:27.116688 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cec4d8-61ed-48d8-bf8a-672b10d38bda None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:27.117147 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cec4d8-61ed-48d8-bf8a-672b10d38bda None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:27.117944 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cec4d8-61ed-48d8-bf8a-672b10d38bda None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:27.120408 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cec4d8-61ed-48d8-bf8a-672b10d38bda None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:27.136791 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 391/771] 10.222.0.70 () {56 vars in 1087 bytes} [Tue Aug 2 21:28:26 2022] GET /identity/v3/services => generated 772 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:27.136791 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cec4d8-61ed-48d8-bf8a-672b10d38bda None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:27.294717 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 381/772] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 2 21:28:26 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 477 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 21:28:27.299947 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:27.304254 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e906840-7a94-497f-8b96-701b4620cedd None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:27.346750 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cec4d8-61ed-48d8-bf8a-672b10d38bda None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:27.394392 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1839de54-fb5c-4c89-9891-81a235406548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:27.395021 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1839de54-fb5c-4c89-9891-81a235406548 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:27.395965 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1839de54-fb5c-4c89-9891-81a235406548 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:27.396272 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1839de54-fb5c-4c89-9891-81a235406548 None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:27.396971 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1839de54-fb5c-4c89-9891-81a235406548 None admin] RBAC: Adding query filter params (type=network) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:27.397283 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1839de54-fb5c-4c89-9891-81a235406548 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:27.399255 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1839de54-fb5c-4c89-9891-81a235406548 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:27.406565 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 392/773] 10.222.0.70 () {56 vars in 1112 bytes} [Tue Aug 2 21:28:27 2022] GET /identity/v3/services?type=network => generated 350 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:27.411906 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:27.412391 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1839de54-fb5c-4c89-9891-81a235406548 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:27.447311 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e906840-7a94-497f-8b96-701b4620cedd None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:27.493553 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5637ad38-ce06-4126-9daa-b4d31409c785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:27.494209 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5637ad38-ce06-4126-9daa-b4d31409c785 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:27.494518 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5637ad38-ce06-4126-9daa-b4d31409c785 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:27.495412 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5637ad38-ce06-4126-9daa-b4d31409c785 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:27.508369 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5637ad38-ce06-4126-9daa-b4d31409c785 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:27.510322 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5637ad38-ce06-4126-9daa-b4d31409c785 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:27.538471 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-5637ad38-ce06-4126-9daa-b4d31409c785 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:27.538471 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:27.538471 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:27.538471 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:27.538471 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:27.538471 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:27.538471 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:27.538471 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:27.538471 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:27.538471 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:27.538471 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:27.538471 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:27.538471 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:28:27.538471 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:28:27.538471 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:28:27.540425 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:28:27.540425 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:27.540425 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:27.540425 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:27.540425 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:27.540425 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:27.540425 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:27.540425 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:27.540425 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:27.540425 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:27.540425 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:27.540425 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:27.540425 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:27.540425 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:27.540425 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:27.540425 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:27.540425 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:27.541318 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:28:27.541318 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:28:27.541318 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:27.541318 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:28:27.541318 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 382/774] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 2 21:28:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:27.547512 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5637ad38-ce06-4126-9daa-b4d31409c785 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:27.556825 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1839de54-fb5c-4c89-9891-81a235406548 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:27.595332 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef8815c-2284-4768-b795-68db2a46534b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:27.595967 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef8815c-2284-4768-b795-68db2a46534b None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:27.596268 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef8815c-2284-4768-b795-68db2a46534b None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:27.596554 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef8815c-2284-4768-b795-68db2a46534b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:27.597316 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef8815c-2284-4768-b795-68db2a46534b None admin] RBAC: Adding query filter params (interface=public, service_id=89379344946f4dbfa4f690c32bea5c5c, region_id=RegionOne) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:27.597629 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef8815c-2284-4768-b795-68db2a46534b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:27.599062 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef8815c-2284-4768-b795-68db2a46534b None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:27.608349 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 393/775] 10.222.0.70 () {56 vars in 1251 bytes} [Tue Aug 2 21:28:27 2022] GET /identity/v3/endpoints?service_id=89379344946f4dbfa4f690c32bea5c5c&interface=public®ion_id=RegionOne => generated 194 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:27.617224 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef8815c-2284-4768-b795-68db2a46534b None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:27.620631 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:27.705280 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5637ad38-ce06-4126-9daa-b4d31409c785 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:27.733896 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:27.743976 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69bebfe-7e39-4d53-aee5-17f9be03d97b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:27.745204 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69bebfe-7e39-4d53-aee5-17f9be03d97b None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:27.745492 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69bebfe-7e39-4d53-aee5-17f9be03d97b None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:27.745770 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69bebfe-7e39-4d53-aee5-17f9be03d97b None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:27.746471 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69bebfe-7e39-4d53-aee5-17f9be03d97b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:27.746780 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69bebfe-7e39-4d53-aee5-17f9be03d97b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:27.748307 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69bebfe-7e39-4d53-aee5-17f9be03d97b None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:27.761360 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 383/776] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 2 21:28:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:27.769205 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69bebfe-7e39-4d53-aee5-17f9be03d97b None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:27.788736 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef8815c-2284-4768-b795-68db2a46534b None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:27.823941 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbace1f-546b-4683-b547-8c82fe446722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:27.824547 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbace1f-546b-4683-b547-8c82fe446722 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:27.824832 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbace1f-546b-4683-b547-8c82fe446722 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:27.825111 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbace1f-546b-4683-b547-8c82fe446722 None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:27.825770 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbace1f-546b-4683-b547-8c82fe446722 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:27.827145 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbace1f-546b-4683-b547-8c82fe446722 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:27.836204 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 394/777] 10.222.0.70 () {56 vars in 1087 bytes} [Tue Aug 2 21:28:27 2022] GET /identity/v3/services => generated 772 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:27.896832 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69bebfe-7e39-4d53-aee5-17f9be03d97b None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:27.937992 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6195ca-23c6-4334-b8fc-6e05a6525f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:27.938662 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6195ca-23c6-4334-b8fc-6e05a6525f35 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:27.938948 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6195ca-23c6-4334-b8fc-6e05a6525f35 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:27.939227 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6195ca-23c6-4334-b8fc-6e05a6525f35 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:27.947356 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6195ca-23c6-4334-b8fc-6e05a6525f35 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:27.949046 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6195ca-23c6-4334-b8fc-6e05a6525f35 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:27.962272 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-ba6195ca-23c6-4334-b8fc-6e05a6525f35 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:28:27.962272 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:27.962272 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:27.962272 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:27.962272 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:27.962272 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:27.962272 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:27.962272 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:27.962272 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:27.962272 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:27.962272 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:27.962272 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:27.962272 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 21:28:27.962272 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 21:28:27.962272 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 21:28:27.964743 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 21:28:27.964743 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:27.964743 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:27.964743 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:27.964743 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:27.964743 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:27.964743 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:27.964743 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:27.964743 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:27.964743 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:27.964743 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:27.964743 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:27.964743 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:27.964743 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:27.964743 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:27.964743 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:27.964743 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:27.965840 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 21:28:27.965840 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 21:28:27.965840 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 21:28:27.965840 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 21:28:27.965840 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 21:28:27.965840 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 21:28:27.965840 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:28:27.965840 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:28:27.965840 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 384/778] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Aug 2 21:28:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:27.973428 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbace1f-546b-4683-b547-8c82fe446722 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:28.068884 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:28.105680 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbace1f-546b-4683-b547-8c82fe446722 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:28.139890 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fdb1f9-bb77-44cd-b080-1219690952be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:28.140551 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fdb1f9-bb77-44cd-b080-1219690952be None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:28.140836 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fdb1f9-bb77-44cd-b080-1219690952be None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:28.141114 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fdb1f9-bb77-44cd-b080-1219690952be None admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:28.141871 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fdb1f9-bb77-44cd-b080-1219690952be None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:28.142183 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fdb1f9-bb77-44cd-b080-1219690952be None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:28.143610 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fdb1f9-bb77-44cd-b080-1219690952be None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:28.157087 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 395/779] 10.222.0.70 () {56 vars in 1148 bytes} [Tue Aug 2 21:28:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:28.162867 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6195ca-23c6-4334-b8fc-6e05a6525f35 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:28.216492 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:28.278839 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6195ca-23c6-4334-b8fc-6e05a6525f35 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:28.331731 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30507b58-ccaf-4f43-9943-699464564542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:28.332428 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30507b58-ccaf-4f43-9943-699464564542 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:28.332718 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30507b58-ccaf-4f43-9943-699464564542 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:28.332997 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30507b58-ccaf-4f43-9943-699464564542 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:28.333790 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30507b58-ccaf-4f43-9943-699464564542 None admin] RBAC: Adding query filter params (role.id=59a4c9a6a22d4bdb966856a28c4aabaf, scope.project.id=42672e04d6ce4b0ab5f7eccfb0cc946c, user.id=6be7b2bcfebd45389ca289c34fbabc3e) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:28.334102 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30507b58-ccaf-4f43-9943-699464564542 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:28.335537 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30507b58-ccaf-4f43-9943-699464564542 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:28.344311 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 385/780] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Aug 2 21:28:28 2022] GET /identity/v3/role_assignments?user.id=6be7b2bcfebd45389ca289c34fbabc3e&scope.project.id=42672e04d6ce4b0ab5f7eccfb0cc946c&role.id=59a4c9a6a22d4bdb966856a28c4aabaf => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:28:28.640702 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81b2e32-5f44-48e8-a2f5-330b87e6d281 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:28.641389 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81b2e32-5f44-48e8-a2f5-330b87e6d281 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:28.641389 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81b2e32-5f44-48e8-a2f5-330b87e6d281 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:28.642879 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 396/781] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:28:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:28:28.648922 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a33f08-fdad-4e5a-84d4-a4170846b4e6 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:28.649225 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a33f08-fdad-4e5a-84d4-a4170846b4e6 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:28.649496 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a33f08-fdad-4e5a-84d4-a4170846b4e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:28.668629 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-87a33f08-fdad-4e5a-84d4-a4170846b4e6 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:28:28.669887 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-87a33f08-fdad-4e5a-84d4-a4170846b4e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:28:28.753396 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 386/782] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:28:28 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 21:28:28.775791 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81b2e32-5f44-48e8-a2f5-330b87e6d281 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:28.913348 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81b2e32-5f44-48e8-a2f5-330b87e6d281 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:28.946135 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:28.958459 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038e3dbc-66be-4c21-a16b-e5b7f9fc652c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:28.959108 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038e3dbc-66be-4c21-a16b-e5b7f9fc652c None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:28.959394 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038e3dbc-66be-4c21-a16b-e5b7f9fc652c None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:28.959671 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038e3dbc-66be-4c21-a16b-e5b7f9fc652c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:28.974294 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038e3dbc-66be-4c21-a16b-e5b7f9fc652c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:28:28.979727 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-038e3dbc-66be-4c21-a16b-e5b7f9fc652c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 21:28:28.979727 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:28.979727 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:28.979727 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:28.979727 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:28.979727 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:28.979727 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:28.979727 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:28.979727 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:28.979727 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:28.979727 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:28.979727 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:28.979727 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:28:28.979727 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:28:28.979727 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:28:28.979727 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:28:28.981795 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:28:28.981795 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:28:28.981795 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:28:28.981795 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:28:28.981795 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:28.981795 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:28.981795 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:28.981795 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:28.981795 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:28.981795 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:28.981795 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:28.981795 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:28.981795 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:28.981795 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:28.981795 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:28.981795 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:28.983711 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:28.983711 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:28.983711 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:28.983711 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:28.983711 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:28:28.983711 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:28:28.983711 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:28:28.983711 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:28:28.983711 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:28:28.983711 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:28:28.983711 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 21:28:28.983711 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:28.983711 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 397/783] 10.222.0.70 () {56 vars in 1096 bytes} [Tue Aug 2 21:28:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:28.987119 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a33f08-fdad-4e5a-84d4-a4170846b4e6 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:29.032790 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:29.094719 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a33f08-fdad-4e5a-84d4-a4170846b4e6 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:29.105473 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38fe3a7-87d5-4593-8edf-a103b6411efb None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:29.105766 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38fe3a7-87d5-4593-8edf-a103b6411efb None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:29.106045 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38fe3a7-87d5-4593-8edf-a103b6411efb None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:29.107649 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 398/784] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:28:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:28:29.112503 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed3fa3c-6e42-485a-8520-51a3cea8854f None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:29.112791 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed3fa3c-6e42-485a-8520-51a3cea8854f None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:29.113338 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed3fa3c-6e42-485a-8520-51a3cea8854f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:29.132199 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8e4496-bfbb-4d39-9d3e-d9859737dffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:29.132852 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8e4496-bfbb-4d39-9d3e-d9859737dffb None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:29.133140 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8e4496-bfbb-4d39-9d3e-d9859737dffb None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:29.133420 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8e4496-bfbb-4d39-9d3e-d9859737dffb None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:29.133618 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-2ed3fa3c-6e42-485a-8520-51a3cea8854f None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:28:29.134149 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8e4496-bfbb-4d39-9d3e-d9859737dffb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:29.134459 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8e4496-bfbb-4d39-9d3e-d9859737dffb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:29.134685 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-2ed3fa3c-6e42-485a-8520-51a3cea8854f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:28:29.135868 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8e4496-bfbb-4d39-9d3e-d9859737dffb None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:29.144991 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 387/785] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 2 21:28:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:29.150497 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8e4496-bfbb-4d39-9d3e-d9859737dffb None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:29.274508 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 399/786] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:28:29 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 21:28:29.300289 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed3fa3c-6e42-485a-8520-51a3cea8854f None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:29.308202 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8e4496-bfbb-4d39-9d3e-d9859737dffb None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:29.310775 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:29.344489 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a756649-1387-4c3d-97ad-55e4dad96bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:29.345160 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a756649-1387-4c3d-97ad-55e4dad96bee None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:29.345447 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a756649-1387-4c3d-97ad-55e4dad96bee None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:29.345724 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a756649-1387-4c3d-97ad-55e4dad96bee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:29.357058 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a756649-1387-4c3d-97ad-55e4dad96bee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:29.358528 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a756649-1387-4c3d-97ad-55e4dad96bee None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:29.374036 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-9a756649-1387-4c3d-97ad-55e4dad96bee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:29.374036 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:29.374036 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:29.374036 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:29.374036 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:29.374036 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:29.374036 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:29.374036 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:29.374036 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:29.374036 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:29.374036 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:29.374036 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:29.374036 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:28:29.374036 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:28:29.374036 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:28:29.376019 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:28:29.376019 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:29.376019 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:29.376019 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:29.376019 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:29.376019 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:29.376019 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:29.376019 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:29.376019 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:29.376019 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:29.376019 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:29.376019 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:29.376019 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:29.376019 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:29.376019 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:29.376019 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:29.376019 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:29.378080 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:28:29.378080 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:28:29.378080 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:29.378080 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:28:29.378080 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 388/787] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 2 21:28:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 21:28:29.381063 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a756649-1387-4c3d-97ad-55e4dad96bee None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:29.432527 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed3fa3c-6e42-485a-8520-51a3cea8854f None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:29.458460 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:29.488734 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a756649-1387-4c3d-97ad-55e4dad96bee None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:29.530515 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b96de06-4ff3-42f0-b536-92db48da8c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:29.531271 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b96de06-4ff3-42f0-b536-92db48da8c1c None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:29.531557 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b96de06-4ff3-42f0-b536-92db48da8c1c None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:29.531833 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b96de06-4ff3-42f0-b536-92db48da8c1c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:29.537097 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdd300b-4be9-4f9f-b450-8d2d5e45f05e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:29.537720 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd300b-4be9-4f9f-b450-8d2d5e45f05e None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:29.538007 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd300b-4be9-4f9f-b450-8d2d5e45f05e None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:29.538283 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdd300b-4be9-4f9f-b450-8d2d5e45f05e None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:29.538981 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdd300b-4be9-4f9f-b450-8d2d5e45f05e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:29.539288 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdd300b-4be9-4f9f-b450-8d2d5e45f05e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:29.550049 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdd300b-4be9-4f9f-b450-8d2d5e45f05e None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:29.562303 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b96de06-4ff3-42f0-b536-92db48da8c1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:28:29.570545 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-5b96de06-4ff3-42f0-b536-92db48da8c1c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 21:28:29.570545 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:29.570545 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:29.570545 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:29.570545 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:29.570545 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:29.570545 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:29.570545 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:29.570545 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:29.570545 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:29.570545 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:29.570545 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:29.570545 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:28:29.570545 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:28:29.570545 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:28:29.570545 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:28:29.572724 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:28:29.572724 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:28:29.572724 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:28:29.572724 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:28:29.572724 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:29.572724 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:29.572724 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:29.572724 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:29.572724 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:29.572724 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:29.572724 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:29.572724 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:29.572724 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:29.572724 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:29.572724 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:29.572724 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:29.574659 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:29.574659 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:29.574659 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:29.574659 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:29.574659 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:28:29.574659 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:28:29.574659 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:28:29.574659 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:28:29.574659 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:28:29.574659 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:28:29.574659 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 21:28:29.574659 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:29.576113 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 389/788] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 2 21:28:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:29.576287 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 400/789] 10.222.0.70 () {56 vars in 1096 bytes} [Tue Aug 2 21:28:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 21:28:29.580601 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdd300b-4be9-4f9f-b450-8d2d5e45f05e None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:29.581857 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b96de06-4ff3-42f0-b536-92db48da8c1c None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:29.636622 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:29.755332 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b96de06-4ff3-42f0-b536-92db48da8c1c None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:29.783159 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdd300b-4be9-4f9f-b450-8d2d5e45f05e None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:29.793333 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc054ef2-cc01-4c98-b6b3-874bcfda4d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:29.794376 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc054ef2-cc01-4c98-b6b3-874bcfda4d31 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:29.794852 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc054ef2-cc01-4c98-b6b3-874bcfda4d31 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:29.795413 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc054ef2-cc01-4c98-b6b3-874bcfda4d31 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:29.804414 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc054ef2-cc01-4c98-b6b3-874bcfda4d31 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:29.806278 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc054ef2-cc01-4c98-b6b3-874bcfda4d31 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:29.818500 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-fc054ef2-cc01-4c98-b6b3-874bcfda4d31 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 02 21:28:29.818500 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:29.818500 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:29.818500 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:29.818500 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:29.818500 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:29.818500 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:29.818500 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:29.818500 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:29.818500 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:29.818500 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:29.818500 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:29.818500 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 21:28:29.818500 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 21:28:29.818500 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 21:28:29.818500 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 21:28:29.819409 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:29.819409 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:29.819409 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 21:28:29.819409 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:28:29.819409 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 21:28:29.819409 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:28:29.819409 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:29.819409 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:29.819409 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:29.819409 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:29.819409 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:29.819409 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:29.819409 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:29.819409 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:29.819409 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:29.819409 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:29.819409 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:29.819409 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:29.820450 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:29.820450 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:29.820450 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 21:28:29.820450 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 21:28:29.820450 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 21:28:29.820450 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 21:28:29.820450 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 21:28:29.820450 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 21:28:29.820450 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 02 21:28:29.820450 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:29.821515 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b4ac4e-724b-4f6b-a13b-212175b683f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:29.821875 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b4ac4e-724b-4f6b-a13b-212175b683f5 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:29.822163 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b4ac4e-724b-4f6b-a13b-212175b683f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:29.822442 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b4ac4e-724b-4f6b-a13b-212175b683f5 None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:29.823741 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b4ac4e-724b-4f6b-a13b-212175b683f5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:29.824050 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b4ac4e-724b-4f6b-a13b-212175b683f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:29.824508 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 401/790] 10.222.0.70 () {56 vars in 1096 bytes} [Tue Aug 2 21:28:29 2022] GET /identity/v3/users/swift => generated 83 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:29.825493 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b4ac4e-724b-4f6b-a13b-212175b683f5 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:29.826069 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b408091-8fd7-469c-9924-bbed3b3d0ff7 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:29.826539 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b408091-8fd7-469c-9924-bbed3b3d0ff7 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:29.827064 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b408091-8fd7-469c-9924-bbed3b3d0ff7 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:29.832561 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 402/791] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:28:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:28:29.833660 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b408091-8fd7-469c-9924-bbed3b3d0ff7 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:29.841311 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 390/792] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 2 21:28:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:29.842676 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d821dbf-c488-4a86-8043-7045c193e851 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:29.842967 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d821dbf-c488-4a86-8043-7045c193e851 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:29.843245 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d821dbf-c488-4a86-8043-7045c193e851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:29.867526 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-8d821dbf-c488-4a86-8043-7045c193e851 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:28:29.869367 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-8d821dbf-c488-4a86-8043-7045c193e851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:28:29.881731 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:29.956560 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 391/793] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:28:29 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 21:28:29.957953 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d821dbf-c488-4a86-8043-7045c193e851 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:29.969232 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b408091-8fd7-469c-9924-bbed3b3d0ff7 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:29.978461 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:30.011714 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0812040-ff32-452c-9e0a-75daa26a09f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:30.012382 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0812040-ff32-452c-9e0a-75daa26a09f7 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:30.012667 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0812040-ff32-452c-9e0a-75daa26a09f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:30.013000 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0812040-ff32-452c-9e0a-75daa26a09f7 None admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:30.013797 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0812040-ff32-452c-9e0a-75daa26a09f7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:30.014153 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0812040-ff32-452c-9e0a-75daa26a09f7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:30.015577 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0812040-ff32-452c-9e0a-75daa26a09f7 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:30.040377 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 403/794] 10.222.0.70 () {56 vars in 1135 bytes} [Tue Aug 2 21:28:29 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:30.041565 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0812040-ff32-452c-9e0a-75daa26a09f7 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:30.092048 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d821dbf-c488-4a86-8043-7045c193e851 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:30.129429 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc00e8a-f71d-4d4c-b67d-03cbf9ad69b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:30.130278 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc00e8a-f71d-4d4c-b67d-03cbf9ad69b1 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:30.130390 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc00e8a-f71d-4d4c-b67d-03cbf9ad69b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:30.130602 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc00e8a-f71d-4d4c-b67d-03cbf9ad69b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:30.141966 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc00e8a-f71d-4d4c-b67d-03cbf9ad69b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:30.143410 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc00e8a-f71d-4d4c-b67d-03cbf9ad69b1 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:30.148781 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:30.156221 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0812040-ff32-452c-9e0a-75daa26a09f7 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:30.159586 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-0cc00e8a-f71d-4d4c-b67d-03cbf9ad69b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:30.159586 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:30.159586 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:30.159586 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:30.159586 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:30.159586 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:30.159586 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:30.159586 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:30.159586 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:30.159586 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:30.159586 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:30.159586 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:30.159586 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:28:30.159586 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:28:30.159586 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:28:30.160519 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:28:30.160519 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:30.160519 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:30.160519 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:30.160519 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:30.160519 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:30.160519 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:30.160519 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:30.160519 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:30.160519 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:30.160519 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:30.160519 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:30.160519 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:30.160519 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:30.160519 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:30.160519 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:30.160519 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:30.161633 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:28:30.161633 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:28:30.161633 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:30.161633 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:28:30.161633 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 392/795] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 2 21:28:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:30.161633 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc00e8a-f71d-4d4c-b67d-03cbf9ad69b1 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:30.195712 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d200c28-6300-4fe8-af8d-96ca75e7450c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:30.196816 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d200c28-6300-4fe8-af8d-96ca75e7450c None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:30.197316 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d200c28-6300-4fe8-af8d-96ca75e7450c None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:30.198387 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d200c28-6300-4fe8-af8d-96ca75e7450c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:30.199329 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d200c28-6300-4fe8-af8d-96ca75e7450c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:30.200914 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d200c28-6300-4fe8-af8d-96ca75e7450c None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:30.210539 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-0d200c28-6300-4fe8-af8d-96ca75e7450c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 02 21:28:30.210539 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:30.210539 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 21:28:30.210539 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 21:28:30.210539 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 21:28:30.210539 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 21:28:30.210539 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 21:28:30.210539 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 21:28:30.210539 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 02 21:28:30.210539 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:30.210539 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 21:28:30.210539 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:30.210539 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:30.210539 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:30.210539 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:30.210539 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:30.211514 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:30.211514 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:30.211514 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:30.211514 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:30.211514 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:30.211514 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:30.211514 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:30.211514 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 21:28:30.211514 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 21:28:30.211514 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 21:28:30.211514 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 21:28:30.211514 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:30.211514 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:30.211514 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:30.211514 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:30.211514 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:30.212363 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:30.212363 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:30.212363 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:30.212363 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:30.212363 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:30.212363 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:30.212363 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:30.212363 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:30.212363 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:30.212363 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:30.212363 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:30.212363 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 21:28:30.212363 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 21:28:30.212363 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 02 21:28:30.212363 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:30.220083 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 404/796] 10.222.0.70 () {56 vars in 1129 bytes} [Tue Aug 2 21:28:30 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:30.221180 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d200c28-6300-4fe8-af8d-96ca75e7450c None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:30.226592 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:30.274550 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc00e8a-f71d-4d4c-b67d-03cbf9ad69b1 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:30.311512 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75451912-7683-4438-8fe3-f4ff47d46db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:30.312147 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75451912-7683-4438-8fe3-f4ff47d46db3 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:30.312458 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75451912-7683-4438-8fe3-f4ff47d46db3 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:30.312738 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75451912-7683-4438-8fe3-f4ff47d46db3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:30.324890 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75451912-7683-4438-8fe3-f4ff47d46db3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:30.326352 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75451912-7683-4438-8fe3-f4ff47d46db3 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:30.340487 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d200c28-6300-4fe8-af8d-96ca75e7450c None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:30.342206 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-75451912-7683-4438-8fe3-f4ff47d46db3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:30.342206 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:30.342206 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:30.342206 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:30.342206 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:30.342206 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:30.342206 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:30.342206 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:30.342206 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:30.342206 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:30.342206 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:30.342206 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:30.342206 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:28:30.342206 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:28:30.342206 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:28:30.343079 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:28:30.343079 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:30.343079 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:30.343079 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:30.343079 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:30.343079 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:30.343079 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:30.343079 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:30.343079 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:30.343079 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:30.343079 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:30.343079 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:30.343079 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:30.343079 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:30.343079 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:30.343079 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:30.343079 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:30.343965 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:28:30.343965 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:28:30.343965 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:30.343965 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:28:30.348058 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 393/797] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 2 21:28:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:30.348921 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75451912-7683-4438-8fe3-f4ff47d46db3 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:30.380203 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb23474-c30f-4dea-8901-02395db02b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:30.381250 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb23474-c30f-4dea-8901-02395db02b43 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:30.381844 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb23474-c30f-4dea-8901-02395db02b43 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:30.382309 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb23474-c30f-4dea-8901-02395db02b43 None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:30.383239 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb23474-c30f-4dea-8901-02395db02b43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:30.383831 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb23474-c30f-4dea-8901-02395db02b43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:30.386322 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb23474-c30f-4dea-8901-02395db02b43 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:30.399966 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 405/798] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 2 21:28:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:30.401275 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb23474-c30f-4dea-8901-02395db02b43 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:30.423565 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:30.462589 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75451912-7683-4438-8fe3-f4ff47d46db3 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:30.477133 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:30.509941 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cf5519-4bc6-489d-83e8-388763d87b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:30.510614 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cf5519-4bc6-489d-83e8-388763d87b70 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:30.511121 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cf5519-4bc6-489d-83e8-388763d87b70 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:30.511248 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cf5519-4bc6-489d-83e8-388763d87b70 None admin] PATH_INFO: `/v3/services` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:30.511951 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cf5519-4bc6-489d-83e8-388763d87b70 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:30.512255 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cf5519-4bc6-489d-83e8-388763d87b70 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:30.513644 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cf5519-4bc6-489d-83e8-388763d87b70 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:30.514803 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb23474-c30f-4dea-8901-02395db02b43 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:30.518823 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 394/799] 10.222.0.70 () {56 vars in 1124 bytes} [Tue Aug 2 21:28:30 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:30.519830 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cf5519-4bc6-489d-83e8-388763d87b70 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:30.552000 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b3056a-3c28-4205-a3f3-c9e0cb8a313b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:30.552586 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b3056a-3c28-4205-a3f3-c9e0cb8a313b None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:30.552874 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b3056a-3c28-4205-a3f3-c9e0cb8a313b None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:30.553154 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b3056a-3c28-4205-a3f3-c9e0cb8a313b None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:30.553850 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b3056a-3c28-4205-a3f3-c9e0cb8a313b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:30.554162 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b3056a-3c28-4205-a3f3-c9e0cb8a313b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:30.555531 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b3056a-3c28-4205-a3f3-c9e0cb8a313b None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:30.567524 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 406/800] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 2 21:28:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:30.568846 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a07f022-9173-4449-af05-283b4b0fafc2 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:30.569141 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a07f022-9173-4449-af05-283b4b0fafc2 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:30.569421 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a07f022-9173-4449-af05-283b4b0fafc2 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:30.570799 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 407/801] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:28:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:28:30.573033 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a07f022-9173-4449-af05-283b4b0fafc2 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:30.636251 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cf5519-4bc6-489d-83e8-388763d87b70 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:30.670017 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:30.677634 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b904b8ed-d5b1-427b-abcc-bde98f922872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:30.678283 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b904b8ed-d5b1-427b-abcc-bde98f922872 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:30.678570 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b904b8ed-d5b1-427b-abcc-bde98f922872 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:30.678851 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b904b8ed-d5b1-427b-abcc-bde98f922872 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:30.689170 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b904b8ed-d5b1-427b-abcc-bde98f922872 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:30.691715 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b904b8ed-d5b1-427b-abcc-bde98f922872 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:30.693139 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a07f022-9173-4449-af05-283b4b0fafc2 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:30.705353 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-b904b8ed-d5b1-427b-abcc-bde98f922872 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 02 21:28:30.705353 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:30.705353 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:30.705353 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:30.705353 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:30.705353 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:30.705353 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:30.705353 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:30.705353 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:30.705353 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:30.705353 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:30.705353 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:30.705353 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 21:28:30.705353 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 21:28:30.705353 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 21:28:30.705353 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 21:28:30.706484 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:30.706484 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:30.706484 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 21:28:30.706484 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:28:30.706484 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 21:28:30.706484 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:28:30.706484 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:30.706484 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:30.706484 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:30.706484 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:30.706484 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:30.706484 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:30.706484 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:30.706484 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:30.706484 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:30.706484 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:30.706484 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:30.706484 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:30.707600 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:30.707600 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:30.707600 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 21:28:30.707600 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 21:28:30.707600 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 21:28:30.707600 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 21:28:30.707600 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 21:28:30.707600 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 21:28:30.707600 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 02 21:28:30.707600 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:28:30.711141 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 395/802] 10.222.0.70 () {56 vars in 1093 bytes} [Tue Aug 2 21:28:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:30.711985 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b904b8ed-d5b1-427b-abcc-bde98f922872 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:30.733440 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3700147f-6331-4f0f-a690-a58e745effba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:30.734068 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3700147f-6331-4f0f-a690-a58e745effba None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:30.734352 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3700147f-6331-4f0f-a690-a58e745effba None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:30.734630 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3700147f-6331-4f0f-a690-a58e745effba None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:30.735500 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3700147f-6331-4f0f-a690-a58e745effba None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:30.735606 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3700147f-6331-4f0f-a690-a58e745effba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:30.737019 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3700147f-6331-4f0f-a690-a58e745effba None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:30.742374 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 408/803] 10.222.0.70 () {56 vars in 1124 bytes} [Tue Aug 2 21:28:30 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:30.746791 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3313cfad-da09-438d-9d74-75ad6d3e5368 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:30.747556 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3313cfad-da09-438d-9d74-75ad6d3e5368 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:30.747839 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3313cfad-da09-438d-9d74-75ad6d3e5368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:30.750543 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:30.767931 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-3313cfad-da09-438d-9d74-75ad6d3e5368 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:28:30.769136 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-3313cfad-da09-438d-9d74-75ad6d3e5368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:28:30.819373 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b904b8ed-d5b1-427b-abcc-bde98f922872 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:30.836295 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 409/804] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:28:30 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 21:28:30.836581 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3313cfad-da09-438d-9d74-75ad6d3e5368 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:30.858498 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c284ce7-710f-4e18-b3cd-73890c6c8e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:30.859135 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c284ce7-710f-4e18-b3cd-73890c6c8e5e None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:30.859417 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c284ce7-710f-4e18-b3cd-73890c6c8e5e None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:30.859690 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c284ce7-710f-4e18-b3cd-73890c6c8e5e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:30.866606 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c284ce7-710f-4e18-b3cd-73890c6c8e5e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:30.868132 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c284ce7-710f-4e18-b3cd-73890c6c8e5e None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:30.882179 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-7c284ce7-710f-4e18-b3cd-73890c6c8e5e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:28:30.882179 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:30.882179 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:30.882179 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:30.882179 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:30.882179 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:30.882179 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:30.882179 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:30.882179 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:30.882179 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:30.882179 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:30.882179 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:30.882179 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 21:28:30.882179 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 21:28:30.882179 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 21:28:30.883093 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 21:28:30.883093 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:30.883093 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:30.883093 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:30.883093 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:30.883093 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:30.883093 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:30.883093 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:30.883093 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:30.883093 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:30.883093 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:30.883093 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:30.883093 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:30.883093 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:30.883093 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:30.883093 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:30.883093 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:30.884015 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 21:28:30.884015 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 21:28:30.884015 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 21:28:30.884015 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 21:28:30.884015 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 21:28:30.884015 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 21:28:30.884015 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:28:30.884015 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:28:30.884015 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 396/805] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Aug 2 21:28:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:30.884015 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c284ce7-710f-4e18-b3cd-73890c6c8e5e None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:30.911453 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:30.942046 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3313cfad-da09-438d-9d74-75ad6d3e5368 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:30.975441 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c0fd8d-ccde-4b48-a3b4-11c0acaea069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:30.976054 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c0fd8d-ccde-4b48-a3b4-11c0acaea069 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:30.976378 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c0fd8d-ccde-4b48-a3b4-11c0acaea069 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:30.976660 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c0fd8d-ccde-4b48-a3b4-11c0acaea069 None admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:30.977456 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c0fd8d-ccde-4b48-a3b4-11c0acaea069 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:30.977769 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c0fd8d-ccde-4b48-a3b4-11c0acaea069 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:30.979800 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c0fd8d-ccde-4b48-a3b4-11c0acaea069 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:30.981967 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:30.988507 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c284ce7-710f-4e18-b3cd-73890c6c8e5e None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:31.001478 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 410/806] 10.222.0.70 () {56 vars in 1133 bytes} [Tue Aug 2 21:28:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:31.001478 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9a478c-4cdf-4d51-ad48-f6d0864d440b None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:31.001478 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9a478c-4cdf-4d51-ad48-f6d0864d440b None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:31.001478 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9a478c-4cdf-4d51-ad48-f6d0864d440b None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:31.001478 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 411/807] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:28:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:28:31.001478 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9a478c-4cdf-4d51-ad48-f6d0864d440b None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:31.023132 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c318db-ea92-479d-8871-560fb220bf0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:31.023747 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c318db-ea92-479d-8871-560fb220bf0a None admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:31.024032 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c318db-ea92-479d-8871-560fb220bf0a None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:31.024343 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c318db-ea92-479d-8871-560fb220bf0a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:31.025044 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c318db-ea92-479d-8871-560fb220bf0a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:31.026953 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c318db-ea92-479d-8871-560fb220bf0a None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:31.051554 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 397/808] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 2 21:28:30 2022] POST /identity/v3/endpoints => generated 346 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:28:31.052408 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c318db-ea92-479d-8871-560fb220bf0a None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:31.123784 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9a478c-4cdf-4d51-ad48-f6d0864d440b None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:31.153452 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:31.168020 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edcd145-42be-4826-98a8-de712acd1fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:31.168828 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edcd145-42be-4826-98a8-de712acd1fc3 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:31.169116 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edcd145-42be-4826-98a8-de712acd1fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:31.169398 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edcd145-42be-4826-98a8-de712acd1fc3 None admin] PATH_INFO: `/v3/services/network` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:31.170047 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edcd145-42be-4826-98a8-de712acd1fc3 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:31.171458 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edcd145-42be-4826-98a8-de712acd1fc3 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:31.175370 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c318db-ea92-479d-8871-560fb220bf0a None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:31.181276 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-9edcd145-42be-4826-98a8-de712acd1fc3 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 02 21:28:31.181276 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:31.181276 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 21:28:31.181276 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 21:28:31.181276 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 21:28:31.181276 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 21:28:31.181276 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 21:28:31.181276 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 21:28:31.181276 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 02 21:28:31.181276 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:31.181276 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 21:28:31.181276 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:31.181276 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:31.181276 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:31.181276 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:31.181276 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:31.181276 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:31.182901 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:31.182901 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:31.182901 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:31.182901 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:31.182901 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:31.182901 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:31.182901 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 21:28:31.182901 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 21:28:31.182901 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 21:28:31.182901 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 21:28:31.182901 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:31.182901 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:31.182901 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:31.182901 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:31.182901 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:31.182901 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:31.184722 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:31.184722 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:31.184722 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:31.184722 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:31.184722 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:31.184722 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:31.184722 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:31.184722 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:31.184722 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:31.184722 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:31.184722 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 21:28:31.184722 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 21:28:31.184722 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 02 21:28:31.184722 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:31.191981 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 412/809] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Aug 2 21:28:31 2022] GET /identity/v3/services/network => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:31.191981 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edcd145-42be-4826-98a8-de712acd1fc3 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:31.219421 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71187d8a-b994-4653-bf52-383c15244126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:31.221144 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71187d8a-b994-4653-bf52-383c15244126 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:31.221144 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71187d8a-b994-4653-bf52-383c15244126 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:31.221557 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71187d8a-b994-4653-bf52-383c15244126 None admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:31.222329 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71187d8a-b994-4653-bf52-383c15244126 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:31.222789 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71187d8a-b994-4653-bf52-383c15244126 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:31.224836 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71187d8a-b994-4653-bf52-383c15244126 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:31.238458 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 398/810] 10.222.0.70 () {56 vars in 1148 bytes} [Tue Aug 2 21:28:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:31.239645 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c83db8-bd5a-4c26-ae4f-de53452fa695 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:31.239645 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c83db8-bd5a-4c26-ae4f-de53452fa695 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:31.239995 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c83db8-bd5a-4c26-ae4f-de53452fa695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:31.259002 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-38c83db8-bd5a-4c26-ae4f-de53452fa695 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:28:31.260762 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-38c83db8-bd5a-4c26-ae4f-de53452fa695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:28:31.268935 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:31.311154 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edcd145-42be-4826-98a8-de712acd1fc3 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:31.348261 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 399/811] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:28:31 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 21:28:31.348261 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c83db8-bd5a-4c26-ae4f-de53452fa695 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:31.356965 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8063c31f-e86e-4a33-a621-fec1ce7602d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:31.357900 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8063c31f-e86e-4a33-a621-fec1ce7602d4 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:31.358326 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8063c31f-e86e-4a33-a621-fec1ce7602d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:31.358679 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8063c31f-e86e-4a33-a621-fec1ce7602d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:31.423682 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:31.440526 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8063c31f-e86e-4a33-a621-fec1ce7602d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:31.441986 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8063c31f-e86e-4a33-a621-fec1ce7602d4 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:31.460890 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c83db8-bd5a-4c26-ae4f-de53452fa695 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:31.498732 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc51e5d9-3abe-431a-b585-cd1981532819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:31.499351 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc51e5d9-3abe-431a-b585-cd1981532819 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:31.499631 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc51e5d9-3abe-431a-b585-cd1981532819 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:31.499903 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc51e5d9-3abe-431a-b585-cd1981532819 None admin] PATH_INFO: `/v3/services` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:31.501038 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc51e5d9-3abe-431a-b585-cd1981532819 None admin] RBAC: Adding query filter params (name=network) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:31.501353 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc51e5d9-3abe-431a-b585-cd1981532819 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:31.502772 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc51e5d9-3abe-431a-b585-cd1981532819 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:31.508150 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 400/812] 10.222.0.70 () {56 vars in 1112 bytes} [Tue Aug 2 21:28:31 2022] GET /identity/v3/services?name=network => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:31.508999 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc51e5d9-3abe-431a-b585-cd1981532819 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:31.519696 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:31.560853 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 413/813] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 2 21:28:31 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 21:28:31.561968 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8063c31f-e86e-4a33-a621-fec1ce7602d4 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:31.621734 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc51e5d9-3abe-431a-b585-cd1981532819 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:31.659142 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eaacba-27fd-4c9e-a2f0-c3fc731fdf3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:31.660256 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eaacba-27fd-4c9e-a2f0-c3fc731fdf3a None admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:31.660548 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eaacba-27fd-4c9e-a2f0-c3fc731fdf3a None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:31.660859 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eaacba-27fd-4c9e-a2f0-c3fc731fdf3a None admin] PATH_INFO: `/v3/projects/42672e04d6ce4b0ab5f7eccfb0cc946c/users/2ee7ebf40212465aac997b461a2d10fc/roles/3e32dbf75f9b41f5adb9fe59851267bb` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:31.662758 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:31.662890 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05eaacba-27fd-4c9e-a2f0-c3fc731fdf3a None admin] RBAC: Authorizing `identity:create_grant(project_id=42672e04d6ce4b0ab5f7eccfb0cc946c, user_id=2ee7ebf40212465aac997b461a2d10fc, role_id=3e32dbf75f9b41f5adb9fe59851267bb)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:31.664285 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05eaacba-27fd-4c9e-a2f0-c3fc731fdf3a None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:31.674745 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8063c31f-e86e-4a33-a621-fec1ce7602d4 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:31.688262 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 401/814] 10.222.0.70 () {58 vars in 1439 bytes} [Tue Aug 2 21:28:31 2022] PUT /identity/v3/projects/42672e04d6ce4b0ab5f7eccfb0cc946c/users/2ee7ebf40212465aac997b461a2d10fc/roles/3e32dbf75f9b41f5adb9fe59851267bb => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:28:31.688262 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eaacba-27fd-4c9e-a2f0-c3fc731fdf3a None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:31.722736 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e4de6d-f3ee-4f35-b08f-6a6b8be97a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:31.723504 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e4de6d-f3ee-4f35-b08f-6a6b8be97a89 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:31.723998 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e4de6d-f3ee-4f35-b08f-6a6b8be97a89 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:31.724381 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e4de6d-f3ee-4f35-b08f-6a6b8be97a89 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:31.738240 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e4de6d-f3ee-4f35-b08f-6a6b8be97a89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:28:31.744111 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-31e4de6d-f3ee-4f35-b08f-6a6b8be97a89 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 21:28:31.744111 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:31.744111 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:31.744111 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:31.744111 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:31.744111 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:31.744111 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:31.744111 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:31.744111 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:31.744111 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:31.744111 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:31.744111 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:31.744111 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:28:31.744111 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:28:31.744111 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:28:31.744111 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:28:31.745223 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:28:31.745223 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:28:31.745223 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:28:31.745223 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:28:31.745223 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:31.745223 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:31.745223 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:31.745223 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:31.745223 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:31.745223 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:31.745223 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:31.745223 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:31.745223 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:31.745223 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:31.745223 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:31.745223 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:31.746084 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:31.746084 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:31.746084 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:31.746084 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:31.746084 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:28:31.746084 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:28:31.746084 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:28:31.746084 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:28:31.746084 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:28:31.746084 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:28:31.746084 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 21:28:31.746084 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:31.750763 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 414/815] 10.222.0.70 () {56 vars in 1102 bytes} [Tue Aug 2 21:28:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:31.751757 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e4de6d-f3ee-4f35-b08f-6a6b8be97a89 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:31.793389 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:31.846389 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eaacba-27fd-4c9e-a2f0-c3fc731fdf3a None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:31.877541 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e4de6d-f3ee-4f35-b08f-6a6b8be97a89 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:31.889514 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2e3b73-1be7-400f-8cce-d18056701a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:31.890377 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2e3b73-1be7-400f-8cce-d18056701a67 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:31.890812 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2e3b73-1be7-400f-8cce-d18056701a67 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:31.891267 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2e3b73-1be7-400f-8cce-d18056701a67 None admin] PATH_INFO: `/v3/services` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:31.892111 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2e3b73-1be7-400f-8cce-d18056701a67 None admin] RBAC: Adding query filter params (type=network) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:31.892599 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2e3b73-1be7-400f-8cce-d18056701a67 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:31.894137 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2e3b73-1be7-400f-8cce-d18056701a67 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:31.902324 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 402/816] 10.222.0.70 () {56 vars in 1112 bytes} [Tue Aug 2 21:28:31 2022] GET /identity/v3/services?type=network => generated 350 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:31.903674 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2e3b73-1be7-400f-8cce-d18056701a67 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:31.919325 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb3fbb5-e340-46b2-bbbc-56ec7ef598bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:31.920164 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb3fbb5-e340-46b2-bbbc-56ec7ef598bc None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:31.920552 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb3fbb5-e340-46b2-bbbc-56ec7ef598bc None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:31.920892 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb3fbb5-e340-46b2-bbbc-56ec7ef598bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:31.932257 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb3fbb5-e340-46b2-bbbc-56ec7ef598bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:31.934085 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb3fbb5-e340-46b2-bbbc-56ec7ef598bc None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:31.951270 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-abb3fbb5-e340-46b2-bbbc-56ec7ef598bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:31.951270 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:31.951270 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:31.951270 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:31.951270 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:31.951270 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:31.951270 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:31.951270 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:31.951270 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:31.951270 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:31.951270 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:31.951270 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:31.951270 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:28:31.951270 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:28:31.951270 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:28:31.952442 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:28:31.952442 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:31.952442 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:31.952442 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:31.952442 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:31.952442 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:31.952442 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:31.952442 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:31.952442 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:31.952442 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:31.952442 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:31.952442 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:31.952442 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:31.952442 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:31.952442 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:31.952442 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:31.952442 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:31.953570 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:28:31.953570 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:28:31.953570 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:31.953570 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:31.954968 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 415/817] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 2 21:28:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:31.955818 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb3fbb5-e340-46b2-bbbc-56ec7ef598bc None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:31.964227 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:32.038838 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2e3b73-1be7-400f-8cce-d18056701a67 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:32.068659 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:32.076619 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cac5436-1598-4fda-82aa-e564d3f4b425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:32.077467 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cac5436-1598-4fda-82aa-e564d3f4b425 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:32.077829 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cac5436-1598-4fda-82aa-e564d3f4b425 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:32.078186 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cac5436-1598-4fda-82aa-e564d3f4b425 None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:32.079004 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cac5436-1598-4fda-82aa-e564d3f4b425 None admin] RBAC: Adding query filter params (name=service) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:32.079408 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cac5436-1598-4fda-82aa-e564d3f4b425 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:32.080917 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cac5436-1598-4fda-82aa-e564d3f4b425 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:32.092035 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb3fbb5-e340-46b2-bbbc-56ec7ef598bc None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:32.095433 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 403/818] 10.222.0.70 () {56 vars in 1103 bytes} [Tue Aug 2 21:28:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:32.095883 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cac5436-1598-4fda-82aa-e564d3f4b425 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:32.140100 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a09fbb-9a1b-48fe-a561-23cf27403f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:32.140994 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a09fbb-9a1b-48fe-a561-23cf27403f87 None admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:32.141883 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a09fbb-9a1b-48fe-a561-23cf27403f87 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:32.142317 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a09fbb-9a1b-48fe-a561-23cf27403f87 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:32.143617 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a09fbb-9a1b-48fe-a561-23cf27403f87 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:32.145466 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a09fbb-9a1b-48fe-a561-23cf27403f87 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:32.175500 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 416/819] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 2 21:28:31 2022] POST /identity/v3/endpoints => generated 337 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:28:32.177483 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a09fbb-9a1b-48fe-a561-23cf27403f87 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:32.247196 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cac5436-1598-4fda-82aa-e564d3f4b425 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:32.290278 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:32.350840 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a09fbb-9a1b-48fe-a561-23cf27403f87 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:32.354065 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada1235a-8522-4785-9946-7dbdf3122f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:32.355195 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada1235a-8522-4785-9946-7dbdf3122f91 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:32.355631 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada1235a-8522-4785-9946-7dbdf3122f91 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:32.356088 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada1235a-8522-4785-9946-7dbdf3122f91 None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:32.356961 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada1235a-8522-4785-9946-7dbdf3122f91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:32.357419 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada1235a-8522-4785-9946-7dbdf3122f91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:32.359088 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada1235a-8522-4785-9946-7dbdf3122f91 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:32.377159 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 404/820] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 2 21:28:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:32.382332 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada1235a-8522-4785-9946-7dbdf3122f91 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:32.394642 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b1846e-27e3-4584-998e-08e57b6d0f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:32.395762 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b1846e-27e3-4584-998e-08e57b6d0f04 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:32.396051 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b1846e-27e3-4584-998e-08e57b6d0f04 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:32.396424 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b1846e-27e3-4584-998e-08e57b6d0f04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:32.411634 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b1846e-27e3-4584-998e-08e57b6d0f04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:32.414263 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b1846e-27e3-4584-998e-08e57b6d0f04 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:32.436939 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-f4b1846e-27e3-4584-998e-08e57b6d0f04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:32.436939 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:32.436939 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:32.436939 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:32.436939 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:32.436939 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:32.436939 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:32.436939 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:32.436939 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:32.436939 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:32.436939 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:32.436939 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:32.436939 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:28:32.436939 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:28:32.436939 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:28:32.438019 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:28:32.438019 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:32.438019 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:32.438019 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:32.438019 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:32.438019 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:32.438019 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:32.438019 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:32.438019 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:32.438019 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:32.438019 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:32.438019 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:32.438019 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:32.438019 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:32.438019 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:32.438019 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:32.438019 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:32.438907 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:28:32.438907 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:28:32.438907 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:32.438907 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:32.440692 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 417/821] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 2 21:28:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:32.446117 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b1846e-27e3-4584-998e-08e57b6d0f04 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:32.447029 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:32.517017 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada1235a-8522-4785-9946-7dbdf3122f91 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:32.568909 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61fcf02-3cf1-4600-b231-34de3aa85c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:32.569625 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61fcf02-3cf1-4600-b231-34de3aa85c8e None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:32.569917 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61fcf02-3cf1-4600-b231-34de3aa85c8e None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:32.570194 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61fcf02-3cf1-4600-b231-34de3aa85c8e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:32.582327 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61fcf02-3cf1-4600-b231-34de3aa85c8e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:32.584099 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61fcf02-3cf1-4600-b231-34de3aa85c8e None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:32.593929 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b1846e-27e3-4584-998e-08e57b6d0f04 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:32.599912 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-c61fcf02-3cf1-4600-b231-34de3aa85c8e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:28:32.599912 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:32.599912 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:32.599912 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:32.599912 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:32.599912 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:32.599912 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:32.599912 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:32.599912 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:32.599912 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:32.599912 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:32.599912 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:32.599912 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 21:28:32.599912 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 21:28:32.599912 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 21:28:32.600894 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 21:28:32.600894 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:32.600894 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:32.600894 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:32.600894 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:32.600894 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:32.600894 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:32.600894 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:32.600894 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:32.600894 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:32.600894 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:32.600894 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:32.600894 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:32.600894 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:32.600894 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:32.600894 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:32.600894 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:32.601805 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 21:28:32.601805 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 21:28:32.601805 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 21:28:32.601805 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 21:28:32.601805 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 21:28:32.601805 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 21:28:32.601805 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:28:32.601805 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:28:32.601805 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 405/822] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Aug 2 21:28:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 21:28:32.606719 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61fcf02-3cf1-4600-b231-34de3aa85c8e None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:32.614348 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:32.642690 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69927847-b3dd-42e0-a36f-175e66855ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:32.643764 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69927847-b3dd-42e0-a36f-175e66855ffa None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:32.644407 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69927847-b3dd-42e0-a36f-175e66855ffa None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:32.645372 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69927847-b3dd-42e0-a36f-175e66855ffa None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:32.646187 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69927847-b3dd-42e0-a36f-175e66855ffa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:32.646766 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69927847-b3dd-42e0-a36f-175e66855ffa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:32.650585 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69927847-b3dd-42e0-a36f-175e66855ffa None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:32.664158 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 418/823] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 2 21:28:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:32.671613 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69927847-b3dd-42e0-a36f-175e66855ffa None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:32.737344 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61fcf02-3cf1-4600-b231-34de3aa85c8e None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:32.752110 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:32.776186 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949074f0-8f0d-4ad6-b927-51fb53714028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:32.776965 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949074f0-8f0d-4ad6-b927-51fb53714028 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:32.777471 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949074f0-8f0d-4ad6-b927-51fb53714028 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:32.777794 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949074f0-8f0d-4ad6-b927-51fb53714028 None admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:32.778633 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949074f0-8f0d-4ad6-b927-51fb53714028 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:32.779038 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949074f0-8f0d-4ad6-b927-51fb53714028 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:32.780606 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949074f0-8f0d-4ad6-b927-51fb53714028 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:32.780971 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69927847-b3dd-42e0-a36f-175e66855ffa None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:32.801015 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 406/824] 10.222.0.70 () {56 vars in 1148 bytes} [Tue Aug 2 21:28:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:28:32.802743 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949074f0-8f0d-4ad6-b927-51fb53714028 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:32.828707 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656361e0-3b73-4300-8ee1-2f18c6df33e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:32.829858 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656361e0-3b73-4300-8ee1-2f18c6df33e6 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:32.830234 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656361e0-3b73-4300-8ee1-2f18c6df33e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:32.830610 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656361e0-3b73-4300-8ee1-2f18c6df33e6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:32.841169 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656361e0-3b73-4300-8ee1-2f18c6df33e6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:32.843468 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656361e0-3b73-4300-8ee1-2f18c6df33e6 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:32.858971 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-656361e0-3b73-4300-8ee1-2f18c6df33e6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 02 21:28:32.858971 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:32.858971 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:32.858971 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:32.858971 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:32.858971 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:32.858971 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:32.858971 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:32.858971 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:32.858971 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:32.858971 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:32.858971 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:32.858971 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 21:28:32.858971 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 21:28:32.858971 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 21:28:32.858971 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 21:28:32.860150 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:32.860150 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:32.860150 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 21:28:32.860150 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:28:32.860150 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 21:28:32.860150 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:28:32.860150 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:32.860150 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:32.860150 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:32.860150 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:32.860150 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:32.860150 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:32.860150 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:32.860150 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:32.860150 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:32.860150 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:32.860150 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:32.860150 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:32.861333 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:32.861333 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:32.861333 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 21:28:32.861333 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 21:28:32.861333 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 21:28:32.861333 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 21:28:32.861333 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 21:28:32.861333 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 21:28:32.861333 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 02 21:28:32.861333 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:32.864265 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 419/825] 10.222.0.70 () {56 vars in 1117 bytes} [Tue Aug 2 21:28:32 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:32.869614 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656361e0-3b73-4300-8ee1-2f18c6df33e6 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:32.905589 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:32.951934 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949074f0-8f0d-4ad6-b927-51fb53714028 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:32.988395 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ca9468-5c94-4a91-8dac-3830e46165ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:32.989030 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ca9468-5c94-4a91-8dac-3830e46165ac None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:32.989320 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ca9468-5c94-4a91-8dac-3830e46165ac None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:32.989605 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ca9468-5c94-4a91-8dac-3830e46165ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:32.990396 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ca9468-5c94-4a91-8dac-3830e46165ac None admin] RBAC: Adding query filter params (role.id=3e32dbf75f9b41f5adb9fe59851267bb, scope.project.id=42672e04d6ce4b0ab5f7eccfb0cc946c, user.id=87dd5c1c5e854d4b96e0b7dad6aa3719) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:32.990712 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ca9468-5c94-4a91-8dac-3830e46165ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:32.992146 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ca9468-5c94-4a91-8dac-3830e46165ac None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:33.004280 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656361e0-3b73-4300-8ee1-2f18c6df33e6 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:33.004487 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 407/826] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Aug 2 21:28:32 2022] GET /identity/v3/role_assignments?user.id=87dd5c1c5e854d4b96e0b7dad6aa3719&scope.project.id=42672e04d6ce4b0ab5f7eccfb0cc946c&role.id=3e32dbf75f9b41f5adb9fe59851267bb => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:28:33.042442 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5027d8e-b782-49d0-9539-557db6939d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:33.043063 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5027d8e-b782-49d0-9539-557db6939d96 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:33.043351 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5027d8e-b782-49d0-9539-557db6939d96 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:33.043632 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5027d8e-b782-49d0-9539-557db6939d96 None admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:33.044533 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5027d8e-b782-49d0-9539-557db6939d96 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:33.044848 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5027d8e-b782-49d0-9539-557db6939d96 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:33.046314 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5027d8e-b782-49d0-9539-557db6939d96 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:33.067517 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 420/827] 10.222.0.70 () {56 vars in 1149 bytes} [Tue Aug 2 21:28:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:28:33.073913 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ca9468-5c94-4a91-8dac-3830e46165ac None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:33.111933 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:33.173278 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c49718-e2b0-4c68-9c65-0c7ac450b6d9 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:33.173634 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c49718-e2b0-4c68-9c65-0c7ac450b6d9 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:33.173842 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c49718-e2b0-4c68-9c65-0c7ac450b6d9 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:33.175324 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 421/828] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:28:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 21:28:33.180920 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ee962c-b868-4e1e-a514-422100a24b2b None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:33.181201 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ee962c-b868-4e1e-a514-422100a24b2b None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:33.181477 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ee962c-b868-4e1e-a514-422100a24b2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:33.189893 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ca9468-5c94-4a91-8dac-3830e46165ac None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:33.211468 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-f2ee962c-b868-4e1e-a514-422100a24b2b None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:28:33.212702 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-f2ee962c-b868-4e1e-a514-422100a24b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:28:33.232321 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbccdede-6edf-4d06-8099-f2ef5d1d2c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:33.232766 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbccdede-6edf-4d06-8099-f2ef5d1d2c4f None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:33.232923 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbccdede-6edf-4d06-8099-f2ef5d1d2c4f None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:33.233193 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbccdede-6edf-4d06-8099-f2ef5d1d2c4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:33.247481 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbccdede-6edf-4d06-8099-f2ef5d1d2c4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:33.249477 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbccdede-6edf-4d06-8099-f2ef5d1d2c4f None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:33.266097 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-fbccdede-6edf-4d06-8099-f2ef5d1d2c4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:33.266097 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:33.266097 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:33.266097 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:33.266097 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:33.266097 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:33.266097 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:33.266097 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:33.266097 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:33.266097 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:33.266097 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:33.266097 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:33.266097 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:28:33.266097 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:28:33.266097 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:28:33.267034 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:28:33.267034 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:33.267034 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:33.267034 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:33.267034 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:33.267034 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:33.267034 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:33.267034 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:33.267034 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:33.267034 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:33.267034 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:33.267034 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:33.267034 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:33.267034 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:33.267034 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:33.267034 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:33.267034 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:33.267921 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:28:33.267921 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:28:33.267921 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:33.267921 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:28:33.269710 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 408/829] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 2 21:28:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 21:28:33.275440 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbccdede-6edf-4d06-8099-f2ef5d1d2c4f None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:33.300372 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 422/830] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:28:33 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 21:28:33.322183 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ee962c-b868-4e1e-a514-422100a24b2b None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:33.338204 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:33.386555 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:33.403403 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbccdede-6edf-4d06-8099-f2ef5d1d2c4f None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:33.442338 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037ee980-50f9-4748-b754-1a9185ecb299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:33.442970 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037ee980-50f9-4748-b754-1a9185ecb299 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:33.443256 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037ee980-50f9-4748-b754-1a9185ecb299 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:33.443694 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037ee980-50f9-4748-b754-1a9185ecb299 None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:33.444756 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037ee980-50f9-4748-b754-1a9185ecb299 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:33.445335 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037ee980-50f9-4748-b754-1a9185ecb299 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:33.446901 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037ee980-50f9-4748-b754-1a9185ecb299 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:33.450831 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ee962c-b868-4e1e-a514-422100a24b2b None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:33.461869 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 409/831] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 2 21:28:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:28:33.468079 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037ee980-50f9-4748-b754-1a9185ecb299 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:33.495326 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fce816-4d19-421a-8f4a-58343dc7eef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:33.495975 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fce816-4d19-421a-8f4a-58343dc7eef1 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:33.496333 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fce816-4d19-421a-8f4a-58343dc7eef1 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:33.496613 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fce816-4d19-421a-8f4a-58343dc7eef1 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:33.497243 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fce816-4d19-421a-8f4a-58343dc7eef1 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:33.498680 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fce816-4d19-421a-8f4a-58343dc7eef1 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:33.508494 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-51fce816-4d19-421a-8f4a-58343dc7eef1 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 02 21:28:33.508494 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:33.508494 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 21:28:33.508494 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 21:28:33.508494 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 21:28:33.508494 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 21:28:33.508494 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 21:28:33.508494 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 21:28:33.508494 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 02 21:28:33.508494 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:33.508494 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 21:28:33.508494 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:33.508494 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:33.508494 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:33.508494 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:33.508494 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:33.508494 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:33.509595 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:33.509595 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:33.509595 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:33.509595 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:33.509595 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:33.509595 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:33.509595 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 21:28:33.509595 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 21:28:33.509595 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 21:28:33.509595 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 21:28:33.509595 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:33.509595 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:33.509595 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:33.509595 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:33.509595 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:33.509595 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:33.510495 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:33.510495 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:33.510495 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:33.510495 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:33.510495 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:33.510495 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:33.510495 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:33.510495 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:33.510495 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:33.510495 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:33.510495 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 21:28:33.510495 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 21:28:33.510495 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 02 21:28:33.510495 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:33.514756 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 423/832] 10.222.0.70 () {56 vars in 1114 bytes} [Tue Aug 2 21:28:33 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 21:28:33.515628 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fce816-4d19-421a-8f4a-58343dc7eef1 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:33.618182 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:33.634127 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037ee980-50f9-4748-b754-1a9185ecb299 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:33.655330 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fce816-4d19-421a-8f4a-58343dc7eef1 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:33.710551 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18b73e2-1ec9-4824-8e37-0ce624321ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:33.712051 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18b73e2-1ec9-4824-8e37-0ce624321ee6 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:33.712927 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18b73e2-1ec9-4824-8e37-0ce624321ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:33.713661 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18b73e2-1ec9-4824-8e37-0ce624321ee6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:33.713815 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e364fd8-423c-4b55-9ec0-6440fab46a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:33.714788 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e364fd8-423c-4b55-9ec0-6440fab46a2b None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:33.715263 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e364fd8-423c-4b55-9ec0-6440fab46a2b None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:33.715733 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e364fd8-423c-4b55-9ec0-6440fab46a2b None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:33.716921 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e364fd8-423c-4b55-9ec0-6440fab46a2b None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:33.717499 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e364fd8-423c-4b55-9ec0-6440fab46a2b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:33.720128 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e364fd8-423c-4b55-9ec0-6440fab46a2b None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:33.728405 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18b73e2-1ec9-4824-8e37-0ce624321ee6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:33.731966 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18b73e2-1ec9-4824-8e37-0ce624321ee6 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:33.735476 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 424/833] 10.222.0.70 () {56 vars in 1114 bytes} [Tue Aug 2 21:28:33 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:33.736949 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e364fd8-423c-4b55-9ec0-6440fab46a2b None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:33.760670 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-f18b73e2-1ec9-4824-8e37-0ce624321ee6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:28:33.760670 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:33.760670 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:33.760670 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:33.760670 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:33.760670 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:33.760670 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:33.760670 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:33.760670 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:33.760670 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:33.760670 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:33.760670 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:33.760670 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 21:28:33.760670 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 21:28:33.760670 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 21:28:33.762425 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 21:28:33.762425 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:33.762425 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:33.762425 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:33.762425 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:33.762425 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:33.762425 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:33.762425 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:33.762425 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:33.762425 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:33.762425 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:33.762425 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:33.762425 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:33.762425 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:33.762425 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:33.762425 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:33.762425 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:33.763418 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 21:28:33.763418 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 21:28:33.763418 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 21:28:33.763418 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 21:28:33.763418 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 21:28:33.763418 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 21:28:33.763418 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:28:33.763418 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:28:33.765733 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 410/834] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Aug 2 21:28:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:33.771285 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18b73e2-1ec9-4824-8e37-0ce624321ee6 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:33.789549 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:33.877772 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e364fd8-423c-4b55-9ec0-6440fab46a2b None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:33.911396 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18b73e2-1ec9-4824-8e37-0ce624321ee6 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:33.917413 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb82af6-da6b-4333-b4ba-e096d8ee65c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:33.918036 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb82af6-da6b-4333-b4ba-e096d8ee65c5 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:33.918314 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb82af6-da6b-4333-b4ba-e096d8ee65c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:33.918586 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb82af6-da6b-4333-b4ba-e096d8ee65c5 None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:33.919765 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb82af6-da6b-4333-b4ba-e096d8ee65c5 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:33.920073 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb82af6-da6b-4333-b4ba-e096d8ee65c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:33.921893 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb82af6-da6b-4333-b4ba-e096d8ee65c5 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:33.935801 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 425/835] 10.222.0.70 () {56 vars in 1114 bytes} [Tue Aug 2 21:28:33 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:33.935801 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ef3f8e-102d-4472-8648-bced7588df3d None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:33.935801 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ef3f8e-102d-4472-8648-bced7588df3d None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:33.935801 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ef3f8e-102d-4472-8648-bced7588df3d None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:33.935801 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 426/836] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:28:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:28:33.938573 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b89935-6f46-4651-9513-07c1654e3dda None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:33.938862 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b89935-6f46-4651-9513-07c1654e3dda None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:33.939140 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b89935-6f46-4651-9513-07c1654e3dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:33.952984 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:33.956073 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c990e887-515a-48b1-942e-1b294ddb14cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:33.957058 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c990e887-515a-48b1-942e-1b294ddb14cf None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:33.957575 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c990e887-515a-48b1-942e-1b294ddb14cf None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:33.958205 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c990e887-515a-48b1-942e-1b294ddb14cf None admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:33.959235 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c990e887-515a-48b1-942e-1b294ddb14cf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:33.959372 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-29b89935-6f46-4651-9513-07c1654e3dda None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:28:33.959884 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c990e887-515a-48b1-942e-1b294ddb14cf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:33.960728 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-29b89935-6f46-4651-9513-07c1654e3dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:28:33.961868 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c990e887-515a-48b1-942e-1b294ddb14cf None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:33.982612 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 411/837] 10.222.0.70 () {56 vars in 1148 bytes} [Tue Aug 2 21:28:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:33.984623 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c990e887-515a-48b1-942e-1b294ddb14cf None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:34.051207 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 427/838] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:28:33 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 21:28:34.073884 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b89935-6f46-4651-9513-07c1654e3dda None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:34.078952 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:34.126275 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c990e887-515a-48b1-942e-1b294ddb14cf None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:34.170332 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8141bc35-3bdb-44c0-be58-c0fd1fb7c740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:34.170907 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8141bc35-3bdb-44c0-be58-c0fd1fb7c740 None admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:34.171190 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8141bc35-3bdb-44c0-be58-c0fd1fb7c740 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:34.171462 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8141bc35-3bdb-44c0-be58-c0fd1fb7c740 None admin] PATH_INFO: `/v3/projects/42672e04d6ce4b0ab5f7eccfb0cc946c/users/6be7b2bcfebd45389ca289c34fbabc3e/roles/59a4c9a6a22d4bdb966856a28c4aabaf` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:34.190730 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8141bc35-3bdb-44c0-be58-c0fd1fb7c740 None admin] RBAC: Authorizing `identity:create_grant(project_id=42672e04d6ce4b0ab5f7eccfb0cc946c, user_id=6be7b2bcfebd45389ca289c34fbabc3e, role_id=59a4c9a6a22d4bdb966856a28c4aabaf)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:34.192171 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8141bc35-3bdb-44c0-be58-c0fd1fb7c740 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:34.206214 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 412/839] 10.222.0.70 () {58 vars in 1439 bytes} [Tue Aug 2 21:28:33 2022] PUT /identity/v3/projects/42672e04d6ce4b0ab5f7eccfb0cc946c/users/6be7b2bcfebd45389ca289c34fbabc3e/roles/59a4c9a6a22d4bdb966856a28c4aabaf => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:28:34.217840 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b89935-6f46-4651-9513-07c1654e3dda None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:34.263342 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022d93d3-389e-46cd-9955-a8b79e22bde3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:34.264076 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022d93d3-389e-46cd-9955-a8b79e22bde3 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:34.264400 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022d93d3-389e-46cd-9955-a8b79e22bde3 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:34.264682 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022d93d3-389e-46cd-9955-a8b79e22bde3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:34.268461 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:34.279957 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022d93d3-389e-46cd-9955-a8b79e22bde3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:28:34.285826 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-022d93d3-389e-46cd-9955-a8b79e22bde3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 21:28:34.285826 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:34.285826 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:34.285826 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:34.285826 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:34.285826 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:34.285826 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:34.285826 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:34.285826 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:34.285826 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:34.285826 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:34.285826 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:34.285826 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:28:34.285826 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:28:34.285826 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:28:34.285826 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:28:34.286858 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:28:34.286858 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:28:34.286858 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:28:34.286858 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:28:34.286858 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:34.286858 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:34.286858 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:34.286858 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:34.286858 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:34.286858 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:34.286858 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:34.286858 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:34.286858 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:34.286858 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:34.286858 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:34.286858 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:34.287714 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:34.287714 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:34.287714 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:34.287714 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:34.287714 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:28:34.287714 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:28:34.287714 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:28:34.287714 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:28:34.287714 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:28:34.287714 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:28:34.287714 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 21:28:34.287714 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:34.291373 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 428/840] 10.222.0.70 () {56 vars in 1096 bytes} [Tue Aug 2 21:28:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 21:28:34.297408 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8141bc35-3bdb-44c0-be58-c0fd1fb7c740 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:34.417229 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8141bc35-3bdb-44c0-be58-c0fd1fb7c740 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:34.436391 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:34.456959 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481752e3-cd46-4325-97ef-d48369200b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:34.457583 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481752e3-cd46-4325-97ef-d48369200b26 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:34.457884 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481752e3-cd46-4325-97ef-d48369200b26 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:34.458140 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481752e3-cd46-4325-97ef-d48369200b26 None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:34.458918 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481752e3-cd46-4325-97ef-d48369200b26 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:34.459224 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481752e3-cd46-4325-97ef-d48369200b26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:34.460675 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481752e3-cd46-4325-97ef-d48369200b26 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:34.475870 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 413/841] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 2 21:28:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:34.481645 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022d93d3-389e-46cd-9955-a8b79e22bde3 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:34.587243 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022d93d3-389e-46cd-9955-a8b79e22bde3 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:34.624010 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb23c574-9044-4781-813c-1866ff2d6b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:34.625063 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb23c574-9044-4781-813c-1866ff2d6b60 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:34.625551 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb23c574-9044-4781-813c-1866ff2d6b60 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:34.626031 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb23c574-9044-4781-813c-1866ff2d6b60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:34.637374 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb23c574-9044-4781-813c-1866ff2d6b60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:34.639124 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb23c574-9044-4781-813c-1866ff2d6b60 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:34.654444 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-cb23c574-9044-4781-813c-1866ff2d6b60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:34.654444 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:34.654444 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:34.654444 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:34.654444 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:34.654444 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:34.654444 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:34.654444 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:34.654444 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:34.654444 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:34.654444 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:34.654444 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:34.654444 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:28:34.654444 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:28:34.654444 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:28:34.655369 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:28:34.655369 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:34.655369 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:34.655369 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:34.655369 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:34.655369 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:34.655369 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:34.655369 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:34.655369 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:34.655369 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:34.655369 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:34.655369 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:34.655369 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:34.655369 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:34.655369 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:34.655369 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:34.655369 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:34.656377 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:28:34.656377 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:28:34.656377 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:34.656377 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:34.663017 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 429/842] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 2 21:28:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:34.664657 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481752e3-cd46-4325-97ef-d48369200b26 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:34.779531 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481752e3-cd46-4325-97ef-d48369200b26 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:34.815002 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387dda6b-6e59-41dd-8730-b9427b6f5f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:34.815977 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387dda6b-6e59-41dd-8730-b9427b6f5f1f None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:34.816497 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387dda6b-6e59-41dd-8730-b9427b6f5f1f None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:34.817017 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387dda6b-6e59-41dd-8730-b9427b6f5f1f None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:34.817965 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387dda6b-6e59-41dd-8730-b9427b6f5f1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:34.818478 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387dda6b-6e59-41dd-8730-b9427b6f5f1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:34.820046 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387dda6b-6e59-41dd-8730-b9427b6f5f1f None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:34.837318 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 414/843] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 2 21:28:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:34.838996 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb23c574-9044-4781-813c-1866ff2d6b60 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:34.891238 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:34.946440 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb23c574-9044-4781-813c-1866ff2d6b60 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:34.982000 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa34591a-db38-4bf5-ac4a-7c8df89fc146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:34.982651 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa34591a-db38-4bf5-ac4a-7c8df89fc146 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:34.982937 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa34591a-db38-4bf5-ac4a-7c8df89fc146 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:34.983218 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa34591a-db38-4bf5-ac4a-7c8df89fc146 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:34.991708 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa34591a-db38-4bf5-ac4a-7c8df89fc146 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:34.993193 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa34591a-db38-4bf5-ac4a-7c8df89fc146 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:35.007563 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-fa34591a-db38-4bf5-ac4a-7c8df89fc146 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 02 21:28:35.007563 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:35.007563 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:35.007563 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:35.007563 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:35.007563 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:35.007563 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:35.007563 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:35.007563 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:35.007563 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:35.007563 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:35.007563 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:35.007563 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 21:28:35.007563 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 21:28:35.007563 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 21:28:35.007563 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 21:28:35.008632 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:35.008632 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:35.008632 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 21:28:35.008632 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:28:35.008632 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 21:28:35.008632 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:28:35.008632 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:35.008632 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:35.008632 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:35.008632 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:35.008632 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:35.008632 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:35.008632 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:35.008632 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:35.008632 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:35.008632 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:35.008632 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:35.008632 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:35.009572 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:35.009572 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:35.009572 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 21:28:35.009572 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 21:28:35.009572 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 21:28:35.009572 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 21:28:35.009572 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 21:28:35.009572 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 21:28:35.009572 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 02 21:28:35.009572 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:35.009572 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 430/844] 10.222.0.70 () {56 vars in 1096 bytes} [Tue Aug 2 21:28:34 2022] GET /identity/v3/users/swift => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:35.015086 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387dda6b-6e59-41dd-8730-b9427b6f5f1f None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:35.065364 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:35.126067 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387dda6b-6e59-41dd-8730-b9427b6f5f1f None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:35.161604 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438588b7-6987-4126-98cf-d1bff1731d23 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:35.161960 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438588b7-6987-4126-98cf-d1bff1731d23 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:35.162169 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438588b7-6987-4126-98cf-d1bff1731d23 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:35.164014 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 431/845] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:28:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 21:28:35.164763 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3509a6f8-b1d0-441e-8d8b-6b4e48adb287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:35.165387 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3509a6f8-b1d0-441e-8d8b-6b4e48adb287 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:35.165673 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3509a6f8-b1d0-441e-8d8b-6b4e48adb287 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:35.165952 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3509a6f8-b1d0-441e-8d8b-6b4e48adb287 None admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:35.167298 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3509a6f8-b1d0-441e-8d8b-6b4e48adb287 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:35.167608 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3509a6f8-b1d0-441e-8d8b-6b4e48adb287 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:35.169060 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3509a6f8-b1d0-441e-8d8b-6b4e48adb287 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:35.169979 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff2d763-19c8-40aa-b6c0-08d6bbc9764c None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:35.170269 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff2d763-19c8-40aa-b6c0-08d6bbc9764c None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:35.170549 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff2d763-19c8-40aa-b6c0-08d6bbc9764c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:35.187480 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 415/846] 10.222.0.70 () {56 vars in 1135 bytes} [Tue Aug 2 21:28:35 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:35.193330 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3509a6f8-b1d0-441e-8d8b-6b4e48adb287 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:35.198619 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-6ff2d763-19c8-40aa-b6c0-08d6bbc9764c None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:28:35.199842 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-6ff2d763-19c8-40aa-b6c0-08d6bbc9764c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:28:35.288333 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 432/847] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:28:35 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 21:28:35.302804 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:35.307577 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3509a6f8-b1d0-441e-8d8b-6b4e48adb287 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:35.314160 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff2d763-19c8-40aa-b6c0-08d6bbc9764c None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:35.356046 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda5509a-192f-442a-a2af-6099621dcaf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:35.356605 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda5509a-192f-442a-a2af-6099621dcaf6 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:35.356890 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda5509a-192f-442a-a2af-6099621dcaf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:35.357167 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda5509a-192f-442a-a2af-6099621dcaf6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:35.363422 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:35.440823 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff2d763-19c8-40aa-b6c0-08d6bbc9764c None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:35.449267 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda5509a-192f-442a-a2af-6099621dcaf6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:35.451641 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda5509a-192f-442a-a2af-6099621dcaf6 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:35.482988 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4affbd5-8992-4472-86da-8999620b6d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:35.484118 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4affbd5-8992-4472-86da-8999620b6d51 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:35.484528 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4affbd5-8992-4472-86da-8999620b6d51 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:35.484903 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4affbd5-8992-4472-86da-8999620b6d51 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:35.485917 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4affbd5-8992-4472-86da-8999620b6d51 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:35.487821 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4affbd5-8992-4472-86da-8999620b6d51 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:35.501928 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-b4affbd5-8992-4472-86da-8999620b6d51 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 02 21:28:35.501928 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:35.501928 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 21:28:35.501928 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 21:28:35.501928 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 21:28:35.501928 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 21:28:35.501928 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 21:28:35.501928 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 21:28:35.501928 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 02 21:28:35.501928 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:35.501928 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 21:28:35.501928 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:35.501928 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:35.501928 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:35.501928 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:35.501928 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:35.502963 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:35.502963 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:35.502963 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:35.502963 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:35.502963 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:35.502963 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:35.502963 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:35.502963 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 21:28:35.502963 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 21:28:35.502963 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 21:28:35.502963 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 21:28:35.502963 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:35.502963 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:35.502963 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:35.502963 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:35.502963 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:35.503802 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:35.503802 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:35.503802 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:35.503802 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:35.503802 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:35.503802 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:35.503802 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:35.503802 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:35.503802 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:35.503802 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:35.503802 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:35.503802 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 21:28:35.503802 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 21:28:35.503802 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 02 21:28:35.503802 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:35.508308 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 433/848] 10.222.0.70 () {56 vars in 1132 bytes} [Tue Aug 2 21:28:35 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 21:28:35.509315 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4affbd5-8992-4472-86da-8999620b6d51 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:35.569765 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:35.579328 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 416/849] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 2 21:28:35 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 02 21:28:35.580504 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda5509a-192f-442a-a2af-6099621dcaf6 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:35.623753 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4affbd5-8992-4472-86da-8999620b6d51 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:35.625680 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:35.661633 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a60a03-d41d-44ee-af23-d86ae7ffb4ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:35.662573 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a60a03-d41d-44ee-af23-d86ae7ffb4ae None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:35.663029 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a60a03-d41d-44ee-af23-d86ae7ffb4ae None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:35.663472 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a60a03-d41d-44ee-af23-d86ae7ffb4ae None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:35.664450 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a60a03-d41d-44ee-af23-d86ae7ffb4ae None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:35.664967 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a60a03-d41d-44ee-af23-d86ae7ffb4ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:35.667390 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a60a03-d41d-44ee-af23-d86ae7ffb4ae None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:35.672904 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 434/850] 10.222.0.70 () {56 vars in 1126 bytes} [Tue Aug 2 21:28:35 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:35.678195 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a60a03-d41d-44ee-af23-d86ae7ffb4ae None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:35.703487 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda5509a-192f-442a-a2af-6099621dcaf6 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:35.747816 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c30995-3068-456c-8f37-d026fcca9864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:35.748561 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c30995-3068-456c-8f37-d026fcca9864 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:35.748917 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c30995-3068-456c-8f37-d026fcca9864 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:35.749263 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c30995-3068-456c-8f37-d026fcca9864 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:35.762885 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c30995-3068-456c-8f37-d026fcca9864 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:35.764147 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c30995-3068-456c-8f37-d026fcca9864 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:35.782181 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-a4c30995-3068-456c-8f37-d026fcca9864 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:35.782181 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:35.782181 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:35.782181 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:35.782181 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:35.782181 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:35.782181 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:35.782181 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:35.782181 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:35.782181 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:35.782181 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:35.782181 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:35.782181 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:28:35.782181 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:28:35.782181 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:28:35.783110 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:28:35.783110 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:35.783110 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:35.783110 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:35.783110 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:35.783110 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:35.783110 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:35.783110 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:35.783110 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:35.783110 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:35.783110 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:35.783110 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:35.783110 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:35.783110 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:35.783110 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:35.783110 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:35.783110 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:35.784579 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:28:35.784579 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:28:35.784579 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:35.784579 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:28:35.787896 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 417/851] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 2 21:28:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:35.788972 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c30995-3068-456c-8f37-d026fcca9864 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:35.798666 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a60a03-d41d-44ee-af23-d86ae7ffb4ae None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:35.833845 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7d1a6e-a5fc-4925-b659-1d8da47a3f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:35.834762 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7d1a6e-a5fc-4925-b659-1d8da47a3f42 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:35.835217 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7d1a6e-a5fc-4925-b659-1d8da47a3f42 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:35.835766 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7d1a6e-a5fc-4925-b659-1d8da47a3f42 None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:35.836660 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7d1a6e-a5fc-4925-b659-1d8da47a3f42 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:35.837139 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7d1a6e-a5fc-4925-b659-1d8da47a3f42 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:35.839258 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7d1a6e-a5fc-4925-b659-1d8da47a3f42 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:35.844555 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 435/852] 10.222.0.70 () {56 vars in 1126 bytes} [Tue Aug 2 21:28:35 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:35.865839 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:35.912649 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c30995-3068-456c-8f37-d026fcca9864 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:35.950756 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716366c8-fce7-4740-9975-8dd738937ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:35.951517 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716366c8-fce7-4740-9975-8dd738937ba9 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:35.951865 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716366c8-fce7-4740-9975-8dd738937ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:35.952203 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716366c8-fce7-4740-9975-8dd738937ba9 None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:35.953003 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716366c8-fce7-4740-9975-8dd738937ba9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:35.953375 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716366c8-fce7-4740-9975-8dd738937ba9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:35.954843 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716366c8-fce7-4740-9975-8dd738937ba9 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:35.969673 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 418/853] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 2 21:28:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:35.977437 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7d1a6e-a5fc-4925-b659-1d8da47a3f42 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:36.013205 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:36.079793 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a252c083-f07a-4472-8a7e-ccc0e8f503e8 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:36.080349 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a252c083-f07a-4472-8a7e-ccc0e8f503e8 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:36.080818 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a252c083-f07a-4472-8a7e-ccc0e8f503e8 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:36.082687 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 419/854] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:28:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:28:36.090511 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f49e107-17ae-42af-b583-a25d624c0c3f None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:36.090802 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f49e107-17ae-42af-b583-a25d624c0c3f None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:36.091275 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f49e107-17ae-42af-b583-a25d624c0c3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:36.096199 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7d1a6e-a5fc-4925-b659-1d8da47a3f42 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:36.115116 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-7f49e107-17ae-42af-b583-a25d624c0c3f None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:28:36.116585 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-7f49e107-17ae-42af-b583-a25d624c0c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:28:36.140649 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf21be29-f24f-4388-b7bc-e9fb3f25b738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:36.141302 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf21be29-f24f-4388-b7bc-e9fb3f25b738 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:36.141653 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf21be29-f24f-4388-b7bc-e9fb3f25b738 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:36.141952 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf21be29-f24f-4388-b7bc-e9fb3f25b738 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:36.151748 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf21be29-f24f-4388-b7bc-e9fb3f25b738 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:36.153239 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf21be29-f24f-4388-b7bc-e9fb3f25b738 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:36.168455 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-bf21be29-f24f-4388-b7bc-e9fb3f25b738 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:28:36.168455 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:36.168455 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:36.168455 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:36.168455 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:36.168455 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:36.168455 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:36.168455 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:36.168455 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:36.168455 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:36.168455 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:36.168455 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:36.168455 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 21:28:36.168455 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 21:28:36.168455 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 21:28:36.169546 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 21:28:36.169546 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:36.169546 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:36.169546 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:36.169546 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:36.169546 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:36.169546 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:36.169546 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:36.169546 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:36.169546 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:36.169546 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:36.169546 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:36.169546 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:36.169546 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:36.169546 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:36.169546 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:36.169546 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:36.170586 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 21:28:36.170586 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 21:28:36.170586 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 21:28:36.170586 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 21:28:36.170586 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 21:28:36.170586 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 21:28:36.170586 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:28:36.170586 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:36.172714 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 436/855] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Aug 2 21:28:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:36.178706 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf21be29-f24f-4388-b7bc-e9fb3f25b738 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:36.194932 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 420/856] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:28:36 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 21:28:36.217564 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f49e107-17ae-42af-b583-a25d624c0c3f None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:36.260213 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:36.285145 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:36.298354 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf21be29-f24f-4388-b7bc-e9fb3f25b738 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:36.331277 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f49e107-17ae-42af-b583-a25d624c0c3f None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:36.336525 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c16ac5-c0f6-4a70-8cf1-20015a3e6a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:36.337344 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c16ac5-c0f6-4a70-8cf1-20015a3e6a79 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:36.337780 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c16ac5-c0f6-4a70-8cf1-20015a3e6a79 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:36.338746 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c16ac5-c0f6-4a70-8cf1-20015a3e6a79 None admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:36.339763 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c16ac5-c0f6-4a70-8cf1-20015a3e6a79 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:36.340220 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c16ac5-c0f6-4a70-8cf1-20015a3e6a79 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:36.342048 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c16ac5-c0f6-4a70-8cf1-20015a3e6a79 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:36.361514 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 437/857] 10.222.0.70 () {56 vars in 1148 bytes} [Tue Aug 2 21:28:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:36.363335 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423b7d9b-1c50-4b66-8504-978e89710647 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:36.363629 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423b7d9b-1c50-4b66-8504-978e89710647 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:36.363969 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423b7d9b-1c50-4b66-8504-978e89710647 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:36.365366 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 438/858] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:28:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:28:36.365951 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423b7d9b-1c50-4b66-8504-978e89710647 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:36.368209 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3be363-a6e7-4048-86a1-9ba7b9b71832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:36.369073 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3be363-a6e7-4048-86a1-9ba7b9b71832 None admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:36.369567 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3be363-a6e7-4048-86a1-9ba7b9b71832 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:36.370052 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3be363-a6e7-4048-86a1-9ba7b9b71832 None admin] PATH_INFO: `/v3/services` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:36.370923 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3be363-a6e7-4048-86a1-9ba7b9b71832 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:36.372507 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3be363-a6e7-4048-86a1-9ba7b9b71832 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:36.396287 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 421/859] 10.222.0.70 () {60 vars in 1141 bytes} [Tue Aug 2 21:28:36 2022] POST /identity/v3/services => generated 251 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 21:28:36.396287 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4b6796-f3d6-4886-88bb-87347d43fd25 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:36.396287 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4b6796-f3d6-4886-88bb-87347d43fd25 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:36.396287 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4b6796-f3d6-4886-88bb-87347d43fd25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:36.413128 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-ea4b6796-f3d6-4886-88bb-87347d43fd25 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:28:36.414413 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-ea4b6796-f3d6-4886-88bb-87347d43fd25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:28:36.497600 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 422/860] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:28:36 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 21:28:36.502677 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423b7d9b-1c50-4b66-8504-978e89710647 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:36.523696 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4b6796-f3d6-4886-88bb-87347d43fd25 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:36.542906 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571d36f6-ba76-4ecb-b04d-067e52657755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:36.543799 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571d36f6-ba76-4ecb-b04d-067e52657755 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:36.544185 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571d36f6-ba76-4ecb-b04d-067e52657755 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:36.544586 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571d36f6-ba76-4ecb-b04d-067e52657755 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:36.545628 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571d36f6-ba76-4ecb-b04d-067e52657755 None admin] RBAC: Adding query filter params (role.id=3e32dbf75f9b41f5adb9fe59851267bb, scope.project.id=42672e04d6ce4b0ab5f7eccfb0cc946c, user.id=2ee7ebf40212465aac997b461a2d10fc) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:36.546051 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571d36f6-ba76-4ecb-b04d-067e52657755 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:36.547725 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571d36f6-ba76-4ecb-b04d-067e52657755 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:36.553297 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:36.556330 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 439/861] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Aug 2 21:28:36 2022] GET /identity/v3/role_assignments?user.id=2ee7ebf40212465aac997b461a2d10fc&scope.project.id=42672e04d6ce4b0ab5f7eccfb0cc946c&role.id=3e32dbf75f9b41f5adb9fe59851267bb => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:36.637913 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4b6796-f3d6-4886-88bb-87347d43fd25 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:36.675896 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d84efc2-71ee-4b5f-9f67-868baac954f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:36.676593 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d84efc2-71ee-4b5f-9f67-868baac954f8 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:36.676877 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d84efc2-71ee-4b5f-9f67-868baac954f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:36.677148 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d84efc2-71ee-4b5f-9f67-868baac954f8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:36.689373 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d84efc2-71ee-4b5f-9f67-868baac954f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:28:36.694558 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-6d84efc2-71ee-4b5f-9f67-868baac954f8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 21:28:36.694558 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:36.694558 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:36.694558 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:36.694558 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:36.694558 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:36.694558 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:36.694558 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:36.694558 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:36.694558 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:36.694558 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:36.694558 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:36.694558 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:28:36.694558 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:28:36.694558 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:28:36.694558 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:28:36.695720 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:28:36.695720 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:28:36.695720 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:28:36.695720 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:28:36.695720 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:36.695720 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:36.695720 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:36.695720 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:36.695720 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:36.695720 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:36.695720 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:36.695720 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:36.695720 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:36.695720 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:36.695720 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:36.695720 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:36.696760 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:36.696760 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:36.696760 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:36.696760 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:36.696760 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:28:36.696760 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:28:36.696760 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:28:36.696760 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:28:36.696760 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:28:36.696760 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:28:36.696760 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 21:28:36.696760 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:28:36.700356 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 423/862] 10.222.0.70 () {56 vars in 1102 bytes} [Tue Aug 2 21:28:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 21:28:36.702680 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571d36f6-ba76-4ecb-b04d-067e52657755 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:36.717611 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:36.819540 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571d36f6-ba76-4ecb-b04d-067e52657755 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:36.855885 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab2199b-1fe4-4d77-a89e-fa7f59c2f6df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:36.856822 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab2199b-1fe4-4d77-a89e-fa7f59c2f6df None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:36.857273 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab2199b-1fe4-4d77-a89e-fa7f59c2f6df None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:36.857694 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab2199b-1fe4-4d77-a89e-fa7f59c2f6df None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:36.858695 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab2199b-1fe4-4d77-a89e-fa7f59c2f6df None admin] RBAC: Adding query filter params (name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:36.859150 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab2199b-1fe4-4d77-a89e-fa7f59c2f6df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:36.860738 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab2199b-1fe4-4d77-a89e-fa7f59c2f6df None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:36.870235 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 440/863] 10.222.0.70 () {56 vars in 1103 bytes} [Tue Aug 2 21:28:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:36.876281 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d84efc2-71ee-4b5f-9f67-868baac954f8 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:36.976605 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:36.981839 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d84efc2-71ee-4b5f-9f67-868baac954f8 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:37.018738 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e2b587-8467-4529-935e-bc7c27104488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:37.019439 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e2b587-8467-4529-935e-bc7c27104488 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:37.019729 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e2b587-8467-4529-935e-bc7c27104488 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:37.020012 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e2b587-8467-4529-935e-bc7c27104488 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:37.030708 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e2b587-8467-4529-935e-bc7c27104488 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:37.032187 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e2b587-8467-4529-935e-bc7c27104488 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:37.049354 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-73e2b587-8467-4529-935e-bc7c27104488 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:37.049354 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:37.049354 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:37.049354 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:37.049354 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:37.049354 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:37.049354 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:37.049354 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:37.049354 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:37.049354 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:37.049354 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:37.049354 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:37.049354 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:28:37.049354 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:28:37.049354 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:28:37.050497 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:28:37.050497 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:37.050497 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:37.050497 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:37.050497 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:37.050497 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:37.050497 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:37.050497 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:37.050497 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:37.050497 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:37.050497 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:37.050497 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:37.050497 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:37.050497 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:37.050497 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:37.050497 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:37.050497 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:37.051762 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:28:37.051762 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:28:37.051762 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:37.051762 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:28:37.051762 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 424/864] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 2 21:28:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:37.058485 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab2199b-1fe4-4d77-a89e-fa7f59c2f6df None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:37.131792 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:37.164355 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab2199b-1fe4-4d77-a89e-fa7f59c2f6df None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:37.200412 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea24bb31-affd-4a22-b0f5-a075a195acae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:37.201042 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea24bb31-affd-4a22-b0f5-a075a195acae None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:37.201324 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea24bb31-affd-4a22-b0f5-a075a195acae None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:37.201601 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea24bb31-affd-4a22-b0f5-a075a195acae None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:37.202302 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea24bb31-affd-4a22-b0f5-a075a195acae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:37.202609 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea24bb31-affd-4a22-b0f5-a075a195acae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:37.204065 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea24bb31-affd-4a22-b0f5-a075a195acae None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:37.217339 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 441/865] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 2 21:28:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:37.222990 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e2b587-8467-4529-935e-bc7c27104488 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:37.347038 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e2b587-8467-4529-935e-bc7c27104488 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:37.381565 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9664c08-43ba-42df-bee6-f9fceac80db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:37.382265 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9664c08-43ba-42df-bee6-f9fceac80db3 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:37.382495 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9664c08-43ba-42df-bee6-f9fceac80db3 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:37.382772 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9664c08-43ba-42df-bee6-f9fceac80db3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:37.391337 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9664c08-43ba-42df-bee6-f9fceac80db3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:37.392882 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9664c08-43ba-42df-bee6-f9fceac80db3 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:37.394705 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:37.405046 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-a9664c08-43ba-42df-bee6-f9fceac80db3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 02 21:28:37.405046 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:37.405046 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:37.405046 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:37.405046 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:37.405046 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:37.405046 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:37.405046 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:37.405046 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:37.405046 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:37.405046 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:37.405046 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:37.405046 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 21:28:37.405046 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 21:28:37.405046 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 21:28:37.405046 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 21:28:37.405999 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:37.405999 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:37.405999 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 21:28:37.405999 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:28:37.405999 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 21:28:37.405999 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:28:37.405999 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:37.405999 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:37.405999 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:37.405999 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:37.405999 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:37.405999 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:37.405999 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:37.405999 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:37.405999 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:37.405999 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:37.405999 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:37.405999 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:37.407086 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:37.407086 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:37.407086 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 21:28:37.407086 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 21:28:37.407086 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 21:28:37.407086 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 21:28:37.407086 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 21:28:37.407086 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 21:28:37.407086 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 02 21:28:37.407086 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:28:37.407086 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 425/866] 10.222.0.70 () {56 vars in 1117 bytes} [Tue Aug 2 21:28:37 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:37.413829 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea24bb31-affd-4a22-b0f5-a075a195acae None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:37.515942 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea24bb31-affd-4a22-b0f5-a075a195acae None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:37.546623 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:37.551734 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabd9481-a1cf-442f-a78e-3dbdbc2420a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:37.552390 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabd9481-a1cf-442f-a78e-3dbdbc2420a7 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:37.552703 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabd9481-a1cf-442f-a78e-3dbdbc2420a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:37.552954 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabd9481-a1cf-442f-a78e-3dbdbc2420a7 None admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:37.553753 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabd9481-a1cf-442f-a78e-3dbdbc2420a7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:37.554057 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabd9481-a1cf-442f-a78e-3dbdbc2420a7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:37.555495 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabd9481-a1cf-442f-a78e-3dbdbc2420a7 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:37.575017 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 442/867] 10.222.0.70 () {56 vars in 1149 bytes} [Tue Aug 2 21:28:37 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:37.580806 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9664c08-43ba-42df-bee6-f9fceac80db3 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:37.688282 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9664c08-43ba-42df-bee6-f9fceac80db3 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:37.723081 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59bcebd-49c8-4a13-abba-b6425f2e6c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:37.723704 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59bcebd-49c8-4a13-abba-b6425f2e6c85 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:37.723981 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59bcebd-49c8-4a13-abba-b6425f2e6c85 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:37.724269 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59bcebd-49c8-4a13-abba-b6425f2e6c85 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:37.797986 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:37.801962 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59bcebd-49c8-4a13-abba-b6425f2e6c85 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:37.803457 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59bcebd-49c8-4a13-abba-b6425f2e6c85 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:37.910652 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 426/868] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 2 21:28:37 2022] GET /identity/v3/auth/tokens => generated 1262 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 21:28:37.917138 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabd9481-a1cf-442f-a78e-3dbdbc2420a7 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:37.973245 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6769b303-2d29-4b79-98de-e25c8da0e51b None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:37.973691 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6769b303-2d29-4b79-98de-e25c8da0e51b None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:37.974103 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6769b303-2d29-4b79-98de-e25c8da0e51b None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:37.975765 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 427/869] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:28:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 21:28:37.981070 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348fac99-0bc1-44b1-b5e8-fee1e2c57122 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:37.981429 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348fac99-0bc1-44b1-b5e8-fee1e2c57122 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:37.981821 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348fac99-0bc1-44b1-b5e8-fee1e2c57122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:38.002132 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-348fac99-0bc1-44b1-b5e8-fee1e2c57122 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:28:38.003637 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-348fac99-0bc1-44b1-b5e8-fee1e2c57122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:28:38.020566 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabd9481-a1cf-442f-a78e-3dbdbc2420a7 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:38.061399 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a206b18a-cf02-4bd5-b3ae-08c0d8040fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:38.062078 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a206b18a-cf02-4bd5-b3ae-08c0d8040fae None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:38.062651 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a206b18a-cf02-4bd5-b3ae-08c0d8040fae None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:38.062996 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a206b18a-cf02-4bd5-b3ae-08c0d8040fae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:38.075853 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 428/870] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:28:37 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 21:28:38.077180 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a206b18a-cf02-4bd5-b3ae-08c0d8040fae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:38.078894 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a206b18a-cf02-4bd5-b3ae-08c0d8040fae None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:38.094091 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-a206b18a-cf02-4bd5-b3ae-08c0d8040fae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:38.094091 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:38.094091 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:38.094091 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:38.094091 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:38.094091 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:38.094091 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:38.094091 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:38.094091 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:38.094091 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:38.094091 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:38.094091 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:38.094091 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:28:38.094091 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:28:38.094091 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:28:38.094985 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:28:38.094985 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:38.094985 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:38.094985 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:38.094985 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:38.094985 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:38.094985 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:38.094985 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:38.094985 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:38.094985 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:38.094985 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:38.094985 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:38.094985 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:38.094985 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:38.094985 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:38.094985 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:38.094985 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:38.095856 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:28:38.095856 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:28:38.095856 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:38.095856 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:38.098082 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348fac99-0bc1-44b1-b5e8-fee1e2c57122 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:38.104343 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 443/871] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 2 21:28:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:38.112067 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a206b18a-cf02-4bd5-b3ae-08c0d8040fae None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:38.132111 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:38.159887 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:38.208103 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348fac99-0bc1-44b1-b5e8-fee1e2c57122 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:38.230349 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a206b18a-cf02-4bd5-b3ae-08c0d8040fae None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:38.250872 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9e30b5-77bb-4c5b-8fc3-4fc2d49c802f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:38.251654 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9e30b5-77bb-4c5b-8fc3-4fc2d49c802f None admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:38.252039 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9e30b5-77bb-4c5b-8fc3-4fc2d49c802f None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:38.252465 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9e30b5-77bb-4c5b-8fc3-4fc2d49c802f None admin] PATH_INFO: `/v3/services` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:38.253228 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9e30b5-77bb-4c5b-8fc3-4fc2d49c802f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:38.254704 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9e30b5-77bb-4c5b-8fc3-4fc2d49c802f None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:38.273956 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05727a5-4397-4f53-b389-555ad2df69cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:38.274935 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05727a5-4397-4f53-b389-555ad2df69cb None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:38.275447 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05727a5-4397-4f53-b389-555ad2df69cb None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:38.275924 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05727a5-4397-4f53-b389-555ad2df69cb None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:38.276891 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05727a5-4397-4f53-b389-555ad2df69cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:38.277334 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05727a5-4397-4f53-b389-555ad2df69cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:38.278955 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05727a5-4397-4f53-b389-555ad2df69cb None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:38.281109 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 429/872] 10.222.0.70 () {60 vars in 1141 bytes} [Tue Aug 2 21:28:38 2022] POST /identity/v3/services => generated 269 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 21:28:38.310246 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 444/873] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 2 21:28:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:38.313529 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9e30b5-77bb-4c5b-8fc3-4fc2d49c802f None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:38.413865 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:38.437176 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9e30b5-77bb-4c5b-8fc3-4fc2d49c802f None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:38.474803 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8340b84-bf6e-4fdc-a45e-307b9b18bf86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:38.475447 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8340b84-bf6e-4fdc-a45e-307b9b18bf86 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:38.475727 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8340b84-bf6e-4fdc-a45e-307b9b18bf86 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:38.475999 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8340b84-bf6e-4fdc-a45e-307b9b18bf86 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:38.483778 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8340b84-bf6e-4fdc-a45e-307b9b18bf86 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:38.485191 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8340b84-bf6e-4fdc-a45e-307b9b18bf86 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:38.497408 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-a8340b84-bf6e-4fdc-a45e-307b9b18bf86 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:28:38.497408 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:38.497408 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:38.497408 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:38.497408 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:38.497408 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:38.497408 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:38.497408 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:38.497408 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:38.497408 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:38.497408 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:38.497408 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:38.497408 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 21:28:38.497408 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 21:28:38.497408 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 21:28:38.498340 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 21:28:38.498340 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:38.498340 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:38.498340 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:38.498340 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:38.498340 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:38.498340 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:38.498340 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:38.498340 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:38.498340 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:38.498340 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:38.498340 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:38.498340 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:38.498340 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:38.498340 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:38.498340 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:38.498340 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:38.499224 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 21:28:38.499224 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 21:28:38.499224 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 21:28:38.499224 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 21:28:38.499224 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 21:28:38.499224 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 21:28:38.499224 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:28:38.499224 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:28:38.503378 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 430/874] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Aug 2 21:28:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:38.504762 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05727a5-4397-4f53-b389-555ad2df69cb None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:38.603065 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352936ba-fa66-4a66-9c26-b7be106aaeae None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:38.604614 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352936ba-fa66-4a66-9c26-b7be106aaeae None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:38.605120 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352936ba-fa66-4a66-9c26-b7be106aaeae None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:38.606906 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 431/875] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:28:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 21:28:38.611790 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d0041f-8f4f-4705-b782-4b7d503d9a1a None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:38.612080 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d0041f-8f4f-4705-b782-4b7d503d9a1a None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:38.612396 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d0041f-8f4f-4705-b782-4b7d503d9a1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:38.616866 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05727a5-4397-4f53-b389-555ad2df69cb None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:38.618582 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:38.636797 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-c2d0041f-8f4f-4705-b782-4b7d503d9a1a None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:28:38.638013 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-c2d0041f-8f4f-4705-b782-4b7d503d9a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:28:38.658001 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e818fb-8457-4d4a-8bb1-1eb46d64e270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:38.658996 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e818fb-8457-4d4a-8bb1-1eb46d64e270 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:38.659472 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e818fb-8457-4d4a-8bb1-1eb46d64e270 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:38.659940 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e818fb-8457-4d4a-8bb1-1eb46d64e270 None admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:38.660910 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e818fb-8457-4d4a-8bb1-1eb46d64e270 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:38.661427 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e818fb-8457-4d4a-8bb1-1eb46d64e270 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:38.663045 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e818fb-8457-4d4a-8bb1-1eb46d64e270 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:38.676733 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 445/876] 10.222.0.70 () {56 vars in 1148 bytes} [Tue Aug 2 21:28:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:38.688351 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e818fb-8457-4d4a-8bb1-1eb46d64e270 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:38.713936 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 432/877] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:28:38 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 21:28:38.735831 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d0041f-8f4f-4705-b782-4b7d503d9a1a None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:38.812725 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e818fb-8457-4d4a-8bb1-1eb46d64e270 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:38.825154 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:38.848740 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ea6015-f71d-40e0-bfa9-016b5bd6a351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:38.849362 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea6015-f71d-40e0-bfa9-016b5bd6a351 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:38.849647 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea6015-f71d-40e0-bfa9-016b5bd6a351 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:38.849924 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea6015-f71d-40e0-bfa9-016b5bd6a351 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:38.850710 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ea6015-f71d-40e0-bfa9-016b5bd6a351 None admin] RBAC: Adding query filter params (role.id=59a4c9a6a22d4bdb966856a28c4aabaf, scope.project.id=42672e04d6ce4b0ab5f7eccfb0cc946c, user.id=6be7b2bcfebd45389ca289c34fbabc3e) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:38.851027 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ea6015-f71d-40e0-bfa9-016b5bd6a351 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:38.852469 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ea6015-f71d-40e0-bfa9-016b5bd6a351 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:38.854973 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d0041f-8f4f-4705-b782-4b7d503d9a1a None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:38.860297 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 446/878] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Aug 2 21:28:38 2022] GET /identity/v3/role_assignments?user.id=6be7b2bcfebd45389ca289c34fbabc3e&scope.project.id=42672e04d6ce4b0ab5f7eccfb0cc946c&role.id=59a4c9a6a22d4bdb966856a28c4aabaf => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:38.860297 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d6249b-b9f4-4b1c-9029-547dea61a7fd None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:38.860297 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d6249b-b9f4-4b1c-9029-547dea61a7fd None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:38.860297 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d6249b-b9f4-4b1c-9029-547dea61a7fd None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:38.865736 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 447/879] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:28:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:28:38.870689 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4368850c-e07d-4088-aae2-bf0951c9fa21 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:38.871314 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4368850c-e07d-4088-aae2-bf0951c9fa21 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:38.872388 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4368850c-e07d-4088-aae2-bf0951c9fa21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:38.905273 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-4368850c-e07d-4088-aae2-bf0951c9fa21 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:28:38.906997 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-4368850c-e07d-4088-aae2-bf0951c9fa21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:28:38.911937 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e379a03c-092d-450d-b345-d69205ec58a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:38.912717 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e379a03c-092d-450d-b345-d69205ec58a2 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:38.913012 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e379a03c-092d-450d-b345-d69205ec58a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:38.913298 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e379a03c-092d-450d-b345-d69205ec58a2 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:38.914020 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e379a03c-092d-450d-b345-d69205ec58a2 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:38.915472 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e379a03c-092d-450d-b345-d69205ec58a2 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:38.926515 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-e379a03c-092d-450d-b345-d69205ec58a2 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 02 21:28:38.926515 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:38.926515 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 21:28:38.926515 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 21:28:38.926515 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 21:28:38.926515 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 21:28:38.926515 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 21:28:38.926515 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 21:28:38.926515 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 02 21:28:38.926515 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:28:38.926515 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 21:28:38.926515 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:28:38.926515 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:38.926515 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:38.926515 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:38.926515 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:38.926515 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:38.927609 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:38.927609 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:38.927609 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:38.927609 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:38.927609 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:38.927609 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:38.927609 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 21:28:38.927609 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 21:28:38.927609 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 21:28:38.927609 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 21:28:38.927609 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:38.927609 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:38.927609 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:38.927609 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:38.927609 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:38.927609 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:38.928485 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:38.928485 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:38.928485 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:38.928485 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:38.928485 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:38.928485 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:38.928485 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:38.928485 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:38.928485 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:38.928485 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:38.928485 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 21:28:38.928485 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 21:28:38.928485 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 02 21:28:38.928485 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:28:38.928485 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 433/880] 10.222.0.70 () {56 vars in 1114 bytes} [Tue Aug 2 21:28:38 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 21:28:38.933686 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e379a03c-092d-450d-b345-d69205ec58a2 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:38.948693 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:38.998733 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 448/881] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:28:38 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 21:28:39.020629 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4368850c-e07d-4088-aae2-bf0951c9fa21 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:39.070587 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e379a03c-092d-450d-b345-d69205ec58a2 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:39.111563 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e181bbf0-0588-4b81-abba-c3056d9b52bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:39.112188 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e181bbf0-0588-4b81-abba-c3056d9b52bc None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:39.112497 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e181bbf0-0588-4b81-abba-c3056d9b52bc None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:39.112764 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e181bbf0-0588-4b81-abba-c3056d9b52bc None admin] PATH_INFO: `/v3/services` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:39.114193 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e181bbf0-0588-4b81-abba-c3056d9b52bc None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:39.114445 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e181bbf0-0588-4b81-abba-c3056d9b52bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:39.116197 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e181bbf0-0588-4b81-abba-c3056d9b52bc None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:39.123953 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 434/882] 10.222.0.70 () {56 vars in 1114 bytes} [Tue Aug 2 21:28:38 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:28:39.130101 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e181bbf0-0588-4b81-abba-c3056d9b52bc None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:39.133191 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:39.149554 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4368850c-e07d-4088-aae2-bf0951c9fa21 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:39.191029 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0903a89-5bf4-43bc-a3bf-10f913ad91d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:39.191725 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0903a89-5bf4-43bc-a3bf-10f913ad91d8 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:39.192002 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0903a89-5bf4-43bc-a3bf-10f913ad91d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:39.193044 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0903a89-5bf4-43bc-a3bf-10f913ad91d8 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:39.193044 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0903a89-5bf4-43bc-a3bf-10f913ad91d8 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:39.194607 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0903a89-5bf4-43bc-a3bf-10f913ad91d8 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:39.205425 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-d0903a89-5bf4-43bc-a3bf-10f913ad91d8 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 02 21:28:39.205425 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:39.205425 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 21:28:39.205425 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 21:28:39.205425 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 21:28:39.205425 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 21:28:39.205425 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 21:28:39.205425 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 21:28:39.205425 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 02 21:28:39.205425 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:39.205425 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 21:28:39.205425 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:39.205425 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:39.205425 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:39.205425 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:39.205425 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:39.205425 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:39.206443 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:39.206443 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:39.206443 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:39.206443 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:39.206443 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:39.206443 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:39.206443 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 21:28:39.206443 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 21:28:39.206443 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 21:28:39.206443 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 21:28:39.206443 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:39.206443 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:39.206443 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:39.206443 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:39.206443 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:39.206443 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:39.207276 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:39.207276 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:39.207276 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:39.207276 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:39.207276 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:39.207276 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:39.207276 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:39.207276 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:39.207276 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:39.207276 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:39.207276 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 21:28:39.207276 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 21:28:39.207276 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 02 21:28:39.207276 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:39.207276 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 449/883] 10.222.0.70 () {56 vars in 1126 bytes} [Tue Aug 2 21:28:39 2022] GET /identity/v3/services/object-store => generated 93 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 21:28:39.213258 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0903a89-5bf4-43bc-a3bf-10f913ad91d8 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:39.243886 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:39.259248 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e181bbf0-0588-4b81-abba-c3056d9b52bc None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:39.304774 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79633bca-d500-4297-97ed-469a3dbf9389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:39.306396 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79633bca-d500-4297-97ed-469a3dbf9389 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:39.307414 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79633bca-d500-4297-97ed-469a3dbf9389 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:39.308429 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79633bca-d500-4297-97ed-469a3dbf9389 None admin] PATH_INFO: `/v3/services` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:39.309299 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79633bca-d500-4297-97ed-469a3dbf9389 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:39.309799 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79633bca-d500-4297-97ed-469a3dbf9389 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:39.311347 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79633bca-d500-4297-97ed-469a3dbf9389 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:39.322375 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 435/884] 10.222.0.70 () {56 vars in 1114 bytes} [Tue Aug 2 21:28:39 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:39.328848 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79633bca-d500-4297-97ed-469a3dbf9389 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:39.362001 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0903a89-5bf4-43bc-a3bf-10f913ad91d8 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:39.400587 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:39.414881 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f80dce-e0a4-477a-a3fd-2dfaa9912331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:39.415518 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f80dce-e0a4-477a-a3fd-2dfaa9912331 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:39.415802 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f80dce-e0a4-477a-a3fd-2dfaa9912331 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:39.416081 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f80dce-e0a4-477a-a3fd-2dfaa9912331 None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:39.417338 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f80dce-e0a4-477a-a3fd-2dfaa9912331 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:39.417952 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f80dce-e0a4-477a-a3fd-2dfaa9912331 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:39.419175 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f80dce-e0a4-477a-a3fd-2dfaa9912331 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:39.428862 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 450/885] 10.222.0.70 () {56 vars in 1122 bytes} [Tue Aug 2 21:28:39 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:39.430793 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f80dce-e0a4-477a-a3fd-2dfaa9912331 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:39.444586 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79633bca-d500-4297-97ed-469a3dbf9389 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:39.489924 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4469564-0fc9-4c58-ab15-bc537e9ab0d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:39.490549 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4469564-0fc9-4c58-ab15-bc537e9ab0d3 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:39.490837 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4469564-0fc9-4c58-ab15-bc537e9ab0d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:39.491115 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4469564-0fc9-4c58-ab15-bc537e9ab0d3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:39.491957 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4469564-0fc9-4c58-ab15-bc537e9ab0d3 None admin] RBAC: Adding query filter params (interface=public, service_id=43decbaf0811405ba4233a99712daac8, region_id=RegionOne) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:39.492339 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4469564-0fc9-4c58-ab15-bc537e9ab0d3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:39.493984 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4469564-0fc9-4c58-ab15-bc537e9ab0d3 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:39.504861 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 436/886] 10.222.0.70 () {56 vars in 1251 bytes} [Tue Aug 2 21:28:39 2022] GET /identity/v3/endpoints?service_id=43decbaf0811405ba4233a99712daac8&interface=public®ion_id=RegionOne => generated 194 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:28:39.505725 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4469564-0fc9-4c58-ab15-bc537e9ab0d3 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:39.529212 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:39.550894 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f80dce-e0a4-477a-a3fd-2dfaa9912331 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:39.598082 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b230b5-1e71-43f5-bc42-9398273c9e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:39.599023 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b230b5-1e71-43f5-bc42-9398273c9e4d None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:39.599702 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b230b5-1e71-43f5-bc42-9398273c9e4d None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:39.600644 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b230b5-1e71-43f5-bc42-9398273c9e4d None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:39.601792 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b230b5-1e71-43f5-bc42-9398273c9e4d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:39.602282 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b230b5-1e71-43f5-bc42-9398273c9e4d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:39.605140 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b230b5-1e71-43f5-bc42-9398273c9e4d None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:39.616266 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 451/887] 10.222.0.70 () {56 vars in 1122 bytes} [Tue Aug 2 21:28:39 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:28:39.637167 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4469564-0fc9-4c58-ab15-bc537e9ab0d3 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:39.683493 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:39.690345 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95c95a4-3f88-407b-aea5-a7e35ea1dd09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:39.691047 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c95a4-3f88-407b-aea5-a7e35ea1dd09 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:39.691736 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c95a4-3f88-407b-aea5-a7e35ea1dd09 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:39.692477 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95c95a4-3f88-407b-aea5-a7e35ea1dd09 None admin] PATH_INFO: `/v3/services` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:39.693616 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95c95a4-3f88-407b-aea5-a7e35ea1dd09 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:39.695084 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95c95a4-3f88-407b-aea5-a7e35ea1dd09 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:39.701928 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 437/888] 10.222.0.70 () {56 vars in 1087 bytes} [Tue Aug 2 21:28:39 2022] GET /identity/v3/services => generated 1268 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:28:40.539456 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368f079b-e690-49df-b686-3bdeba4c705c None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:40.539996 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368f079b-e690-49df-b686-3bdeba4c705c None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:40.539996 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368f079b-e690-49df-b686-3bdeba4c705c None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:40.541628 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 452/889] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:28:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:28:40.546842 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791b9365-baaf-4fb7-8589-23ffab65e10e None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:40.547143 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791b9365-baaf-4fb7-8589-23ffab65e10e None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:40.547426 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791b9365-baaf-4fb7-8589-23ffab65e10e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:40.567302 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-791b9365-baaf-4fb7-8589-23ffab65e10e None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:28:40.568818 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-791b9365-baaf-4fb7-8589-23ffab65e10e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:28:40.639420 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 438/890] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:28:40 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 21:28:40.661862 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368f079b-e690-49df-b686-3bdeba4c705c None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:40.769899 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368f079b-e690-49df-b686-3bdeba4c705c None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:40.806709 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ef8e08-b0f1-4bc2-959c-2cb8a746b81d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:40.808257 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ef8e08-b0f1-4bc2-959c-2cb8a746b81d None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:40.808735 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ef8e08-b0f1-4bc2-959c-2cb8a746b81d None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:40.809200 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ef8e08-b0f1-4bc2-959c-2cb8a746b81d None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:40.810016 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ef8e08-b0f1-4bc2-959c-2cb8a746b81d None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:40.811602 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ef8e08-b0f1-4bc2-959c-2cb8a746b81d None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:40.821440 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-e8ef8e08-b0f1-4bc2-959c-2cb8a746b81d None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 02 21:28:40.821440 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:40.821440 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 21:28:40.821440 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 21:28:40.821440 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 21:28:40.821440 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 21:28:40.821440 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 21:28:40.821440 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 21:28:40.821440 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 02 21:28:40.821440 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:40.821440 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 21:28:40.821440 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:40.821440 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:40.821440 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:40.821440 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:40.821440 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:40.822452 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:40.822452 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:40.822452 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:40.822452 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:40.822452 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:40.822452 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:40.822452 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:40.822452 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 21:28:40.822452 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 21:28:40.822452 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 21:28:40.822452 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 21:28:40.822452 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:40.822452 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:40.822452 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:40.822452 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:40.822452 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:40.823852 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:40.823852 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:40.823852 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:40.823852 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:40.823852 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:40.823852 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:40.823852 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:40.823852 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:40.823852 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:40.823852 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:40.823852 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:40.823852 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 21:28:40.823852 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 21:28:40.823852 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 02 21:28:40.823852 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:40.826679 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 453/891] 10.222.0.70 () {56 vars in 1132 bytes} [Tue Aug 2 21:28:40 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:40.832776 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791b9365-baaf-4fb7-8589-23ffab65e10e None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:40.939653 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791b9365-baaf-4fb7-8589-23ffab65e10e None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:40.964220 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:40.984200 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaa7347-29cb-441e-9f02-815735c29fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:40.984862 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa7347-29cb-441e-9f02-815735c29fce None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:40.985151 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa7347-29cb-441e-9f02-815735c29fce None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:40.985431 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa7347-29cb-441e-9f02-815735c29fce None admin] PATH_INFO: `/v3/services` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:40.986118 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaa7347-29cb-441e-9f02-815735c29fce None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:40.986428 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaa7347-29cb-441e-9f02-815735c29fce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:40.987814 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaa7347-29cb-441e-9f02-815735c29fce None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:40.993298 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 439/892] 10.222.0.70 () {56 vars in 1126 bytes} [Tue Aug 2 21:28:40 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:40.999515 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ef8e08-b0f1-4bc2-959c-2cb8a746b81d None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:41.022680 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:41.084952 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9338796-ccc7-4810-a1d9-d3c11bba3f0f None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:41.085122 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9338796-ccc7-4810-a1d9-d3c11bba3f0f None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:41.085349 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9338796-ccc7-4810-a1d9-d3c11bba3f0f None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:41.086931 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 440/893] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:28:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:28:41.091998 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38999b13-a509-471f-90fe-8c34467e05f1 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:41.092385 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38999b13-a509-471f-90fe-8c34467e05f1 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:41.092674 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38999b13-a509-471f-90fe-8c34467e05f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:41.105241 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ef8e08-b0f1-4bc2-959c-2cb8a746b81d None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:41.111943 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-38999b13-a509-471f-90fe-8c34467e05f1 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:28:41.113677 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-38999b13-a509-471f-90fe-8c34467e05f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:28:41.142693 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062a50b5-956c-4ba9-b4e5-83cce2f6be4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:41.143607 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062a50b5-956c-4ba9-b4e5-83cce2f6be4f None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:41.144086 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062a50b5-956c-4ba9-b4e5-83cce2f6be4f None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:41.144554 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062a50b5-956c-4ba9-b4e5-83cce2f6be4f None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:41.145399 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062a50b5-956c-4ba9-b4e5-83cce2f6be4f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:41.145890 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062a50b5-956c-4ba9-b4e5-83cce2f6be4f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:41.147478 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062a50b5-956c-4ba9-b4e5-83cce2f6be4f None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:41.152847 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 454/894] 10.222.0.70 () {56 vars in 1126 bytes} [Tue Aug 2 21:28:40 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:41.159049 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062a50b5-956c-4ba9-b4e5-83cce2f6be4f None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:41.204256 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 441/895] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:28:41 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 21:28:41.225403 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38999b13-a509-471f-90fe-8c34467e05f1 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:41.256112 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:41.281040 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062a50b5-956c-4ba9-b4e5-83cce2f6be4f None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:41.324054 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61db920-e1e2-456c-80f6-006a3c674fe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:41.324723 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61db920-e1e2-456c-80f6-006a3c674fe3 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:41.324998 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61db920-e1e2-456c-80f6-006a3c674fe3 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:41.325271 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61db920-e1e2-456c-80f6-006a3c674fe3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:41.326030 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61db920-e1e2-456c-80f6-006a3c674fe3 None admin] RBAC: Adding query filter params (interface=public, service_id=0a882453f41841178bc1f865086d6ba5, region_id=RegionOne) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:41.326344 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61db920-e1e2-456c-80f6-006a3c674fe3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:41.327982 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61db920-e1e2-456c-80f6-006a3c674fe3 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:41.340491 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 455/896] 10.222.0.70 () {56 vars in 1251 bytes} [Tue Aug 2 21:28:41 2022] GET /identity/v3/endpoints?service_id=0a882453f41841178bc1f865086d6ba5&interface=public®ion_id=RegionOne => generated 194 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:41.341762 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61db920-e1e2-456c-80f6-006a3c674fe3 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:41.343685 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38999b13-a509-471f-90fe-8c34467e05f1 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:41.362855 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:41.383146 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798f3863-3cce-4400-a7b7-90d863ca5988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:41.384113 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f3863-3cce-4400-a7b7-90d863ca5988 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:41.384610 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f3863-3cce-4400-a7b7-90d863ca5988 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:41.385119 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798f3863-3cce-4400-a7b7-90d863ca5988 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:41.396217 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798f3863-3cce-4400-a7b7-90d863ca5988 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:28:41.402072 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-798f3863-3cce-4400-a7b7-90d863ca5988 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 02 21:28:41.402072 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:41.402072 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:41.402072 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:41.402072 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:41.402072 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:41.402072 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:41.402072 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:41.402072 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:41.402072 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:41.402072 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:41.402072 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:41.402072 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:28:41.402072 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:28:41.402072 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:28:41.402072 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:28:41.403031 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:28:41.403031 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:28:41.403031 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:28:41.403031 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:28:41.403031 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:41.403031 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:41.403031 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:41.403031 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:41.403031 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:41.403031 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:41.403031 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:41.403031 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:41.403031 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:41.403031 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:41.403031 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:41.403031 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:41.403878 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:41.403878 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:41.403878 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:41.403878 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:41.403878 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:28:41.403878 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:28:41.403878 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:28:41.403878 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:28:41.403878 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:28:41.403878 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:28:41.403878 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 02 21:28:41.403878 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:28:41.406568 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 442/897] 10.222.0.70 () {56 vars in 1120 bytes} [Tue Aug 2 21:28:41 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 21:28:41.412714 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798f3863-3cce-4400-a7b7-90d863ca5988 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:41.457958 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61db920-e1e2-456c-80f6-006a3c674fe3 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:41.501149 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10873a09-e114-417c-b07c-99a7fe71d10e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:41.502178 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10873a09-e114-417c-b07c-99a7fe71d10e None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:41.502683 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10873a09-e114-417c-b07c-99a7fe71d10e None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:41.503175 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10873a09-e114-417c-b07c-99a7fe71d10e None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:41.504030 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10873a09-e114-417c-b07c-99a7fe71d10e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:41.505683 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10873a09-e114-417c-b07c-99a7fe71d10e None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:41.512204 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 456/898] 10.222.0.70 () {56 vars in 1087 bytes} [Tue Aug 2 21:28:41 2022] GET /identity/v3/services => generated 1268 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:28:41.540495 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798f3863-3cce-4400-a7b7-90d863ca5988 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:41.582827 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15851fe-3182-4ae2-b4ac-5f07e5925204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:41.583873 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15851fe-3182-4ae2-b4ac-5f07e5925204 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:41.584411 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15851fe-3182-4ae2-b4ac-5f07e5925204 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:41.584890 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15851fe-3182-4ae2-b4ac-5f07e5925204 None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:41.585842 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15851fe-3182-4ae2-b4ac-5f07e5925204 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:41.586389 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15851fe-3182-4ae2-b4ac-5f07e5925204 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:41.588813 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15851fe-3182-4ae2-b4ac-5f07e5925204 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:41.599084 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 443/899] 10.222.0.70 () {56 vars in 1115 bytes} [Tue Aug 2 21:28:41 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:41.608535 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10873a09-e114-417c-b07c-99a7fe71d10e None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:41.611468 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:41.725093 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10873a09-e114-417c-b07c-99a7fe71d10e None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:41.759607 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71ddd2e-c1b4-44dd-8bda-2c62b0be024b None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:41.760680 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71ddd2e-c1b4-44dd-8bda-2c62b0be024b None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:41.760757 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71ddd2e-c1b4-44dd-8bda-2c62b0be024b None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:41.761293 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79dba59-fb25-4f2f-9a60-72606352523a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:41.761937 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79dba59-fb25-4f2f-9a60-72606352523a None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:41.762214 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79dba59-fb25-4f2f-9a60-72606352523a None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:41.762385 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 444/900] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:28:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:28:41.762558 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79dba59-fb25-4f2f-9a60-72606352523a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:41.767362 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759fec4e-e72c-43d7-aceb-b4b5befe2235 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:41.767878 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759fec4e-e72c-43d7-aceb-b4b5befe2235 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:41.768422 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759fec4e-e72c-43d7-aceb-b4b5befe2235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:41.773553 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79dba59-fb25-4f2f-9a60-72606352523a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:41.774995 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79dba59-fb25-4f2f-9a60-72606352523a None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:41.788943 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-759fec4e-e72c-43d7-aceb-b4b5befe2235 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:28:41.790424 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-759fec4e-e72c-43d7-aceb-b4b5befe2235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:28:41.790767 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-b79dba59-fb25-4f2f-9a60-72606352523a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:41.790767 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:41.790767 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:41.790767 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:41.790767 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:41.790767 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:41.790767 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:41.790767 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:41.790767 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:41.790767 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:41.790767 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:41.790767 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:41.790767 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:28:41.790767 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:28:41.790767 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:28:41.791728 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:28:41.791728 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:41.791728 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:41.791728 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:41.791728 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:41.791728 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:41.791728 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:41.791728 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:41.791728 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:41.791728 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:41.791728 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:41.791728 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:41.791728 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:41.791728 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:41.791728 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:41.791728 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:41.791728 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:41.792669 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:28:41.792669 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:28:41.792669 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:41.792669 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:41.792669 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 457/901] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 2 21:28:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 21:28:41.797823 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79dba59-fb25-4f2f-9a60-72606352523a None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:41.834828 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:41.859707 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:41.876175 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 445/902] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:28:41 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 21:28:41.876175 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2efb37-4f6c-4975-9708-4d1b7ef92357 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:41.876175 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2efb37-4f6c-4975-9708-4d1b7ef92357 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:41.876175 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2efb37-4f6c-4975-9708-4d1b7ef92357 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:41.876175 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 446/903] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:28:41 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:28:41.881447 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2327893-a5a0-41b7-b730-f0688e2169ac None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:41.881605 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2327893-a5a0-41b7-b730-f0688e2169ac None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:41.881846 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2327893-a5a0-41b7-b730-f0688e2169ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:41.901822 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-f2327893-a5a0-41b7-b730-f0688e2169ac None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:28:41.903035 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-f2327893-a5a0-41b7-b730-f0688e2169ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:28:41.917251 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79dba59-fb25-4f2f-9a60-72606352523a None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:41.956271 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b08dd5-fe8a-4798-bbe6-7c3837db174e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:41.957203 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b08dd5-fe8a-4798-bbe6-7c3837db174e None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:41.957489 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b08dd5-fe8a-4798-bbe6-7c3837db174e None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:41.957768 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b08dd5-fe8a-4798-bbe6-7c3837db174e None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:41.958463 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b08dd5-fe8a-4798-bbe6-7c3837db174e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:41.958773 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b08dd5-fe8a-4798-bbe6-7c3837db174e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:41.960137 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b08dd5-fe8a-4798-bbe6-7c3837db174e None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:41.972992 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 458/904] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 2 21:28:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:41.973802 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b08dd5-fe8a-4798-bbe6-7c3837db174e None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:41.982473 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 447/905] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:28:41 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 21:28:41.983186 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2327893-a5a0-41b7-b730-f0688e2169ac None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:42.096863 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:42.100401 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2327893-a5a0-41b7-b730-f0688e2169ac None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:42.107031 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b08dd5-fe8a-4798-bbe6-7c3837db174e None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:42.125428 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:42.139381 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412da358-6d9b-45ec-aa3f-084e20b69676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:42.140129 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412da358-6d9b-45ec-aa3f-084e20b69676 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:42.140650 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412da358-6d9b-45ec-aa3f-084e20b69676 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:42.140760 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412da358-6d9b-45ec-aa3f-084e20b69676 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:42.146368 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383d7aa0-58e3-4517-998a-a2bb35528df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:42.147096 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383d7aa0-58e3-4517-998a-a2bb35528df9 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:42.147336 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383d7aa0-58e3-4517-998a-a2bb35528df9 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:42.147616 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383d7aa0-58e3-4517-998a-a2bb35528df9 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:42.148148 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412da358-6d9b-45ec-aa3f-084e20b69676 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:42.148284 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383d7aa0-58e3-4517-998a-a2bb35528df9 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:42.149616 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383d7aa0-58e3-4517-998a-a2bb35528df9 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:42.149712 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412da358-6d9b-45ec-aa3f-084e20b69676 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:42.161690 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-412da358-6d9b-45ec-aa3f-084e20b69676 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 02 21:28:42.161690 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:42.161690 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:42.161690 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:42.161690 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:42.161690 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:42.161690 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:42.161690 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:42.161690 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:42.161690 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:42.161690 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:42.161690 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:42.161690 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 21:28:42.161690 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 21:28:42.161690 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 21:28:42.161690 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 21:28:42.162594 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:42.162594 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:42.162594 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 21:28:42.162594 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:28:42.162594 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 21:28:42.162594 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:28:42.162594 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:42.162594 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:42.162594 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:42.162594 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:42.162594 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:42.162594 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:42.162594 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:42.162594 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:42.162594 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:42.162594 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:42.162594 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:42.162594 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:42.168547 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:42.168547 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:42.168547 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 21:28:42.168547 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 21:28:42.168547 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 21:28:42.168547 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 21:28:42.168547 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 21:28:42.168547 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 21:28:42.168547 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 02 21:28:42.168547 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:28:42.169079 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-383d7aa0-58e3-4517-998a-a2bb35528df9 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 02 21:28:42.169079 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:42.169079 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 21:28:42.169079 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 21:28:42.169079 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 21:28:42.169079 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 21:28:42.169079 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 21:28:42.169079 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 21:28:42.169079 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 02 21:28:42.169079 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:42.169079 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 21:28:42.169079 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:42.169079 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:42.169079 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:42.169079 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:42.169079 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:42.169079 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:42.169960 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:42.169960 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:42.169960 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:42.169960 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:42.169960 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:42.169960 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:42.169960 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 21:28:42.169960 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 21:28:42.169960 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 21:28:42.169960 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 21:28:42.169960 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:42.169960 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:42.169960 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:42.169960 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:42.169960 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:42.169960 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:42.170782 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:42.170782 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:42.170782 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:42.170782 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:42.170782 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:42.170782 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:42.170782 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:42.170782 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:42.170782 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:42.170782 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:42.170782 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 21:28:42.170782 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 21:28:42.170782 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 02 21:28:42.170782 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:42.171502 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 448/906] 10.222.0.70 () {56 vars in 1117 bytes} [Tue Aug 2 21:28:41 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:42.171502 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412da358-6d9b-45ec-aa3f-084e20b69676 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:42.171638 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 459/907] 10.222.0.70 () {56 vars in 1114 bytes} [Tue Aug 2 21:28:41 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:42.171638 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383d7aa0-58e3-4517-998a-a2bb35528df9 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:42.275276 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383d7aa0-58e3-4517-998a-a2bb35528df9 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:42.278564 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412da358-6d9b-45ec-aa3f-084e20b69676 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:42.313769 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57b5db8-b42e-44b8-a45b-8668b093d590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:42.314390 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57b5db8-b42e-44b8-a45b-8668b093d590 None admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:42.314676 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57b5db8-b42e-44b8-a45b-8668b093d590 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:42.314950 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57b5db8-b42e-44b8-a45b-8668b093d590 None admin] PATH_INFO: `/v3/services` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:42.315690 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57b5db8-b42e-44b8-a45b-8668b093d590 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:42.317112 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57b5db8-b42e-44b8-a45b-8668b093d590 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:42.318846 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757028d9-f90d-420c-8d13-1652e7f7d664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:42.319471 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757028d9-f90d-420c-8d13-1652e7f7d664 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:42.319756 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757028d9-f90d-420c-8d13-1652e7f7d664 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:42.320034 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757028d9-f90d-420c-8d13-1652e7f7d664 None admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:42.320871 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757028d9-f90d-420c-8d13-1652e7f7d664 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:42.321176 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757028d9-f90d-420c-8d13-1652e7f7d664 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:42.323210 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757028d9-f90d-420c-8d13-1652e7f7d664 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:42.336285 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 449/908] 10.222.0.70 () {60 vars in 1141 bytes} [Tue Aug 2 21:28:42 2022] POST /identity/v3/services => generated 241 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:28:42.336285 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57b5db8-b42e-44b8-a45b-8668b093d590 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:42.346634 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 460/909] 10.222.0.70 () {56 vars in 1149 bytes} [Tue Aug 2 21:28:42 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:42.353092 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757028d9-f90d-420c-8d13-1652e7f7d664 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:42.368453 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:42.419453 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:42.480018 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57b5db8-b42e-44b8-a45b-8668b093d590 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:42.491504 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757028d9-f90d-420c-8d13-1652e7f7d664 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:42.520806 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b23aba7-3fe5-447e-91f9-82404a339b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:42.521852 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b23aba7-3fe5-447e-91f9-82404a339b8a None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:42.522140 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b23aba7-3fe5-447e-91f9-82404a339b8a None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:42.522415 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b23aba7-3fe5-447e-91f9-82404a339b8a None admin] PATH_INFO: `/v3/services` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:42.523423 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b23aba7-3fe5-447e-91f9-82404a339b8a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:42.524010 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b23aba7-3fe5-447e-91f9-82404a339b8a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:42.525559 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b23aba7-3fe5-447e-91f9-82404a339b8a None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:42.531513 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 450/910] 10.222.0.70 () {56 vars in 1114 bytes} [Tue Aug 2 21:28:42 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:42.537171 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b23aba7-3fe5-447e-91f9-82404a339b8a None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:42.538204 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e02a94-e3d5-4c4b-88a1-f95733450e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:42.538840 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e02a94-e3d5-4c4b-88a1-f95733450e23 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:42.539125 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e02a94-e3d5-4c4b-88a1-f95733450e23 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:42.539404 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e02a94-e3d5-4c4b-88a1-f95733450e23 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:42.611596 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e02a94-e3d5-4c4b-88a1-f95733450e23 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:42.614160 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e02a94-e3d5-4c4b-88a1-f95733450e23 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:42.651766 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b23aba7-3fe5-447e-91f9-82404a339b8a None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:42.664421 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:42.666811 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:42.700328 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc36cff-504f-484a-8b31-dcd226c1b4ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:42.700879 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc36cff-504f-484a-8b31-dcd226c1b4ad None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:42.701430 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc36cff-504f-484a-8b31-dcd226c1b4ad None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:42.701727 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc36cff-504f-484a-8b31-dcd226c1b4ad None admin] PATH_INFO: `/v3/services` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:42.702436 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc36cff-504f-484a-8b31-dcd226c1b4ad None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:42.703116 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc36cff-504f-484a-8b31-dcd226c1b4ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:42.705520 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc36cff-504f-484a-8b31-dcd226c1b4ad None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:42.712698 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 451/911] 10.222.0.70 () {56 vars in 1114 bytes} [Tue Aug 2 21:28:42 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:42.717840 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc36cff-504f-484a-8b31-dcd226c1b4ad None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:42.749890 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 461/912] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 2 21:28:42 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 02 21:28:42.755106 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e02a94-e3d5-4c4b-88a1-f95733450e23 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:42.829546 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc36cff-504f-484a-8b31-dcd226c1b4ad None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:42.866110 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eb9542-f167-4c2e-a67e-1890024e922e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:42.867110 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eb9542-f167-4c2e-a67e-1890024e922e None admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:42.867361 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e02a94-e3d5-4c4b-88a1-f95733450e23 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:42.867813 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eb9542-f167-4c2e-a67e-1890024e922e None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:42.868345 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00eb9542-f167-4c2e-a67e-1890024e922e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:42.869432 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eb9542-f167-4c2e-a67e-1890024e922e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:42.871068 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00eb9542-f167-4c2e-a67e-1890024e922e None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:42.887401 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:42.893464 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 452/913] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 2 21:28:42 2022] POST /identity/v3/endpoints => generated 346 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 21:28:42.914963 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b2f59e-e0a9-4dcd-97d6-a37571162cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:42.915677 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b2f59e-e0a9-4dcd-97d6-a37571162cb8 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:42.915969 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b2f59e-e0a9-4dcd-97d6-a37571162cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:42.916867 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b2f59e-e0a9-4dcd-97d6-a37571162cb8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:42.919207 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:42.930095 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b2f59e-e0a9-4dcd-97d6-a37571162cb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:42.931793 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b2f59e-e0a9-4dcd-97d6-a37571162cb8 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:42.948477 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-c0b2f59e-e0a9-4dcd-97d6-a37571162cb8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:42.948477 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:42.948477 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:42.948477 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:42.948477 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:42.948477 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:42.948477 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:42.948477 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:42.948477 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:42.948477 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:42.948477 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:42.948477 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:42.948477 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:28:42.948477 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:28:42.948477 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:28:42.949451 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:28:42.949451 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:42.949451 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:42.949451 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:42.949451 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:42.949451 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:42.949451 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:42.949451 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:42.949451 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:42.949451 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:42.949451 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:42.949451 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:42.949451 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:42.949451 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:42.949451 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:42.949451 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:42.949451 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:42.950430 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:28:42.950430 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:28:42.950430 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:42.950430 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:42.950430 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 462/914] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 2 21:28:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:42.957053 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eb9542-f167-4c2e-a67e-1890024e922e None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:43.070657 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00eb9542-f167-4c2e-a67e-1890024e922e None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:43.110782 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9230e62b-7c88-44d4-9311-755c12c07876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:43.111736 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9230e62b-7c88-44d4-9311-755c12c07876 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:43.112196 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9230e62b-7c88-44d4-9311-755c12c07876 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:43.112685 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9230e62b-7c88-44d4-9311-755c12c07876 None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:43.113832 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9230e62b-7c88-44d4-9311-755c12c07876 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:43.114313 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9230e62b-7c88-44d4-9311-755c12c07876 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:43.115863 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9230e62b-7c88-44d4-9311-755c12c07876 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:43.129339 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 453/915] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 2 21:28:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:43.135807 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b2f59e-e0a9-4dcd-97d6-a37571162cb8 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:43.245950 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b2f59e-e0a9-4dcd-97d6-a37571162cb8 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:43.282061 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41a637b-0dd3-4e66-be80-cec28b341196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:43.282711 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41a637b-0dd3-4e66-be80-cec28b341196 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:43.282996 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41a637b-0dd3-4e66-be80-cec28b341196 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:43.283274 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41a637b-0dd3-4e66-be80-cec28b341196 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:43.290779 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41a637b-0dd3-4e66-be80-cec28b341196 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:43.292548 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41a637b-0dd3-4e66-be80-cec28b341196 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:43.304269 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-c41a637b-0dd3-4e66-be80-cec28b341196 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:28:43.304269 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:43.304269 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:43.304269 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:43.304269 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:43.304269 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:43.304269 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:43.304269 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:43.304269 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:43.304269 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:43.304269 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:43.304269 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:43.304269 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 21:28:43.304269 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 21:28:43.304269 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 21:28:43.305241 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 21:28:43.305241 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:43.305241 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:43.305241 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:43.305241 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:43.305241 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:43.305241 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:43.305241 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:43.305241 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:43.305241 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:43.305241 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:43.305241 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:43.305241 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:43.305241 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:43.305241 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:43.305241 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:43.305241 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:43.306201 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 21:28:43.306201 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 21:28:43.306201 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 21:28:43.306201 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 21:28:43.306201 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 21:28:43.306201 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 21:28:43.306201 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:28:43.306201 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:43.306201 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 463/916] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Aug 2 21:28:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:43.311419 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9230e62b-7c88-44d4-9311-755c12c07876 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:43.380724 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:43.423412 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9230e62b-7c88-44d4-9311-755c12c07876 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:43.461199 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d55eb49-b56a-475e-b51f-7911311c5179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:43.461828 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d55eb49-b56a-475e-b51f-7911311c5179 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:43.462111 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d55eb49-b56a-475e-b51f-7911311c5179 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:43.462387 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d55eb49-b56a-475e-b51f-7911311c5179 None admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:43.463693 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d55eb49-b56a-475e-b51f-7911311c5179 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:43.464007 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d55eb49-b56a-475e-b51f-7911311c5179 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:43.465500 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d55eb49-b56a-475e-b51f-7911311c5179 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:43.477885 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 454/917] 10.222.0.70 () {56 vars in 1148 bytes} [Tue Aug 2 21:28:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:43.483623 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41a637b-0dd3-4e66-be80-cec28b341196 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:43.553125 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:43.595804 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41a637b-0dd3-4e66-be80-cec28b341196 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:43.623520 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc6781f-c26c-46c1-bb37-3ab4e0ed8ed6 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:43.623828 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc6781f-c26c-46c1-bb37-3ab4e0ed8ed6 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:43.624086 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc6781f-c26c-46c1-bb37-3ab4e0ed8ed6 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:43.625474 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 455/918] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:28:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 21:28:43.631668 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cd9c5a-0f3c-4986-a811-df4e0e3f5336 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:43.632182 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cd9c5a-0f3c-4986-a811-df4e0e3f5336 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:43.632695 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cd9c5a-0f3c-4986-a811-df4e0e3f5336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:43.635962 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da02498-b3ea-4766-b05c-a03d245cd546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:43.638552 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da02498-b3ea-4766-b05c-a03d245cd546 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:43.638552 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da02498-b3ea-4766-b05c-a03d245cd546 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:43.638552 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da02498-b3ea-4766-b05c-a03d245cd546 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:43.638552 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da02498-b3ea-4766-b05c-a03d245cd546 None admin] RBAC: Adding query filter params (role.id=13e24a71ee30450ab0dfa871704b0520, scope.project.id=42672e04d6ce4b0ab5f7eccfb0cc946c, user.id=6be7b2bcfebd45389ca289c34fbabc3e) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:43.638552 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da02498-b3ea-4766-b05c-a03d245cd546 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:43.639644 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da02498-b3ea-4766-b05c-a03d245cd546 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:43.646708 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 464/919] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Aug 2 21:28:43 2022] GET /identity/v3/role_assignments?user.id=6be7b2bcfebd45389ca289c34fbabc3e&scope.project.id=42672e04d6ce4b0ab5f7eccfb0cc946c&role.id=13e24a71ee30450ab0dfa871704b0520 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:43.659391 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-e2cd9c5a-0f3c-4986-a811-df4e0e3f5336 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:28:43.660772 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-e2cd9c5a-0f3c-4986-a811-df4e0e3f5336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:28:43.741466 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 456/920] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:28:43 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 21:28:43.765190 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da02498-b3ea-4766-b05c-a03d245cd546 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:43.873891 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da02498-b3ea-4766-b05c-a03d245cd546 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:43.884714 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:43.910010 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fa64b1-205e-4a2c-becb-b2aa6431b713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:43.910721 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa64b1-205e-4a2c-becb-b2aa6431b713 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:43.911004 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa64b1-205e-4a2c-becb-b2aa6431b713 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:43.911284 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa64b1-205e-4a2c-becb-b2aa6431b713 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:43.911967 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fa64b1-205e-4a2c-becb-b2aa6431b713 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:43.913424 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fa64b1-205e-4a2c-becb-b2aa6431b713 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:43.923165 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-41fa64b1-205e-4a2c-becb-b2aa6431b713 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 02 21:28:43.923165 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:43.923165 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 21:28:43.923165 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 21:28:43.923165 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 21:28:43.923165 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 21:28:43.923165 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 21:28:43.923165 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 21:28:43.923165 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 02 21:28:43.923165 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:43.923165 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 21:28:43.923165 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:43.923165 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:43.923165 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:43.923165 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:43.923165 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:43.924146 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:43.924146 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:43.924146 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:43.924146 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:43.924146 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:43.924146 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:43.924146 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:43.924146 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 21:28:43.924146 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 21:28:43.924146 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 21:28:43.924146 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 21:28:43.924146 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:43.924146 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:43.924146 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:43.924146 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:43.924146 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:43.925320 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:43.925320 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:43.925320 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:43.925320 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:43.925320 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:43.925320 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:43.925320 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:43.925320 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:43.925320 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:43.925320 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:43.925320 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:43.925320 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 21:28:43.925320 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 21:28:43.925320 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 02 21:28:43.925320 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:43.925320 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 465/921] 10.222.0.70 () {56 vars in 1132 bytes} [Tue Aug 2 21:28:43 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:43.933956 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cd9c5a-0f3c-4986-a811-df4e0e3f5336 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:43.990395 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:44.042303 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cd9c5a-0f3c-4986-a811-df4e0e3f5336 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:44.077707 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbcda50-ce6d-486e-b6b5-400a68a3540e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:44.078334 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbcda50-ce6d-486e-b6b5-400a68a3540e None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:44.078619 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbcda50-ce6d-486e-b6b5-400a68a3540e None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:44.078896 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbcda50-ce6d-486e-b6b5-400a68a3540e None admin] PATH_INFO: `/v3/services` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:44.079577 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbcda50-ce6d-486e-b6b5-400a68a3540e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:44.079887 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbcda50-ce6d-486e-b6b5-400a68a3540e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:44.081294 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbcda50-ce6d-486e-b6b5-400a68a3540e None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:44.086532 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 457/922] 10.222.0.70 () {56 vars in 1126 bytes} [Tue Aug 2 21:28:43 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:44.092463 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fa64b1-205e-4a2c-becb-b2aa6431b713 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:44.206207 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fa64b1-205e-4a2c-becb-b2aa6431b713 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:44.241440 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9004e22-49ae-4140-ad8b-217aff62214a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:44.242058 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9004e22-49ae-4140-ad8b-217aff62214a None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:44.242341 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9004e22-49ae-4140-ad8b-217aff62214a None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:44.242616 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9004e22-49ae-4140-ad8b-217aff62214a None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:44.243292 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9004e22-49ae-4140-ad8b-217aff62214a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:44.243595 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9004e22-49ae-4140-ad8b-217aff62214a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:44.245534 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9004e22-49ae-4140-ad8b-217aff62214a None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:44.250817 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 466/923] 10.222.0.70 () {56 vars in 1126 bytes} [Tue Aug 2 21:28:44 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:44.256608 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbcda50-ce6d-486e-b6b5-400a68a3540e None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:44.365556 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbcda50-ce6d-486e-b6b5-400a68a3540e None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:44.380134 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:44.400985 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc15eea-0f9b-4f22-8fa7-7dfc228f2916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:44.401637 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc15eea-0f9b-4f22-8fa7-7dfc228f2916 None admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:44.401927 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc15eea-0f9b-4f22-8fa7-7dfc228f2916 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:44.402199 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc15eea-0f9b-4f22-8fa7-7dfc228f2916 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:44.402915 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc15eea-0f9b-4f22-8fa7-7dfc228f2916 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:44.404317 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc15eea-0f9b-4f22-8fa7-7dfc228f2916 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:44.427685 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 458/924] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 2 21:28:44 2022] POST /identity/v3/endpoints => generated 347 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:28:44.538370 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d222a0-0002-404c-ab9e-8cfa98b3e571 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:44.538565 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d222a0-0002-404c-ab9e-8cfa98b3e571 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:44.538836 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d222a0-0002-404c-ab9e-8cfa98b3e571 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:44.540441 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 467/925] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:28:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:28:44.546828 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9834db31-9b4d-4727-b895-4458d7bb4f3f None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:44.547432 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9834db31-9b4d-4727-b895-4458d7bb4f3f None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:44.547925 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9834db31-9b4d-4727-b895-4458d7bb4f3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:44.572201 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-9834db31-9b4d-4727-b895-4458d7bb4f3f None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:28:44.574342 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-9834db31-9b4d-4727-b895-4458d7bb4f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:28:44.658703 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 459/926] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:28:44 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 21:28:44.681800 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d222a0-0002-404c-ab9e-8cfa98b3e571 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:44.725295 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:44.791730 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d222a0-0002-404c-ab9e-8cfa98b3e571 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:44.827835 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a6d68d-7471-4106-a70b-9f3482db7d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:44.828548 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a6d68d-7471-4106-a70b-9f3482db7d79 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:44.828836 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a6d68d-7471-4106-a70b-9f3482db7d79 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:44.829114 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a6d68d-7471-4106-a70b-9f3482db7d79 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:44.829758 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a6d68d-7471-4106-a70b-9f3482db7d79 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:44.831159 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a6d68d-7471-4106-a70b-9f3482db7d79 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:44.842163 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-82a6d68d-7471-4106-a70b-9f3482db7d79 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 02 21:28:44.842163 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:44.842163 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 21:28:44.842163 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 21:28:44.842163 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 21:28:44.842163 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 21:28:44.842163 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 21:28:44.842163 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 21:28:44.842163 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 02 21:28:44.842163 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:44.842163 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 21:28:44.842163 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:44.842163 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:44.842163 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:44.842163 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:44.842163 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:44.842163 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:44.843301 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:44.843301 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:44.843301 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:44.843301 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:44.843301 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:44.843301 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:44.843301 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 21:28:44.843301 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 21:28:44.843301 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 21:28:44.843301 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 21:28:44.843301 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:44.843301 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:44.843301 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:44.843301 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:44.843301 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:44.843301 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:44.844195 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:44.844195 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:44.844195 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:44.844195 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:44.844195 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:44.844195 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:44.844195 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:44.844195 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:44.844195 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:44.844195 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:44.844195 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 21:28:44.844195 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 21:28:44.844195 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 02 21:28:44.844195 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:44.844195 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 468/927] 10.222.0.70 () {56 vars in 1126 bytes} [Tue Aug 2 21:28:44 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:44.851599 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9834db31-9b4d-4727-b895-4458d7bb4f3f None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:44.953500 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:44.960891 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9834db31-9b4d-4727-b895-4458d7bb4f3f None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:45.000028 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6ca520-bcde-4f69-8694-c4de83ae785a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:45.001033 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6ca520-bcde-4f69-8694-c4de83ae785a None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:45.001540 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6ca520-bcde-4f69-8694-c4de83ae785a None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:45.002020 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6ca520-bcde-4f69-8694-c4de83ae785a None admin] PATH_INFO: `/v3/services` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:45.002898 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6ca520-bcde-4f69-8694-c4de83ae785a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:45.003404 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6ca520-bcde-4f69-8694-c4de83ae785a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:45.005004 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6ca520-bcde-4f69-8694-c4de83ae785a None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:45.011088 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 460/928] 10.222.0.70 () {56 vars in 1122 bytes} [Tue Aug 2 21:28:44 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:45.016908 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a6d68d-7471-4106-a70b-9f3482db7d79 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:45.055618 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630bf58a-5ee3-408d-b2e1-c46415585c34 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:45.055803 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630bf58a-5ee3-408d-b2e1-c46415585c34 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:45.056088 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630bf58a-5ee3-408d-b2e1-c46415585c34 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:45.058252 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 461/929] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:28:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:28:45.063558 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e67e8f8-0eac-44f7-a2e0-491b242e1dd6 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:45.063558 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e67e8f8-0eac-44f7-a2e0-491b242e1dd6 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:45.063998 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e67e8f8-0eac-44f7-a2e0-491b242e1dd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:45.087556 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-6e67e8f8-0eac-44f7-a2e0-491b242e1dd6 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:28:45.089056 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-6e67e8f8-0eac-44f7-a2e0-491b242e1dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:28:45.124930 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a6d68d-7471-4106-a70b-9f3482db7d79 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:45.126616 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:45.174255 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1069b385-6e3f-45b3-9f69-0d9cbaa7ddd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:45.174928 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1069b385-6e3f-45b3-9f69-0d9cbaa7ddd2 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:45.175194 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1069b385-6e3f-45b3-9f69-0d9cbaa7ddd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:45.175473 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1069b385-6e3f-45b3-9f69-0d9cbaa7ddd2 None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:45.176153 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1069b385-6e3f-45b3-9f69-0d9cbaa7ddd2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:45.176530 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1069b385-6e3f-45b3-9f69-0d9cbaa7ddd2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:45.178140 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1069b385-6e3f-45b3-9f69-0d9cbaa7ddd2 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:45.183866 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 469/930] 10.222.0.70 () {56 vars in 1122 bytes} [Tue Aug 2 21:28:45 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:45.189650 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1069b385-6e3f-45b3-9f69-0d9cbaa7ddd2 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:45.190914 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 462/931] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:28:45 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 21:28:45.217290 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e67e8f8-0eac-44f7-a2e0-491b242e1dd6 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:45.321798 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1069b385-6e3f-45b3-9f69-0d9cbaa7ddd2 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:45.324702 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:45.335675 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e67e8f8-0eac-44f7-a2e0-491b242e1dd6 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:45.377990 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c308e37-14d0-4547-9b18-550d665e4c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:45.378617 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c308e37-14d0-4547-9b18-550d665e4c19 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:45.378900 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c308e37-14d0-4547-9b18-550d665e4c19 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:45.379177 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c308e37-14d0-4547-9b18-550d665e4c19 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:45.379934 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c308e37-14d0-4547-9b18-550d665e4c19 None admin] RBAC: Adding query filter params (interface=public, service_id=ecd974892f6042af880440556e468df6, region_id=RegionOne) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:45.380282 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c308e37-14d0-4547-9b18-550d665e4c19 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:45.381638 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c308e37-14d0-4547-9b18-550d665e4c19 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:45.392281 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 470/932] 10.222.0.70 () {56 vars in 1251 bytes} [Tue Aug 2 21:28:45 2022] GET /identity/v3/endpoints?service_id=ecd974892f6042af880440556e468df6&interface=public®ion_id=RegionOne => generated 194 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:45.392458 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a279c879-e596-4383-b0ec-fc9d56d8390a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:45.393455 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a279c879-e596-4383-b0ec-fc9d56d8390a None admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:45.393455 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a279c879-e596-4383-b0ec-fc9d56d8390a None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:45.393636 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a279c879-e596-4383-b0ec-fc9d56d8390a None admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:45.394304 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a279c879-e596-4383-b0ec-fc9d56d8390a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:45.395786 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a279c879-e596-4383-b0ec-fc9d56d8390a None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:45.396736 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c308e37-14d0-4547-9b18-550d665e4c19 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:45.398467 dv-cinder-851449-4-smb devstack@keystone.service[80420]: WARNING keystone.server.flask.common [None req-a279c879-e596-4383-b0ec-fc9d56d8390a None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 02 21:28:45.418216 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.sql.core [None req-a279c879-e596-4383-b0ec-fc9d56d8390a None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 02 21:28:45.418216 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 02 21:28:45.418216 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [parameters: {'id': '036a055473ec44168411d84dee2b749c', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 02 21:28:45.418216 dv-cinder-851449-4-smb devstack@keystone.service[80420]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80420) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 02 21:28:45.433581 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:45.441549 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-a279c879-e596-4383-b0ec-fc9d56d8390a None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 036a055473ec44168411d84dee2b749c.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 036a055473ec44168411d84dee2b749c. Aug 02 21:28:45.441549 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:45.441549 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 02 21:28:45.441549 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 02 21:28:45.441549 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 02 21:28:45.441549 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 02 21:28:45.441549 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 02 21:28:45.441549 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application result = self._query(query) Aug 02 21:28:45.441549 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 02 21:28:45.441549 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application conn.query(q) Aug 02 21:28:45.441549 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 02 21:28:45.441549 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 02 21:28:45.441549 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 02 21:28:45.442369 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application result.read() Aug 02 21:28:45.442369 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 02 21:28:45.442369 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 02 21:28:45.442369 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 02 21:28:45.442369 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 02 21:28:45.442369 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 02 21:28:45.442369 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 02 21:28:45.442369 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 02 21:28:45.442369 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 02 21:28:45.442369 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 02 21:28:45.442369 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:28:45.442369 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 02 21:28:45.442369 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:28:45.442369 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:45.442369 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 02 21:28:45.442369 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 02 21:28:45.442369 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 02 21:28:45.442369 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 02 21:28:45.443345 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 02 21:28:45.443345 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application next(self.gen) Aug 02 21:28:45.443345 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 02 21:28:45.443345 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application yield resource Aug 02 21:28:45.443345 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 02 21:28:45.443345 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application next(self.gen) Aug 02 21:28:45.443345 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 02 21:28:45.443345 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self.session.rollback() Aug 02 21:28:45.443345 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 02 21:28:45.443345 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self.force_reraise() Aug 02 21:28:45.443345 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 02 21:28:45.443345 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise self.value Aug 02 21:28:45.443345 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 02 21:28:45.443345 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 02 21:28:45.443345 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 02 21:28:45.443345 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application session.commit() Aug 02 21:28:45.443345 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 02 21:28:45.444271 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 02 21:28:45.444271 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 02 21:28:45.444271 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self._prepare_impl() Aug 02 21:28:45.444271 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 02 21:28:45.444271 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self.session.flush() Aug 02 21:28:45.444271 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 02 21:28:45.444271 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self._flush(objects) Aug 02 21:28:45.444271 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 02 21:28:45.444271 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 02 21:28:45.444271 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 02 21:28:45.444271 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application compat.raise_( Aug 02 21:28:45.444271 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 02 21:28:45.444271 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception Aug 02 21:28:45.444271 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 02 21:28:45.444271 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application flush_context.execute() Aug 02 21:28:45.444271 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 02 21:28:45.444271 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rec.execute(self) Aug 02 21:28:45.445172 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 02 21:28:45.445172 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 02 21:28:45.445172 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 02 21:28:45.445172 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 02 21:28:45.445172 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 02 21:28:45.445172 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 02 21:28:45.445172 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 02 21:28:45.445172 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 02 21:28:45.445172 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 02 21:28:45.445172 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 02 21:28:45.445172 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 02 21:28:45.445172 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 02 21:28:45.445172 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 02 21:28:45.445172 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 02 21:28:45.445172 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 02 21:28:45.447695 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 02 21:28:45.447695 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 02 21:28:45.447695 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception Aug 02 21:28:45.447695 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 02 21:28:45.447695 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 02 21:28:45.447695 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 02 21:28:45.447695 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 02 21:28:45.447695 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 02 21:28:45.447695 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application result = self._query(query) Aug 02 21:28:45.447695 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 02 21:28:45.447695 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application conn.query(q) Aug 02 21:28:45.447695 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 02 21:28:45.447695 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 02 21:28:45.447695 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 02 21:28:45.447695 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application result.read() Aug 02 21:28:45.447695 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 02 21:28:45.447695 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 02 21:28:45.449942 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 02 21:28:45.449942 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 02 21:28:45.449942 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 02 21:28:45.449942 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 02 21:28:45.449942 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 02 21:28:45.449942 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 02 21:28:45.449942 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 02 21:28:45.449942 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 02 21:28:45.449942 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [parameters: {'id': '036a055473ec44168411d84dee2b749c', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 02 21:28:45.449942 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 02 21:28:45.449942 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:28:45.449942 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 21:28:45.449942 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:28:45.449942 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:45.449942 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 02 21:28:45.452014 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 02 21:28:45.452014 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 02 21:28:45.452014 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 02 21:28:45.452014 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 02 21:28:45.452014 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:28:45.452014 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 21:28:45.452014 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:28:45.452014 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:45.452014 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:45.452014 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:45.452014 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:45.452014 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:45.452014 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:45.452014 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:45.452014 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:45.452014 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:45.452014 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:45.454165 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:45.454165 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 02 21:28:45.454165 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 02 21:28:45.454165 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:45.454165 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:45.454165 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 02 21:28:45.454165 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 02 21:28:45.454165 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 036a055473ec44168411d84dee2b749c. Aug 02 21:28:45.454165 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:28:45.454165 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 463/933] 10.222.0.70 () {60 vars in 1140 bytes} [Tue Aug 2 21:28:45 2022] POST /identity/v3/projects => generated 262 bytes in 226 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:45.454165 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a279c879-e596-4383-b0ec-fc9d56d8390a None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:45.521837 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c308e37-14d0-4547-9b18-550d665e4c19 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:45.560531 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c10737-636f-4c96-b4e7-01c6af72fd66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:45.561621 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c10737-636f-4c96-b4e7-01c6af72fd66 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:45.562115 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c10737-636f-4c96-b4e7-01c6af72fd66 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:45.562601 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c10737-636f-4c96-b4e7-01c6af72fd66 None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:45.563445 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c10737-636f-4c96-b4e7-01c6af72fd66 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:45.565257 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c10737-636f-4c96-b4e7-01c6af72fd66 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:45.572649 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 471/934] 10.222.0.70 () {56 vars in 1087 bytes} [Tue Aug 2 21:28:45 2022] GET /identity/v3/services => generated 1497 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:28:45.582912 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a279c879-e596-4383-b0ec-fc9d56d8390a None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:45.625044 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755a4b03-4ec1-4791-9acc-7e98d58f7b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:45.626102 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a4b03-4ec1-4791-9acc-7e98d58f7b6e None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:45.626636 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a4b03-4ec1-4791-9acc-7e98d58f7b6e None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:45.627115 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a4b03-4ec1-4791-9acc-7e98d58f7b6e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:45.635743 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755a4b03-4ec1-4791-9acc-7e98d58f7b6e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:45.637926 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755a4b03-4ec1-4791-9acc-7e98d58f7b6e None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:45.652207 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-755a4b03-4ec1-4791-9acc-7e98d58f7b6e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:28:45.652207 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:45.652207 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:45.652207 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:45.652207 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:45.652207 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:45.652207 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:45.652207 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:45.652207 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:45.652207 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:45.652207 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:45.652207 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:45.652207 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 21:28:45.652207 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 21:28:45.652207 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 21:28:45.653217 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 21:28:45.653217 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:45.653217 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:45.653217 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:45.653217 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:45.653217 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:45.653217 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:45.653217 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:45.653217 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:45.653217 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:45.653217 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:45.653217 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:45.653217 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:45.653217 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:45.653217 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:45.653217 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:45.653217 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:45.654134 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 21:28:45.654134 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 21:28:45.654134 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 21:28:45.654134 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 21:28:45.654134 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 21:28:45.654134 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 21:28:45.654134 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:28:45.654134 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:28:45.656884 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 464/935] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Aug 2 21:28:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:45.665422 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c10737-636f-4c96-b4e7-01c6af72fd66 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:45.775573 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:45.783225 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c10737-636f-4c96-b4e7-01c6af72fd66 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:45.815285 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67af558-7a44-4099-9681-c5ba7c47a9c0 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:45.815567 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67af558-7a44-4099-9681-c5ba7c47a9c0 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:45.815840 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67af558-7a44-4099-9681-c5ba7c47a9c0 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:45.820259 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 465/936] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:28:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:28:45.830546 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d41dc0-b585-4031-8b0d-1a253ca67c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:45.831116 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d41dc0-b585-4031-8b0d-1a253ca67c3a None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:45.831398 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d41dc0-b585-4031-8b0d-1a253ca67c3a None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:45.831524 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f08f5f-59df-4900-a590-750a6bbdb827 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:45.831671 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d41dc0-b585-4031-8b0d-1a253ca67c3a None admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:45.831987 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f08f5f-59df-4900-a590-750a6bbdb827 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:45.832399 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f08f5f-59df-4900-a590-750a6bbdb827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:45.832505 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d41dc0-b585-4031-8b0d-1a253ca67c3a None admin] RBAC: Adding query filter params (name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:45.832710 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d41dc0-b585-4031-8b0d-1a253ca67c3a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:45.834131 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d41dc0-b585-4031-8b0d-1a253ca67c3a None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:45.847887 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:45.854205 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 472/937] 10.222.0.70 () {56 vars in 1112 bytes} [Tue Aug 2 21:28:45 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:45.857902 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-d4f08f5f-59df-4900-a590-750a6bbdb827 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:28:45.860955 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-d4f08f5f-59df-4900-a590-750a6bbdb827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:28:45.948045 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 466/938] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:28:45 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 21:28:45.971080 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d41dc0-b585-4031-8b0d-1a253ca67c3a None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:46.082455 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d41dc0-b585-4031-8b0d-1a253ca67c3a None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:46.121834 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e67d6f-7f72-41b9-bed0-e00ceead5802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:46.122485 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e67d6f-7f72-41b9-bed0-e00ceead5802 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:46.122765 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e67d6f-7f72-41b9-bed0-e00ceead5802 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:46.123039 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e67d6f-7f72-41b9-bed0-e00ceead5802 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:46.138429 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e67d6f-7f72-41b9-bed0-e00ceead5802 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:28:46.143469 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-d5e67d6f-7f72-41b9-bed0-e00ceead5802 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 02 21:28:46.143469 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:46.143469 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:46.143469 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:46.143469 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:46.143469 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:46.143469 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:46.143469 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:46.143469 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:46.143469 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:46.143469 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:46.143469 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:46.143469 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:28:46.143469 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:28:46.143469 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:28:46.143469 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:28:46.144442 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:28:46.144442 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:28:46.144442 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:28:46.144442 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:28:46.144442 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:46.144442 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:46.144442 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:46.144442 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:46.144442 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:46.144442 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:46.144442 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:46.144442 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:46.144442 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:46.144442 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:46.144442 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:46.144442 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:46.145282 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:46.145282 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:46.145282 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:46.145282 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:46.145282 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:28:46.145282 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:28:46.145282 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:28:46.145282 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:28:46.145282 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:28:46.145282 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:28:46.145282 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 02 21:28:46.145282 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:46.145282 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 473/939] 10.222.0.70 () {56 vars in 1120 bytes} [Tue Aug 2 21:28:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:46.153334 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f08f5f-59df-4900-a590-750a6bbdb827 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:46.257225 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f08f5f-59df-4900-a590-750a6bbdb827 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:46.299504 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf260d5d-4e5d-44ab-b3b0-186e691762d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:46.300133 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf260d5d-4e5d-44ab-b3b0-186e691762d5 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:46.300444 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf260d5d-4e5d-44ab-b3b0-186e691762d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:46.300722 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf260d5d-4e5d-44ab-b3b0-186e691762d5 None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:46.301455 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf260d5d-4e5d-44ab-b3b0-186e691762d5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:46.301765 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf260d5d-4e5d-44ab-b3b0-186e691762d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:46.303147 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf260d5d-4e5d-44ab-b3b0-186e691762d5 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:46.309053 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:46.312756 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 467/940] 10.222.0.70 () {56 vars in 1115 bytes} [Tue Aug 2 21:28:46 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:46.318269 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e67d6f-7f72-41b9-bed0-e00ceead5802 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:46.336751 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:46.429353 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e67d6f-7f72-41b9-bed0-e00ceead5802 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:46.465079 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd4a6bc-44b2-40fd-84e1-35799803a952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:46.465726 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd4a6bc-44b2-40fd-84e1-35799803a952 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:46.466001 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd4a6bc-44b2-40fd-84e1-35799803a952 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:46.466279 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd4a6bc-44b2-40fd-84e1-35799803a952 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:46.478661 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd4a6bc-44b2-40fd-84e1-35799803a952 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:46.480147 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd4a6bc-44b2-40fd-84e1-35799803a952 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:46.498806 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-cbd4a6bc-44b2-40fd-84e1-35799803a952 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:46.498806 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:46.498806 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:46.498806 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:46.498806 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:46.498806 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:46.498806 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:46.498806 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:46.498806 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:46.498806 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:46.498806 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:46.498806 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:46.498806 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:28:46.498806 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:28:46.498806 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:28:46.499769 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:28:46.499769 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:46.499769 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:46.499769 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:46.499769 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:46.499769 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:46.499769 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:46.499769 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:46.499769 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:46.499769 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:46.499769 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:46.499769 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:46.499769 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:46.499769 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:46.499769 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:46.499769 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:46.499769 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:46.500698 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:28:46.500698 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:28:46.500698 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:46.500698 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:46.500698 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 474/941] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 2 21:28:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:46.506212 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf260d5d-4e5d-44ab-b3b0-186e691762d5 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:46.555575 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c885bce6-620c-4965-a78e-b5798ac70bd6 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:46.555894 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c885bce6-620c-4965-a78e-b5798ac70bd6 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:46.556130 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c885bce6-620c-4965-a78e-b5798ac70bd6 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:46.558183 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 475/942] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:28:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:28:46.563310 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97126c0-4f39-4151-a159-59e975859c4d None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:46.563550 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97126c0-4f39-4151-a159-59e975859c4d None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:46.563818 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97126c0-4f39-4151-a159-59e975859c4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:46.582009 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-f97126c0-4f39-4151-a159-59e975859c4d None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:28:46.583188 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-f97126c0-4f39-4151-a159-59e975859c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:28:46.631141 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf260d5d-4e5d-44ab-b3b0-186e691762d5 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:46.648665 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:46.654522 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 476/943] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:28:46 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 21:28:46.675974 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab47498b-1d46-44af-a60f-5fa3a2a5ef80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:46.676743 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab47498b-1d46-44af-a60f-5fa3a2a5ef80 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:46.677170 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab47498b-1d46-44af-a60f-5fa3a2a5ef80 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:46.677408 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97126c0-4f39-4151-a159-59e975859c4d None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:46.677639 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab47498b-1d46-44af-a60f-5fa3a2a5ef80 None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:46.678488 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab47498b-1d46-44af-a60f-5fa3a2a5ef80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:46.678885 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab47498b-1d46-44af-a60f-5fa3a2a5ef80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:46.681299 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab47498b-1d46-44af-a60f-5fa3a2a5ef80 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:46.694019 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 468/944] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 2 21:28:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:46.701161 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab47498b-1d46-44af-a60f-5fa3a2a5ef80 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:46.771210 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:46.795259 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97126c0-4f39-4151-a159-59e975859c4d None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:46.814980 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab47498b-1d46-44af-a60f-5fa3a2a5ef80 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:46.837805 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045bf782-73bc-4b80-9e3b-1105e704870c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:46.838951 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045bf782-73bc-4b80-9e3b-1105e704870c None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:46.839449 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045bf782-73bc-4b80-9e3b-1105e704870c None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:46.839919 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045bf782-73bc-4b80-9e3b-1105e704870c None admin] PATH_INFO: `/v3/services/compute` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:46.840917 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045bf782-73bc-4b80-9e3b-1105e704870c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:46.842519 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045bf782-73bc-4b80-9e3b-1105e704870c None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:46.853426 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-045bf782-73bc-4b80-9e3b-1105e704870c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 02 21:28:46.853426 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:46.853426 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 21:28:46.853426 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 21:28:46.853426 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 21:28:46.853426 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 21:28:46.853426 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 21:28:46.853426 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 21:28:46.853426 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 02 21:28:46.853426 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:46.853426 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 21:28:46.853426 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:46.853426 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:46.853426 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:46.853426 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:46.853426 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:46.853426 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:46.854508 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:46.854508 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:46.854508 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:46.854508 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:46.854508 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:46.854508 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:46.854508 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 21:28:46.854508 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 21:28:46.854508 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 21:28:46.854508 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 21:28:46.854508 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:46.854508 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:46.854508 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:46.854508 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:46.854508 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:46.854508 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:46.855332 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:46.855332 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:46.855332 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:46.855332 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:46.855332 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:46.855332 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:46.855332 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:46.855332 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:46.855332 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:46.855332 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:46.855332 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 21:28:46.855332 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 21:28:46.855332 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 02 21:28:46.855332 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:46.857663 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 477/945] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Aug 2 21:28:46 2022] GET /identity/v3/services/compute => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 21:28:46.863864 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045bf782-73bc-4b80-9e3b-1105e704870c None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:46.865706 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37970459-44f3-49b5-a1cc-e977b35a0b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:46.866350 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37970459-44f3-49b5-a1cc-e977b35a0b6a None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:46.866626 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37970459-44f3-49b5-a1cc-e977b35a0b6a None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:46.866962 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37970459-44f3-49b5-a1cc-e977b35a0b6a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:46.876265 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37970459-44f3-49b5-a1cc-e977b35a0b6a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:46.878202 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37970459-44f3-49b5-a1cc-e977b35a0b6a None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:46.904021 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-37970459-44f3-49b5-a1cc-e977b35a0b6a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 02 21:28:46.904021 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:46.904021 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:46.904021 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:46.904021 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:46.904021 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:46.904021 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:46.904021 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:46.904021 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:46.904021 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:46.904021 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:46.904021 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:46.904021 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 21:28:46.904021 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 21:28:46.904021 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 21:28:46.904021 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 21:28:46.905646 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:46.905646 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:46.905646 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 21:28:46.905646 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:28:46.905646 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 21:28:46.905646 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:28:46.905646 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:46.905646 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:46.905646 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:46.905646 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:46.905646 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:46.905646 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:46.905646 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:46.905646 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:46.905646 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:46.905646 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:46.905646 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:46.905646 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:46.906589 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:46.906589 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:46.906589 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 21:28:46.906589 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 21:28:46.906589 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 21:28:46.906589 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 21:28:46.906589 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 21:28:46.906589 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 21:28:46.906589 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 02 21:28:46.906589 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:28:46.906589 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 469/946] 10.222.0.70 () {56 vars in 1117 bytes} [Tue Aug 2 21:28:46 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:46.906589 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37970459-44f3-49b5-a1cc-e977b35a0b6a None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:46.952694 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:46.998894 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045bf782-73bc-4b80-9e3b-1105e704870c None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:47.034390 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37970459-44f3-49b5-a1cc-e977b35a0b6a None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:47.041217 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7f8161-d521-4d4c-97c6-088b5faab7ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:47.042136 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f8161-d521-4d4c-97c6-088b5faab7ae None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:47.043127 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f8161-d521-4d4c-97c6-088b5faab7ae None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:47.043599 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f8161-d521-4d4c-97c6-088b5faab7ae None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:47.044954 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7f8161-d521-4d4c-97c6-088b5faab7ae None admin] RBAC: Adding query filter params (name=compute) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:47.045462 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7f8161-d521-4d4c-97c6-088b5faab7ae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:47.047789 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7f8161-d521-4d4c-97c6-088b5faab7ae None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:47.053627 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:47.056115 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 478/947] 10.222.0.70 () {56 vars in 1112 bytes} [Tue Aug 2 21:28:46 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:28:47.063148 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7f8161-d521-4d4c-97c6-088b5faab7ae None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:47.084393 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff20ae3a-d18f-48f4-bcbc-273aea29ac11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:47.085041 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff20ae3a-d18f-48f4-bcbc-273aea29ac11 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:47.085331 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff20ae3a-d18f-48f4-bcbc-273aea29ac11 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:47.085611 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff20ae3a-d18f-48f4-bcbc-273aea29ac11 None admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:47.086420 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff20ae3a-d18f-48f4-bcbc-273aea29ac11 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:47.086728 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff20ae3a-d18f-48f4-bcbc-273aea29ac11 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:47.089670 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff20ae3a-d18f-48f4-bcbc-273aea29ac11 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:47.114915 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 470/948] 10.222.0.70 () {56 vars in 1149 bytes} [Tue Aug 2 21:28:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:28:47.116800 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff20ae3a-d18f-48f4-bcbc-273aea29ac11 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:47.191367 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7f8161-d521-4d4c-97c6-088b5faab7ae None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:47.218093 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:47.223491 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff20ae3a-d18f-48f4-bcbc-273aea29ac11 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:47.231657 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a671e4-8155-408d-98ff-db349c516230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:47.232589 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a671e4-8155-408d-98ff-db349c516230 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:47.233069 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a671e4-8155-408d-98ff-db349c516230 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:47.233565 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a671e4-8155-408d-98ff-db349c516230 None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:47.234449 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a671e4-8155-408d-98ff-db349c516230 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:47.234946 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a671e4-8155-408d-98ff-db349c516230 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:47.236525 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a671e4-8155-408d-98ff-db349c516230 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:47.242337 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 479/949] 10.222.0.70 () {56 vars in 1112 bytes} [Tue Aug 2 21:28:47 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:47.279783 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8a2669-380e-4fca-82a6-8eb05b9a1de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:47.280478 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a2669-380e-4fca-82a6-8eb05b9a1de3 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:47.280766 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a2669-380e-4fca-82a6-8eb05b9a1de3 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:47.281116 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a2669-380e-4fca-82a6-8eb05b9a1de3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:47.292711 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8a2669-380e-4fca-82a6-8eb05b9a1de3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:47.296268 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8a2669-380e-4fca-82a6-8eb05b9a1de3 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:47.310933 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-8c8a2669-380e-4fca-82a6-8eb05b9a1de3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:47.310933 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:47.310933 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:47.310933 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:47.310933 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:47.310933 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:47.310933 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:47.310933 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:47.310933 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:47.310933 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:47.310933 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:47.310933 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:47.310933 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:28:47.310933 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:28:47.310933 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:28:47.311898 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:28:47.311898 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:47.311898 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:47.311898 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:47.311898 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:47.311898 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:47.311898 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:47.311898 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:47.311898 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:47.311898 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:47.311898 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:47.311898 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:47.311898 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:47.311898 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:47.311898 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:47.311898 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:47.311898 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:47.312825 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:28:47.312825 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:28:47.312825 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:47.312825 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:28:47.317234 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 471/950] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 2 21:28:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:47.318645 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a671e4-8155-408d-98ff-db349c516230 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:47.436722 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a671e4-8155-408d-98ff-db349c516230 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:47.484575 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52bbebb-3a28-47c5-9693-51100488ebd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:47.485205 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52bbebb-3a28-47c5-9693-51100488ebd2 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:47.485494 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52bbebb-3a28-47c5-9693-51100488ebd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:47.485771 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52bbebb-3a28-47c5-9693-51100488ebd2 None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:47.486475 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52bbebb-3a28-47c5-9693-51100488ebd2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:47.486783 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52bbebb-3a28-47c5-9693-51100488ebd2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:47.488438 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52bbebb-3a28-47c5-9693-51100488ebd2 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:47.501884 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 480/951] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 2 21:28:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:47.507714 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8a2669-380e-4fca-82a6-8eb05b9a1de3 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:47.545951 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:47.615198 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8a2669-380e-4fca-82a6-8eb05b9a1de3 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:47.652267 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dab4870-f1a5-45a1-aa88-3a27b46b8516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:47.653166 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dab4870-f1a5-45a1-aa88-3a27b46b8516 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:47.653601 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dab4870-f1a5-45a1-aa88-3a27b46b8516 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:47.654103 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dab4870-f1a5-45a1-aa88-3a27b46b8516 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:47.661410 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dab4870-f1a5-45a1-aa88-3a27b46b8516 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:47.663114 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dab4870-f1a5-45a1-aa88-3a27b46b8516 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:47.675514 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-2dab4870-f1a5-45a1-aa88-3a27b46b8516 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:28:47.675514 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:47.675514 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:47.675514 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:47.675514 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:47.675514 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:47.675514 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:47.675514 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:47.675514 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:47.675514 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:47.675514 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:47.675514 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:47.675514 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 21:28:47.675514 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 21:28:47.675514 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 21:28:47.676629 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 21:28:47.676629 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:47.676629 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:47.676629 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:47.676629 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:47.676629 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:47.676629 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:47.676629 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:47.676629 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:47.676629 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:47.676629 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:47.676629 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:47.676629 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:47.676629 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:47.676629 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:47.676629 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:47.676629 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:47.677730 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 21:28:47.677730 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 21:28:47.677730 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 21:28:47.677730 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 21:28:47.677730 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 21:28:47.677730 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 21:28:47.677730 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:28:47.677730 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:28:47.684387 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 472/952] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Aug 2 21:28:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:47.687640 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52bbebb-3a28-47c5-9693-51100488ebd2 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:47.740906 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:47.756389 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc93556-bf85-48a4-92a7-95490eaa5c99 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:47.756683 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc93556-bf85-48a4-92a7-95490eaa5c99 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:47.756966 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc93556-bf85-48a4-92a7-95490eaa5c99 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:47.758582 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 473/953] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:28:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 21:28:47.763498 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfae441-98a1-49b1-b691-45850fc1e089 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:47.763785 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfae441-98a1-49b1-b691-45850fc1e089 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:47.764060 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfae441-98a1-49b1-b691-45850fc1e089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:47.782675 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-ebfae441-98a1-49b1-b691-45850fc1e089 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:28:47.783866 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-ebfae441-98a1-49b1-b691-45850fc1e089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:28:47.805390 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52bbebb-3a28-47c5-9693-51100488ebd2 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:47.852648 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b697c8-c629-4d84-b007-2ee0eb630c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:47.853462 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b697c8-c629-4d84-b007-2ee0eb630c6b None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:47.855153 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b697c8-c629-4d84-b007-2ee0eb630c6b None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:47.855436 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b697c8-c629-4d84-b007-2ee0eb630c6b None admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:47.856191 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b697c8-c629-4d84-b007-2ee0eb630c6b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:47.856530 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b697c8-c629-4d84-b007-2ee0eb630c6b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:47.857969 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b697c8-c629-4d84-b007-2ee0eb630c6b None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:47.877619 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 481/954] 10.222.0.70 () {56 vars in 1148 bytes} [Tue Aug 2 21:28:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:47.883903 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 474/955] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:28:47 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 21:28:47.883903 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfae441-98a1-49b1-b691-45850fc1e089 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:47.903688 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:47.905860 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b697c8-c629-4d84-b007-2ee0eb630c6b None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:47.999165 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfae441-98a1-49b1-b691-45850fc1e089 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:48.029566 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b697c8-c629-4d84-b007-2ee0eb630c6b None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:48.039633 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:48.047758 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9af62d2-0067-47f4-8dea-31767df73e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:48.049229 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af62d2-0067-47f4-8dea-31767df73e4f None admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:48.050450 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af62d2-0067-47f4-8dea-31767df73e4f None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:48.050937 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9af62d2-0067-47f4-8dea-31767df73e4f None admin] PATH_INFO: `/v3/projects/42672e04d6ce4b0ab5f7eccfb0cc946c/users/6be7b2bcfebd45389ca289c34fbabc3e/roles/13e24a71ee30450ab0dfa871704b0520` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:48.054095 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9af62d2-0067-47f4-8dea-31767df73e4f None admin] RBAC: Authorizing `identity:create_grant(project_id=42672e04d6ce4b0ab5f7eccfb0cc946c, user_id=6be7b2bcfebd45389ca289c34fbabc3e, role_id=13e24a71ee30450ab0dfa871704b0520)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:48.056328 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9af62d2-0067-47f4-8dea-31767df73e4f None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:48.068991 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9834a07-af0a-4db6-b6ed-34fe995b00ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:48.069859 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9834a07-af0a-4db6-b6ed-34fe995b00ec None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:48.070185 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9834a07-af0a-4db6-b6ed-34fe995b00ec None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:48.070412 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9834a07-af0a-4db6-b6ed-34fe995b00ec None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:48.071259 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9834a07-af0a-4db6-b6ed-34fe995b00ec None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:48.072724 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9834a07-af0a-4db6-b6ed-34fe995b00ec None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:48.073934 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 475/956] 10.222.0.70 () {58 vars in 1439 bytes} [Tue Aug 2 21:28:47 2022] PUT /identity/v3/projects/42672e04d6ce4b0ab5f7eccfb0cc946c/users/6be7b2bcfebd45389ca289c34fbabc3e/roles/13e24a71ee30450ab0dfa871704b0520 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:28:48.081950 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87c16b3-c974-44de-bae3-5a26b21760e9 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:48.082295 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-d9834a07-af0a-4db6-b6ed-34fe995b00ec None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 02 21:28:48.082295 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:48.082295 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 21:28:48.082295 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 21:28:48.082295 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 21:28:48.082295 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 21:28:48.082295 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 21:28:48.082295 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 21:28:48.082295 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 02 21:28:48.082295 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:48.082295 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 21:28:48.082295 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:48.082295 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:48.082295 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:48.082295 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:48.082295 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:48.082295 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:48.083479 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:48.083479 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:48.083479 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:48.083479 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:48.083479 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:48.083479 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:48.083479 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 21:28:48.083479 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 21:28:48.083479 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 21:28:48.083479 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 21:28:48.083479 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:48.083479 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:48.083479 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:48.083479 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:48.083479 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:48.083479 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:48.084426 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:48.084426 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:48.084426 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:48.084426 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:48.084426 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:48.084426 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:48.084426 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:48.084426 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:48.084426 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:48.084426 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:48.084426 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 21:28:48.084426 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 21:28:48.084426 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 02 21:28:48.084426 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:48.086177 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87c16b3-c974-44de-bae3-5a26b21760e9 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:48.086811 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87c16b3-c974-44de-bae3-5a26b21760e9 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:48.089018 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 482/957] 10.222.0.70 () {56 vars in 1126 bytes} [Tue Aug 2 21:28:47 2022] GET /identity/v3/services/object-store => generated 93 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 21:28:48.089858 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 476/958] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:28:48 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:28:48.091042 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9834a07-af0a-4db6-b6ed-34fe995b00ec None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:48.097799 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee86505-43cc-41c3-9307-79a0c42956d4 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:48.098082 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee86505-43cc-41c3-9307-79a0c42956d4 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:48.100138 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee86505-43cc-41c3-9307-79a0c42956d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:48.128465 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-dee86505-43cc-41c3-9307-79a0c42956d4 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:28:48.130961 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-dee86505-43cc-41c3-9307-79a0c42956d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:28:48.215860 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9834a07-af0a-4db6-b6ed-34fe995b00ec None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:48.232766 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 477/959] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:28:48 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 21:28:48.258099 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee86505-43cc-41c3-9307-79a0c42956d4 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:48.265259 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed71293-a56b-4506-ac07-a99969468d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:48.265886 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed71293-a56b-4506-ac07-a99969468d7a None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:48.266168 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed71293-a56b-4506-ac07-a99969468d7a None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:48.266438 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed71293-a56b-4506-ac07-a99969468d7a None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:48.267116 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed71293-a56b-4506-ac07-a99969468d7a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:48.267419 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed71293-a56b-4506-ac07-a99969468d7a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:48.269603 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed71293-a56b-4506-ac07-a99969468d7a None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:48.270769 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:48.277131 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 483/960] 10.222.0.70 () {56 vars in 1122 bytes} [Tue Aug 2 21:28:48 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:48.290722 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed71293-a56b-4506-ac07-a99969468d7a None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:48.340400 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:48.403578 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee86505-43cc-41c3-9307-79a0c42956d4 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:48.421907 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed71293-a56b-4506-ac07-a99969468d7a None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:48.450717 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a465bdb-e1c2-4cb6-bc3f-10c0a88f1bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:48.451359 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a465bdb-e1c2-4cb6-bc3f-10c0a88f1bde None admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:48.451767 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a465bdb-e1c2-4cb6-bc3f-10c0a88f1bde None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:48.452047 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a465bdb-e1c2-4cb6-bc3f-10c0a88f1bde None admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:48.452750 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a465bdb-e1c2-4cb6-bc3f-10c0a88f1bde None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:48.454846 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a465bdb-e1c2-4cb6-bc3f-10c0a88f1bde None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:48.461595 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80e8b46-9818-41a8-9540-90716f87c96c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:48.462439 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80e8b46-9818-41a8-9540-90716f87c96c None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:48.462938 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80e8b46-9818-41a8-9540-90716f87c96c None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:48.463381 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80e8b46-9818-41a8-9540-90716f87c96c None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:48.464216 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80e8b46-9818-41a8-9540-90716f87c96c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:48.464695 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80e8b46-9818-41a8-9540-90716f87c96c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:48.466235 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80e8b46-9818-41a8-9540-90716f87c96c None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:48.470825 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.sql.core [None req-8a465bdb-e1c2-4cb6-bc3f-10c0a88f1bde None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 02 21:28:48.470825 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 02 21:28:48.470825 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [parameters: {'user_id': '3bc309cde77e4f9fbeb9f92bf0b4677d', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 02 21:28:48.470825 dv-cinder-851449-4-smb devstack@keystone.service[80420]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80420) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 02 21:28:48.477703 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 484/961] 10.222.0.70 () {56 vars in 1122 bytes} [Tue Aug 2 21:28:48 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:48.477858 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-8a465bdb-e1c2-4cb6-bc3f-10c0a88f1bde None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 02 21:28:48.477858 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:48.477858 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 02 21:28:48.477858 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 02 21:28:48.477858 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 02 21:28:48.477858 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 02 21:28:48.477858 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 02 21:28:48.477858 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application result = self._query(query) Aug 02 21:28:48.477858 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 02 21:28:48.477858 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application conn.query(q) Aug 02 21:28:48.477858 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 02 21:28:48.477858 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 02 21:28:48.477858 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 02 21:28:48.477858 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application result.read() Aug 02 21:28:48.477858 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 02 21:28:48.479393 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 02 21:28:48.479393 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 02 21:28:48.479393 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 02 21:28:48.479393 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 02 21:28:48.479393 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 02 21:28:48.479393 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 02 21:28:48.479393 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 02 21:28:48.479393 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 02 21:28:48.479393 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:28:48.479393 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 02 21:28:48.479393 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:28:48.479393 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:48.479393 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 02 21:28:48.479393 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 02 21:28:48.479393 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 02 21:28:48.479393 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 02 21:28:48.479393 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 02 21:28:48.479393 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application next(self.gen) Aug 02 21:28:48.480721 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 02 21:28:48.480721 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application yield resource Aug 02 21:28:48.480721 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 02 21:28:48.480721 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application next(self.gen) Aug 02 21:28:48.480721 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 02 21:28:48.480721 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self.session.rollback() Aug 02 21:28:48.480721 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 02 21:28:48.480721 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self.force_reraise() Aug 02 21:28:48.480721 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 02 21:28:48.480721 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise self.value Aug 02 21:28:48.480721 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 02 21:28:48.480721 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 02 21:28:48.480721 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 02 21:28:48.480721 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application session.commit() Aug 02 21:28:48.480721 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 02 21:28:48.480721 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 02 21:28:48.480721 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 02 21:28:48.482120 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self._prepare_impl() Aug 02 21:28:48.482120 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 02 21:28:48.482120 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self.session.flush() Aug 02 21:28:48.482120 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 02 21:28:48.482120 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self._flush(objects) Aug 02 21:28:48.482120 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 02 21:28:48.482120 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 02 21:28:48.482120 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 02 21:28:48.482120 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application compat.raise_( Aug 02 21:28:48.482120 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 02 21:28:48.482120 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception Aug 02 21:28:48.482120 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 02 21:28:48.482120 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application flush_context.execute() Aug 02 21:28:48.482120 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 02 21:28:48.482120 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rec.execute(self) Aug 02 21:28:48.482120 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 02 21:28:48.482120 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 02 21:28:48.483380 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 02 21:28:48.483380 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 02 21:28:48.483380 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 02 21:28:48.483380 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 02 21:28:48.483380 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 02 21:28:48.483380 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 02 21:28:48.483380 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 02 21:28:48.483380 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 02 21:28:48.483380 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 02 21:28:48.483380 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 02 21:28:48.483380 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 02 21:28:48.483380 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 02 21:28:48.483380 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 02 21:28:48.483380 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 02 21:28:48.483380 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 02 21:28:48.483380 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception Aug 02 21:28:48.484876 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 02 21:28:48.484876 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 02 21:28:48.484876 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 02 21:28:48.484876 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 02 21:28:48.484876 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 02 21:28:48.484876 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application result = self._query(query) Aug 02 21:28:48.484876 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 02 21:28:48.484876 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application conn.query(q) Aug 02 21:28:48.484876 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 02 21:28:48.484876 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 02 21:28:48.484876 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 02 21:28:48.484876 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application result.read() Aug 02 21:28:48.484876 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 02 21:28:48.484876 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 02 21:28:48.484876 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 02 21:28:48.484876 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 02 21:28:48.486013 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 02 21:28:48.486013 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 02 21:28:48.486013 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 02 21:28:48.486013 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 02 21:28:48.486013 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 02 21:28:48.486013 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 02 21:28:48.486013 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [parameters: {'user_id': '3bc309cde77e4f9fbeb9f92bf0b4677d', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 02 21:28:48.486013 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 02 21:28:48.486013 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:28:48.486013 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 21:28:48.486013 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:28:48.486013 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:48.486013 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:48.486013 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:48.486013 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:48.487016 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:48.487016 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:48.487016 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:48.487016 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:48.487016 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:48.487016 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:48.487016 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:48.487016 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 02 21:28:48.487016 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 02 21:28:48.487016 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:48.487016 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:48.487016 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 21:28:48.487016 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:28:48.487016 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 21:28:48.487016 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:28:48.487016 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 02 21:28:48.487016 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 02 21:28:48.489549 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 02 21:28:48.489549 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 02 21:28:48.489549 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 02 21:28:48.489549 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 02 21:28:48.489549 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 02 21:28:48.489549 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:28:48.489549 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 478/962] 10.222.0.70 () {60 vars in 1131 bytes} [Tue Aug 2 21:28:48 2022] POST /identity/v3/users => generated 160 bytes in 222 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:48.495949 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a465bdb-e1c2-4cb6-bc3f-10c0a88f1bde None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:48.499022 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80e8b46-9818-41a8-9540-90716f87c96c None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:48.582242 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:48.612103 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:48.616406 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80e8b46-9818-41a8-9540-90716f87c96c None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:48.622244 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a465bdb-e1c2-4cb6-bc3f-10c0a88f1bde None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:48.655032 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354bd355-04a1-42f8-8932-880c806d2680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:48.655935 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354bd355-04a1-42f8-8932-880c806d2680 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:48.656467 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354bd355-04a1-42f8-8932-880c806d2680 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:48.656909 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354bd355-04a1-42f8-8932-880c806d2680 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:48.665874 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354bd355-04a1-42f8-8932-880c806d2680 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:48.667243 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f53ed66-8673-4430-82ce-883e3deb0379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:48.667965 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f53ed66-8673-4430-82ce-883e3deb0379 None admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:48.668381 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f53ed66-8673-4430-82ce-883e3deb0379 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:48.668639 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354bd355-04a1-42f8-8932-880c806d2680 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:48.668845 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f53ed66-8673-4430-82ce-883e3deb0379 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:48.669829 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f53ed66-8673-4430-82ce-883e3deb0379 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:48.671659 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f53ed66-8673-4430-82ce-883e3deb0379 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:48.683001 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-354bd355-04a1-42f8-8932-880c806d2680 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 02 21:28:48.683001 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:48.683001 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:48.683001 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:48.683001 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:48.683001 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:48.683001 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:48.683001 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:48.683001 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:48.683001 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:48.683001 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:48.683001 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:48.683001 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 21:28:48.683001 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 21:28:48.683001 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 21:28:48.683001 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 21:28:48.684158 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:48.684158 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:48.684158 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 21:28:48.684158 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:28:48.684158 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 21:28:48.684158 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:28:48.684158 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:48.684158 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:48.684158 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:48.684158 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:48.684158 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:48.684158 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:48.684158 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:48.684158 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:48.684158 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:48.684158 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:48.684158 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:48.684158 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:48.685454 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:48.685454 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:48.685454 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 21:28:48.685454 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 21:28:48.685454 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 21:28:48.685454 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 21:28:48.685454 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 21:28:48.685454 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 21:28:48.685454 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 02 21:28:48.685454 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:48.692558 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 485/963] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 2 21:28:48 2022] GET /identity/v3/users/cinder => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:48.693989 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354bd355-04a1-42f8-8932-880c806d2680 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:48.712336 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 479/964] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 2 21:28:48 2022] POST /identity/v3/endpoints => generated 349 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:28:48.822539 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354bd355-04a1-42f8-8932-880c806d2680 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:48.869676 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7fe41f-234e-4c48-ac05-f84fde58712a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:48.870549 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7fe41f-234e-4c48-ac05-f84fde58712a None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:48.871039 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7fe41f-234e-4c48-ac05-f84fde58712a None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:48.871465 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7fe41f-234e-4c48-ac05-f84fde58712a None admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:48.872456 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7fe41f-234e-4c48-ac05-f84fde58712a None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:48.872930 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7fe41f-234e-4c48-ac05-f84fde58712a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:48.874524 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7fe41f-234e-4c48-ac05-f84fde58712a None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:48.916750 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 486/965] 10.222.0.70 () {56 vars in 1101 bytes} [Tue Aug 2 21:28:48 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:28:49.330031 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445ad460-1c88-4e0c-97af-3057f267c73c None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:49.330914 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445ad460-1c88-4e0c-97af-3057f267c73c None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:49.331195 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445ad460-1c88-4e0c-97af-3057f267c73c None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:49.332620 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 480/966] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:28:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:28:49.338483 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fd211d-8ad8-4e2c-8c03-4989ed214446 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:49.338945 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fd211d-8ad8-4e2c-8c03-4989ed214446 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:49.339326 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fd211d-8ad8-4e2c-8c03-4989ed214446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:49.357279 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-b4fd211d-8ad8-4e2c-8c03-4989ed214446 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:28:49.358606 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-b4fd211d-8ad8-4e2c-8c03-4989ed214446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:28:49.369026 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:49.433438 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 487/967] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:28:49 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 21:28:49.455437 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445ad460-1c88-4e0c-97af-3057f267c73c None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:49.559708 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445ad460-1c88-4e0c-97af-3057f267c73c None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:49.584119 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:49.597420 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a512db3e-35b8-4f29-9887-9b830c2d860b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:49.597420 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a512db3e-35b8-4f29-9887-9b830c2d860b None admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:49.597420 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a512db3e-35b8-4f29-9887-9b830c2d860b None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:49.597420 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a512db3e-35b8-4f29-9887-9b830c2d860b None admin] PATH_INFO: `/v3/services` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:49.597801 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a512db3e-35b8-4f29-9887-9b830c2d860b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:49.599666 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a512db3e-35b8-4f29-9887-9b830c2d860b None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:49.616860 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 481/968] 10.222.0.70 () {60 vars in 1141 bytes} [Tue Aug 2 21:28:49 2022] POST /identity/v3/services => generated 242 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:28:50.172311 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8879f2ef-2ec1-4c85-9c8e-64027358d051 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:50.172850 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8879f2ef-2ec1-4c85-9c8e-64027358d051 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:50.172850 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8879f2ef-2ec1-4c85-9c8e-64027358d051 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:50.174358 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 488/969] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:28:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:28:50.179370 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ef4a65-7335-4db0-addc-65936d6c165e None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:50.179661 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ef4a65-7335-4db0-addc-65936d6c165e None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:50.179938 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ef4a65-7335-4db0-addc-65936d6c165e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:50.198642 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-e1ef4a65-7335-4db0-addc-65936d6c165e None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:28:50.200160 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-e1ef4a65-7335-4db0-addc-65936d6c165e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:28:50.292606 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 482/970] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:28:50 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 21:28:50.311172 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8879f2ef-2ec1-4c85-9c8e-64027358d051 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:50.415184 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8879f2ef-2ec1-4c85-9c8e-64027358d051 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:50.449307 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc5f9e0-34d7-48d3-a3f1-5fa792edc673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:50.449877 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc5f9e0-34d7-48d3-a3f1-5fa792edc673 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:50.450160 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc5f9e0-34d7-48d3-a3f1-5fa792edc673 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:50.450436 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc5f9e0-34d7-48d3-a3f1-5fa792edc673 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:50.460857 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc5f9e0-34d7-48d3-a3f1-5fa792edc673 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:28:50.466304 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-8dc5f9e0-34d7-48d3-a3f1-5fa792edc673 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 02 21:28:50.466304 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:50.466304 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:50.466304 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:50.466304 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:50.466304 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:50.466304 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:50.466304 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:50.466304 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:50.466304 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:50.466304 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:50.466304 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:50.466304 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:28:50.466304 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:28:50.466304 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:28:50.466304 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:28:50.467216 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:28:50.467216 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:28:50.467216 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:28:50.467216 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:28:50.467216 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:50.467216 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:50.467216 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:50.467216 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:50.467216 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:50.467216 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:50.467216 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:50.467216 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:50.467216 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:50.467216 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:50.467216 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:50.467216 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:50.468067 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:50.468067 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:50.468067 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:50.468067 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:50.468067 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:28:50.468067 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:28:50.468067 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:28:50.468067 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:28:50.468067 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:28:50.468067 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:28:50.468067 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 02 21:28:50.468067 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:50.472448 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 489/971] 10.222.0.70 () {56 vars in 1120 bytes} [Tue Aug 2 21:28:50 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:50.473671 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ef4a65-7335-4db0-addc-65936d6c165e None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:50.580251 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ef4a65-7335-4db0-addc-65936d6c165e None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:50.593986 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:50.617272 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2b8fa4-03c4-45d1-9b42-2b98f924be3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:50.618058 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b8fa4-03c4-45d1-9b42-2b98f924be3f None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:50.618336 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b8fa4-03c4-45d1-9b42-2b98f924be3f None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:50.618609 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b8fa4-03c4-45d1-9b42-2b98f924be3f None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:50.619354 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2b8fa4-03c4-45d1-9b42-2b98f924be3f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:50.619659 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2b8fa4-03c4-45d1-9b42-2b98f924be3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:50.621044 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2b8fa4-03c4-45d1-9b42-2b98f924be3f None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:50.633474 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 483/972] 10.222.0.70 () {56 vars in 1115 bytes} [Tue Aug 2 21:28:50 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:50.635181 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc5f9e0-34d7-48d3-a3f1-5fa792edc673 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:50.640569 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:50.741953 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc5f9e0-34d7-48d3-a3f1-5fa792edc673 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:50.759162 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4435b71-d6fc-4e86-8190-cc42c9d95cd3 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:50.759474 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4435b71-d6fc-4e86-8190-cc42c9d95cd3 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:50.760289 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4435b71-d6fc-4e86-8190-cc42c9d95cd3 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:50.761796 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 484/973] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:28:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 21:28:50.766797 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3530ad-13fa-4985-a956-8e3e79f7d20b None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:50.767086 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3530ad-13fa-4985-a956-8e3e79f7d20b None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:50.767368 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3530ad-13fa-4985-a956-8e3e79f7d20b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:50.779416 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853ac49c-bc01-4cf2-a953-71838482e330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:50.780085 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853ac49c-bc01-4cf2-a953-71838482e330 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:50.780407 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853ac49c-bc01-4cf2-a953-71838482e330 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:50.780686 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853ac49c-bc01-4cf2-a953-71838482e330 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:50.786608 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-0d3530ad-13fa-4985-a956-8e3e79f7d20b None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:28:50.787812 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-0d3530ad-13fa-4985-a956-8e3e79f7d20b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:28:50.791368 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853ac49c-bc01-4cf2-a953-71838482e330 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:50.792852 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853ac49c-bc01-4cf2-a953-71838482e330 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:50.807474 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-853ac49c-bc01-4cf2-a953-71838482e330 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:50.807474 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:50.807474 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:50.807474 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:50.807474 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:50.807474 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:50.807474 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:50.807474 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:50.807474 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:50.807474 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:50.807474 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:50.807474 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:50.807474 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:28:50.807474 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:28:50.807474 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:28:50.808419 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:28:50.808419 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:50.808419 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:50.808419 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:50.808419 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:50.808419 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:50.808419 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:50.808419 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:50.808419 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:50.808419 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:50.808419 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:50.808419 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:50.808419 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:50.808419 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:50.808419 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:50.808419 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:50.808419 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:50.809356 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:28:50.809356 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:28:50.809356 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:50.809356 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:50.809356 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 490/974] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 2 21:28:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:50.814242 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853ac49c-bc01-4cf2-a953-71838482e330 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:50.864103 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 485/975] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:28:50 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 21:28:50.876910 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:50.887598 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3530ad-13fa-4985-a956-8e3e79f7d20b None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:50.926568 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853ac49c-bc01-4cf2-a953-71838482e330 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:50.964261 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdcb38f-ef30-43d3-b1a1-da741c6e753a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:50.964912 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdcb38f-ef30-43d3-b1a1-da741c6e753a None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:50.965172 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdcb38f-ef30-43d3-b1a1-da741c6e753a None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:50.965451 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdcb38f-ef30-43d3-b1a1-da741c6e753a None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:50.966263 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdcb38f-ef30-43d3-b1a1-da741c6e753a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:50.966591 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdcb38f-ef30-43d3-b1a1-da741c6e753a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:50.968064 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdcb38f-ef30-43d3-b1a1-da741c6e753a None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:50.985661 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 491/976] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 2 21:28:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:28:50.986482 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdcb38f-ef30-43d3-b1a1-da741c6e753a None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:50.988498 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3530ad-13fa-4985-a956-8e3e79f7d20b None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:50.990816 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:51.024048 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cdca11-4596-4ea4-860d-96ce22ceaf0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:51.024625 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cdca11-4596-4ea4-860d-96ce22ceaf0d None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:51.024910 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cdca11-4596-4ea4-860d-96ce22ceaf0d None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:51.025187 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cdca11-4596-4ea4-860d-96ce22ceaf0d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:51.026380 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cdca11-4596-4ea4-860d-96ce22ceaf0d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:51.027742 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cdca11-4596-4ea4-860d-96ce22ceaf0d None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:51.036869 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-a9cdca11-4596-4ea4-860d-96ce22ceaf0d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 02 21:28:51.036869 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:51.036869 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 21:28:51.036869 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 21:28:51.036869 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 21:28:51.036869 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 21:28:51.036869 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 21:28:51.036869 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 21:28:51.036869 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 02 21:28:51.036869 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:28:51.036869 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 21:28:51.036869 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:28:51.036869 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:51.036869 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:51.036869 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:51.036869 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:51.036869 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:51.038060 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:51.038060 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:51.038060 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:51.038060 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:51.038060 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:51.038060 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:51.038060 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 21:28:51.038060 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 21:28:51.038060 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 21:28:51.038060 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 21:28:51.038060 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:51.038060 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:51.038060 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:51.038060 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:51.038060 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:51.038060 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:51.039242 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:51.039242 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:51.039242 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:51.039242 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:51.039242 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:51.039242 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:51.039242 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:51.039242 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:51.039242 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:51.039242 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:51.039242 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 21:28:51.039242 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 21:28:51.039242 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 02 21:28:51.039242 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:28:51.039242 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 486/977] 10.222.0.70 () {56 vars in 1126 bytes} [Tue Aug 2 21:28:50 2022] GET /identity/v3/services/object-store => generated 93 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:51.043834 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cdca11-4596-4ea4-860d-96ce22ceaf0d None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:51.096333 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdcb38f-ef30-43d3-b1a1-da741c6e753a None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:51.115419 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:51.136037 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65618d1-8b42-491c-852b-a5db2103d656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:51.136708 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65618d1-8b42-491c-852b-a5db2103d656 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:51.136991 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65618d1-8b42-491c-852b-a5db2103d656 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:51.137508 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65618d1-8b42-491c-852b-a5db2103d656 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:51.144621 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65618d1-8b42-491c-852b-a5db2103d656 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:51.146064 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65618d1-8b42-491c-852b-a5db2103d656 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:51.146168 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cdca11-4596-4ea4-860d-96ce22ceaf0d None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:51.159234 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-f65618d1-8b42-491c-852b-a5db2103d656 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 02 21:28:51.159234 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:51.159234 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:51.159234 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:51.159234 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:51.159234 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:51.159234 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:51.159234 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:51.159234 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:51.159234 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:51.159234 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:51.159234 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:51.159234 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 21:28:51.159234 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 21:28:51.159234 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 21:28:51.159234 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 21:28:51.160225 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:51.160225 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:51.160225 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 21:28:51.160225 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:28:51.160225 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 21:28:51.160225 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:28:51.160225 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:51.160225 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:51.160225 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:51.160225 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:51.160225 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:51.160225 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:51.160225 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:51.160225 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:51.160225 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:51.160225 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:51.160225 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:51.160225 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:51.161281 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:51.161281 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:51.161281 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 21:28:51.161281 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 21:28:51.161281 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 21:28:51.161281 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 21:28:51.161281 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 21:28:51.161281 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 21:28:51.161281 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 02 21:28:51.161281 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:51.161281 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 492/978] 10.222.0.70 () {56 vars in 1117 bytes} [Tue Aug 2 21:28:50 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:51.166203 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65618d1-8b42-491c-852b-a5db2103d656 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:51.185221 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8deea85-42a8-4771-8c4c-641b3732539c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:51.185835 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8deea85-42a8-4771-8c4c-641b3732539c None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:51.186119 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8deea85-42a8-4771-8c4c-641b3732539c None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:51.186393 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8deea85-42a8-4771-8c4c-641b3732539c None admin] PATH_INFO: `/v3/services` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:51.187076 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8deea85-42a8-4771-8c4c-641b3732539c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:51.187388 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8deea85-42a8-4771-8c4c-641b3732539c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:51.188804 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8deea85-42a8-4771-8c4c-641b3732539c None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:51.199334 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 487/979] 10.222.0.70 () {56 vars in 1122 bytes} [Tue Aug 2 21:28:51 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:28:51.201042 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8deea85-42a8-4771-8c4c-641b3732539c None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:51.232418 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:51.286144 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65618d1-8b42-491c-852b-a5db2103d656 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:51.310452 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8deea85-42a8-4771-8c4c-641b3732539c None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:51.324837 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4bb768-f83a-40a9-99dc-c6b85e822e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:51.325479 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4bb768-f83a-40a9-99dc-c6b85e822e79 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:51.325755 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4bb768-f83a-40a9-99dc-c6b85e822e79 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:51.326035 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4bb768-f83a-40a9-99dc-c6b85e822e79 None admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:51.326839 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4bb768-f83a-40a9-99dc-c6b85e822e79 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:51.327152 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4bb768-f83a-40a9-99dc-c6b85e822e79 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:51.328621 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4bb768-f83a-40a9-99dc-c6b85e822e79 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:51.346704 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 493/980] 10.222.0.70 () {56 vars in 1149 bytes} [Tue Aug 2 21:28:51 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:28:51.348542 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03923bcc-a73c-4398-a71f-d115f7d2fede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:51.349416 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03923bcc-a73c-4398-a71f-d115f7d2fede None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:51.349890 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03923bcc-a73c-4398-a71f-d115f7d2fede None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:51.350370 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03923bcc-a73c-4398-a71f-d115f7d2fede None admin] PATH_INFO: `/v3/services` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:51.351269 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03923bcc-a73c-4398-a71f-d115f7d2fede None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:51.351892 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03923bcc-a73c-4398-a71f-d115f7d2fede None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:51.352330 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4bb768-f83a-40a9-99dc-c6b85e822e79 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:51.353783 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03923bcc-a73c-4398-a71f-d115f7d2fede None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:51.359512 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 488/981] 10.222.0.70 () {56 vars in 1122 bytes} [Tue Aug 2 21:28:51 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:51.365584 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03923bcc-a73c-4398-a71f-d115f7d2fede None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:51.391549 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:51.468370 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4bb768-f83a-40a9-99dc-c6b85e822e79 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:51.472553 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:51.479684 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03923bcc-a73c-4398-a71f-d115f7d2fede None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:51.508559 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafad67b-40f5-450e-8d73-876222e7193b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:51.509203 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafad67b-40f5-450e-8d73-876222e7193b None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:51.509478 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafad67b-40f5-450e-8d73-876222e7193b None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:51.509738 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafad67b-40f5-450e-8d73-876222e7193b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:51.517039 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52a5fef-04e2-4bc6-9a68-adc97b070b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:51.517651 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52a5fef-04e2-4bc6-9a68-adc97b070b9b None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:51.517937 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52a5fef-04e2-4bc6-9a68-adc97b070b9b None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:51.518214 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52a5fef-04e2-4bc6-9a68-adc97b070b9b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:51.518965 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52a5fef-04e2-4bc6-9a68-adc97b070b9b None admin] RBAC: Adding query filter params (interface=admin, service_id=ecd974892f6042af880440556e468df6, region_id=RegionOne) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:51.519272 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52a5fef-04e2-4bc6-9a68-adc97b070b9b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:51.520662 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52a5fef-04e2-4bc6-9a68-adc97b070b9b None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:51.525785 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 489/982] 10.222.0.70 () {56 vars in 1249 bytes} [Tue Aug 2 21:28:51 2022] GET /identity/v3/endpoints?service_id=ecd974892f6042af880440556e468df6&interface=admin®ion_id=RegionOne => generated 193 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:28:51.531198 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52a5fef-04e2-4bc6-9a68-adc97b070b9b None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:51.594408 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafad67b-40f5-450e-8d73-876222e7193b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:51.595787 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafad67b-40f5-450e-8d73-876222e7193b None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:51.632658 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:51.635878 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52a5fef-04e2-4bc6-9a68-adc97b070b9b None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:51.669943 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f99d1d7-850e-4727-8f80-fe1281b36c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:51.670567 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f99d1d7-850e-4727-8f80-fe1281b36c04 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:51.670854 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f99d1d7-850e-4727-8f80-fe1281b36c04 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:51.671131 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f99d1d7-850e-4727-8f80-fe1281b36c04 None admin] PATH_INFO: `/v3/services` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:51.671784 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f99d1d7-850e-4727-8f80-fe1281b36c04 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:51.673186 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f99d1d7-850e-4727-8f80-fe1281b36c04 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:51.686649 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 490/983] 10.222.0.70 () {56 vars in 1087 bytes} [Tue Aug 2 21:28:51 2022] GET /identity/v3/services => generated 1727 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 21:28:51.686649 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9fa30f-167c-4caf-af8c-814491d844ca None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:51.686649 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9fa30f-167c-4caf-af8c-814491d844ca None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:51.686649 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9fa30f-167c-4caf-af8c-814491d844ca None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:51.686649 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 491/984] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:28:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:28:51.691710 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0eb53b-2fcc-4f75-9a61-8d1e9796236c None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:51.691710 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0eb53b-2fcc-4f75-9a61-8d1e9796236c None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:51.691710 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0eb53b-2fcc-4f75-9a61-8d1e9796236c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:51.703000 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 494/985] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 2 21:28:51 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 21:28:51.708014 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-ba0eb53b-2fcc-4f75-9a61-8d1e9796236c None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:28:51.708861 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafad67b-40f5-450e-8d73-876222e7193b None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:51.709292 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-ba0eb53b-2fcc-4f75-9a61-8d1e9796236c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:28:51.731907 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:51.808257 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 492/986] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:28:51 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 21:28:51.820752 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafad67b-40f5-450e-8d73-876222e7193b None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:51.822118 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0eb53b-2fcc-4f75-9a61-8d1e9796236c None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:51.864163 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d975d88-b7f1-417f-b3cf-c2f53e8be99f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:51.864816 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d975d88-b7f1-417f-b3cf-c2f53e8be99f None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:51.865102 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d975d88-b7f1-417f-b3cf-c2f53e8be99f None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:51.865378 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d975d88-b7f1-417f-b3cf-c2f53e8be99f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:51.867610 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:51.878625 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d975d88-b7f1-417f-b3cf-c2f53e8be99f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:51.880192 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d975d88-b7f1-417f-b3cf-c2f53e8be99f None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:51.896001 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-9d975d88-b7f1-417f-b3cf-c2f53e8be99f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:51.896001 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:51.896001 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:51.896001 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:51.896001 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:51.896001 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:51.896001 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:51.896001 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:51.896001 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:51.896001 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:51.896001 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:51.896001 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:51.896001 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:28:51.896001 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:28:51.896001 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:28:51.897178 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:28:51.897178 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:51.897178 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:51.897178 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:51.897178 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:51.897178 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:51.897178 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:51.897178 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:51.897178 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:51.897178 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:51.897178 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:51.897178 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:51.897178 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:51.897178 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:51.897178 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:51.897178 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:51.897178 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:51.898646 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:28:51.898646 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:28:51.898646 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:51.898646 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:51.901037 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 495/987] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 2 21:28:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 21:28:51.904692 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d975d88-b7f1-417f-b3cf-c2f53e8be99f None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:51.931956 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0eb53b-2fcc-4f75-9a61-8d1e9796236c None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:51.969531 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942945d8-cdc0-471a-9502-d17d1a27f477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:51.970461 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942945d8-cdc0-471a-9502-d17d1a27f477 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:51.970748 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942945d8-cdc0-471a-9502-d17d1a27f477 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:51.971179 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942945d8-cdc0-471a-9502-d17d1a27f477 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:51.972124 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942945d8-cdc0-471a-9502-d17d1a27f477 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:51.973835 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942945d8-cdc0-471a-9502-d17d1a27f477 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:51.985712 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-942945d8-cdc0-471a-9502-d17d1a27f477 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 02 21:28:51.985712 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:51.985712 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 21:28:51.985712 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 21:28:51.985712 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 21:28:51.985712 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 21:28:51.985712 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 21:28:51.985712 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 21:28:51.985712 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 02 21:28:51.985712 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:28:51.985712 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 21:28:51.985712 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:28:51.985712 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:51.985712 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:51.985712 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:51.985712 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:51.985712 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:51.986762 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:51.986762 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:51.986762 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:51.986762 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:51.986762 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:51.986762 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:51.986762 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 21:28:51.986762 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 21:28:51.986762 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 21:28:51.986762 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 21:28:51.986762 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:51.986762 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:51.986762 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:51.986762 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:51.986762 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:51.986762 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:51.987614 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:51.987614 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:51.987614 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:51.987614 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:51.987614 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:51.987614 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:51.987614 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:51.987614 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:51.987614 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:51.987614 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:51.987614 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 21:28:51.987614 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 21:28:51.987614 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 02 21:28:51.987614 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:28:51.989460 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 493/988] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Aug 2 21:28:51 2022] GET /identity/v3/services/compute => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 21:28:51.992976 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942945d8-cdc0-471a-9502-d17d1a27f477 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:52.012859 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:52.017676 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d975d88-b7f1-417f-b3cf-c2f53e8be99f None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:52.054324 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d71f721-9714-494a-a0e1-c7a6e68d472b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:52.054948 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d71f721-9714-494a-a0e1-c7a6e68d472b None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:52.055230 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d71f721-9714-494a-a0e1-c7a6e68d472b None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:52.055509 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d71f721-9714-494a-a0e1-c7a6e68d472b None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:52.056346 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d71f721-9714-494a-a0e1-c7a6e68d472b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:52.056794 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d71f721-9714-494a-a0e1-c7a6e68d472b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:52.058199 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d71f721-9714-494a-a0e1-c7a6e68d472b None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:52.075516 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 496/989] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 2 21:28:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:28:52.076548 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d71f721-9714-494a-a0e1-c7a6e68d472b None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:52.101422 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942945d8-cdc0-471a-9502-d17d1a27f477 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:52.126416 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:52.136936 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b145c095-e7ef-413a-811d-d400bd7d6be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:52.137634 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b145c095-e7ef-413a-811d-d400bd7d6be1 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:52.137920 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b145c095-e7ef-413a-811d-d400bd7d6be1 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:52.138195 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b145c095-e7ef-413a-811d-d400bd7d6be1 None admin] PATH_INFO: `/v3/services` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:52.138869 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b145c095-e7ef-413a-811d-d400bd7d6be1 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:52.139172 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b145c095-e7ef-413a-811d-d400bd7d6be1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:52.140572 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b145c095-e7ef-413a-811d-d400bd7d6be1 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:52.147504 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 494/990] 10.222.0.70 () {56 vars in 1112 bytes} [Tue Aug 2 21:28:51 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:28:52.153645 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b145c095-e7ef-413a-811d-d400bd7d6be1 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:52.194778 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d71f721-9714-494a-a0e1-c7a6e68d472b None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:52.232626 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbec83dc-8241-4aef-ae02-e8a3326181b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:52.233274 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbec83dc-8241-4aef-ae02-e8a3326181b9 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:52.233729 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbec83dc-8241-4aef-ae02-e8a3326181b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:52.234004 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbec83dc-8241-4aef-ae02-e8a3326181b9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:52.239599 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:52.242079 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbec83dc-8241-4aef-ae02-e8a3326181b9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:52.243458 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbec83dc-8241-4aef-ae02-e8a3326181b9 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:52.254970 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-cbec83dc-8241-4aef-ae02-e8a3326181b9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:28:52.254970 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:52.254970 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:52.254970 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:52.254970 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:52.254970 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:52.254970 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:52.254970 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:52.254970 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:52.254970 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:52.254970 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:52.254970 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:52.254970 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 21:28:52.254970 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 21:28:52.254970 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 21:28:52.255859 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 21:28:52.255859 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:52.255859 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:52.255859 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:52.255859 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:52.255859 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:52.255859 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:52.255859 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:52.255859 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:52.255859 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:52.255859 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:52.255859 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:52.255859 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:52.255859 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:52.255859 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:52.255859 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:52.255859 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:52.256783 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 21:28:52.256783 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 21:28:52.256783 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 21:28:52.256783 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 21:28:52.256783 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 21:28:52.256783 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 21:28:52.256783 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:28:52.256783 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:52.256783 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 497/991] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Aug 2 21:28:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:52.262213 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbec83dc-8241-4aef-ae02-e8a3326181b9 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:52.264527 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b145c095-e7ef-413a-811d-d400bd7d6be1 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:52.306144 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d07d5b6-09d2-43d4-b8f0-bdac91193b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:52.306768 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d07d5b6-09d2-43d4-b8f0-bdac91193b3b None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:52.307053 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d07d5b6-09d2-43d4-b8f0-bdac91193b3b None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:52.307327 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d07d5b6-09d2-43d4-b8f0-bdac91193b3b None admin] PATH_INFO: `/v3/services` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:52.308002 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d07d5b6-09d2-43d4-b8f0-bdac91193b3b None admin] RBAC: Adding query filter params (type=compute) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:52.308338 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d07d5b6-09d2-43d4-b8f0-bdac91193b3b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:52.309705 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d07d5b6-09d2-43d4-b8f0-bdac91193b3b None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:52.319709 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 495/992] 10.222.0.70 () {56 vars in 1112 bytes} [Tue Aug 2 21:28:52 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:28:52.320741 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d07d5b6-09d2-43d4-b8f0-bdac91193b3b None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:52.379237 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbec83dc-8241-4aef-ae02-e8a3326181b9 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:52.388128 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:52.418011 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0097e9-079e-4709-890f-af13551534cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:52.418973 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0097e9-079e-4709-890f-af13551534cc None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:52.419248 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0097e9-079e-4709-890f-af13551534cc None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:52.419544 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0097e9-079e-4709-890f-af13551534cc None admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:52.420305 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0097e9-079e-4709-890f-af13551534cc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:52.420618 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0097e9-079e-4709-890f-af13551534cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:52.422043 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0097e9-079e-4709-890f-af13551534cc None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:52.428715 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d07d5b6-09d2-43d4-b8f0-bdac91193b3b None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:52.434405 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 498/993] 10.222.0.70 () {56 vars in 1148 bytes} [Tue Aug 2 21:28:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:28:52.440284 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0097e9-079e-4709-890f-af13551534cc None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:52.468571 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed75a587-3f7a-451f-a04d-af4bceeefe26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:52.469445 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed75a587-3f7a-451f-a04d-af4bceeefe26 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:52.469924 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed75a587-3f7a-451f-a04d-af4bceeefe26 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:52.470479 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed75a587-3f7a-451f-a04d-af4bceeefe26 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:52.471503 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed75a587-3f7a-451f-a04d-af4bceeefe26 None admin] RBAC: Adding query filter params (interface=public, service_id=680a17505f594c51ae0c617d08f042e9, region_id=RegionOne) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:52.471989 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed75a587-3f7a-451f-a04d-af4bceeefe26 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:52.473537 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed75a587-3f7a-451f-a04d-af4bceeefe26 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:52.479364 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 496/994] 10.222.0.70 () {56 vars in 1251 bytes} [Tue Aug 2 21:28:52 2022] GET /identity/v3/endpoints?service_id=680a17505f594c51ae0c617d08f042e9&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:52.484414 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed75a587-3f7a-451f-a04d-af4bceeefe26 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:52.497745 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:52.546844 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0097e9-079e-4709-890f-af13551534cc None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:52.583089 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b41519-fdea-4287-9e61-8aa2bc6fb7aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:52.583701 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b41519-fdea-4287-9e61-8aa2bc6fb7aa None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:52.583985 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b41519-fdea-4287-9e61-8aa2bc6fb7aa None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:52.584284 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b41519-fdea-4287-9e61-8aa2bc6fb7aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:52.585067 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b41519-fdea-4287-9e61-8aa2bc6fb7aa None admin] RBAC: Adding query filter params (role.id=13e24a71ee30450ab0dfa871704b0520, scope.project.id=42672e04d6ce4b0ab5f7eccfb0cc946c, user.id=6be7b2bcfebd45389ca289c34fbabc3e) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:52.585377 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b41519-fdea-4287-9e61-8aa2bc6fb7aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:52.586785 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b41519-fdea-4287-9e61-8aa2bc6fb7aa None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:52.587930 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed75a587-3f7a-451f-a04d-af4bceeefe26 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:52.592962 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 499/995] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Aug 2 21:28:52 2022] GET /identity/v3/role_assignments?user.id=6be7b2bcfebd45389ca289c34fbabc3e&scope.project.id=42672e04d6ce4b0ab5f7eccfb0cc946c&role.id=13e24a71ee30450ab0dfa871704b0520 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:28:52.623986 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680e2a7e-e962-4bcc-843f-15d0a959ca03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:52.624670 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680e2a7e-e962-4bcc-843f-15d0a959ca03 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:52.624956 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680e2a7e-e962-4bcc-843f-15d0a959ca03 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:52.625235 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680e2a7e-e962-4bcc-843f-15d0a959ca03 None admin] PATH_INFO: `/v3/services` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:52.625900 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680e2a7e-e962-4bcc-843f-15d0a959ca03 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:52.627308 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680e2a7e-e962-4bcc-843f-15d0a959ca03 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:52.640375 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 497/996] 10.222.0.70 () {56 vars in 1087 bytes} [Tue Aug 2 21:28:52 2022] GET /identity/v3/services => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 21:28:53.694992 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1797dd81-ff71-4725-8117-69015e49a976 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:53.695483 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1797dd81-ff71-4725-8117-69015e49a976 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:53.695483 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1797dd81-ff71-4725-8117-69015e49a976 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:53.697074 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 500/997] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:28:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:28:53.702024 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60f5470-0eae-4475-bfb5-e4bae3ac86c6 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:53.702432 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60f5470-0eae-4475-bfb5-e4bae3ac86c6 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:53.702605 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60f5470-0eae-4475-bfb5-e4bae3ac86c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:53.720537 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-e60f5470-0eae-4475-bfb5-e4bae3ac86c6 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:28:53.721721 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-e60f5470-0eae-4475-bfb5-e4bae3ac86c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:28:53.797988 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 498/998] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:28:53 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 21:28:53.819086 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1797dd81-ff71-4725-8117-69015e49a976 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:53.850194 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:53.923305 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1797dd81-ff71-4725-8117-69015e49a976 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:53.959251 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca21f96-c500-4142-a1ab-e91b9b1f0c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:53.959888 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca21f96-c500-4142-a1ab-e91b9b1f0c12 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:53.960163 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca21f96-c500-4142-a1ab-e91b9b1f0c12 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:53.960470 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca21f96-c500-4142-a1ab-e91b9b1f0c12 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:53.961091 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca21f96-c500-4142-a1ab-e91b9b1f0c12 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:53.962448 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca21f96-c500-4142-a1ab-e91b9b1f0c12 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:53.972082 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-9ca21f96-c500-4142-a1ab-e91b9b1f0c12 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 02 21:28:53.972082 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:53.972082 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 21:28:53.972082 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 21:28:53.972082 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 21:28:53.972082 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 21:28:53.972082 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 21:28:53.972082 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 21:28:53.972082 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 02 21:28:53.972082 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:53.972082 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 21:28:53.972082 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:53.972082 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:53.972082 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:53.972082 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:53.972082 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:53.972082 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:53.973225 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:53.973225 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:53.973225 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:53.973225 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:53.973225 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:53.973225 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:53.973225 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 21:28:53.973225 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 21:28:53.973225 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 21:28:53.973225 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 21:28:53.973225 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:53.973225 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:53.973225 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:53.973225 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:53.973225 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:53.973225 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:53.974079 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:53.974079 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:53.974079 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:53.974079 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:53.974079 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:53.974079 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:53.974079 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:53.974079 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:53.974079 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:53.974079 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:53.974079 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 21:28:53.974079 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 21:28:53.974079 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 02 21:28:53.974079 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:53.981541 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 501/999] 10.222.0.70 () {56 vars in 1126 bytes} [Tue Aug 2 21:28:53 2022] GET /identity/v3/services/object-store => generated 93 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:53.981671 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60f5470-0eae-4475-bfb5-e4bae3ac86c6 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:53.983072 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:54.079249 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60f5470-0eae-4475-bfb5-e4bae3ac86c6 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:54.112801 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1826639a-6c2b-4484-8ff3-3c71a8d6e0ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:54.113683 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1826639a-6c2b-4484-8ff3-3c71a8d6e0ce None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:54.113963 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1826639a-6c2b-4484-8ff3-3c71a8d6e0ce None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:54.114234 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1826639a-6c2b-4484-8ff3-3c71a8d6e0ce None admin] PATH_INFO: `/v3/services` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:54.114965 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1826639a-6c2b-4484-8ff3-3c71a8d6e0ce None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:54.115269 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1826639a-6c2b-4484-8ff3-3c71a8d6e0ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:54.116719 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1826639a-6c2b-4484-8ff3-3c71a8d6e0ce None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:54.126955 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 499/1000] 10.222.0.70 () {56 vars in 1122 bytes} [Tue Aug 2 21:28:53 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:54.127968 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca21f96-c500-4142-a1ab-e91b9b1f0c12 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:54.221630 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:54.229626 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca21f96-c500-4142-a1ab-e91b9b1f0c12 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:54.266629 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013abefb-ddce-47dd-af5c-e65ac20a6432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:54.267251 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013abefb-ddce-47dd-af5c-e65ac20a6432 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:54.267530 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013abefb-ddce-47dd-af5c-e65ac20a6432 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:54.267803 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013abefb-ddce-47dd-af5c-e65ac20a6432 None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:54.268508 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013abefb-ddce-47dd-af5c-e65ac20a6432 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:54.268811 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013abefb-ddce-47dd-af5c-e65ac20a6432 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:54.270243 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013abefb-ddce-47dd-af5c-e65ac20a6432 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:54.279841 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 502/1001] 10.222.0.70 () {56 vars in 1122 bytes} [Tue Aug 2 21:28:54 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:28:54.280987 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1826639a-6c2b-4484-8ff3-3c71a8d6e0ce None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:54.349071 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:54.384536 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1826639a-6c2b-4484-8ff3-3c71a8d6e0ce None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:54.419477 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c4b0cb-bdde-4149-a04d-cea38a88239a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:54.420092 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c4b0cb-bdde-4149-a04d-cea38a88239a None admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:54.420404 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c4b0cb-bdde-4149-a04d-cea38a88239a None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:54.420741 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c4b0cb-bdde-4149-a04d-cea38a88239a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:54.421464 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c4b0cb-bdde-4149-a04d-cea38a88239a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:54.422815 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c4b0cb-bdde-4149-a04d-cea38a88239a None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:54.439860 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 500/1002] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 2 21:28:54 2022] POST /identity/v3/endpoints => generated 325 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:28:54.651897 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16966f0e-857e-4d85-b79f-623ae900f34c None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:54.652089 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16966f0e-857e-4d85-b79f-623ae900f34c None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:54.652411 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16966f0e-857e-4d85-b79f-623ae900f34c None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:54.653917 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 503/1003] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:28:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:28:54.658966 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ee59b3-d8fe-4da8-a118-b8be2eeccdc7 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:54.659263 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ee59b3-d8fe-4da8-a118-b8be2eeccdc7 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:54.659548 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ee59b3-d8fe-4da8-a118-b8be2eeccdc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:54.678187 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-17ee59b3-d8fe-4da8-a118-b8be2eeccdc7 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:28:54.679256 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-17ee59b3-d8fe-4da8-a118-b8be2eeccdc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:28:54.679574 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3933b32-9f65-4b9a-aff3-6278d5133513 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:54.679865 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3933b32-9f65-4b9a-aff3-6278d5133513 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:54.680218 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3933b32-9f65-4b9a-aff3-6278d5133513 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:54.682202 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 504/1004] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:28:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:28:54.686884 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9025eb4-8902-4c5a-a3cd-181642e2b9b4 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:54.687175 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9025eb4-8902-4c5a-a3cd-181642e2b9b4 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:54.687456 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9025eb4-8902-4c5a-a3cd-181642e2b9b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:54.705618 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-f9025eb4-8902-4c5a-a3cd-181642e2b9b4 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:28:54.706807 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-f9025eb4-8902-4c5a-a3cd-181642e2b9b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:28:54.758509 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 501/1005] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:28:54 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 21:28:54.780555 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ee59b3-d8fe-4da8-a118-b8be2eeccdc7 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:54.781705 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 505/1006] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:28:54 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 21:28:54.804401 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9025eb4-8902-4c5a-a3cd-181642e2b9b4 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:54.841080 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:54.889255 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ee59b3-d8fe-4da8-a118-b8be2eeccdc7 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:54.898251 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:54.912433 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9025eb4-8902-4c5a-a3cd-181642e2b9b4 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:54.927690 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6dfde0-6f89-4fcf-8423-77f6edb62075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:54.928382 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6dfde0-6f89-4fcf-8423-77f6edb62075 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:54.928668 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6dfde0-6f89-4fcf-8423-77f6edb62075 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:54.928944 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6dfde0-6f89-4fcf-8423-77f6edb62075 None admin] PATH_INFO: `/v3/services/image` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:54.929584 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6dfde0-6f89-4fcf-8423-77f6edb62075 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:54.930954 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6dfde0-6f89-4fcf-8423-77f6edb62075 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:54.939975 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-9c6dfde0-6f89-4fcf-8423-77f6edb62075 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 02 21:28:54.939975 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:54.939975 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 21:28:54.939975 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 21:28:54.939975 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 21:28:54.939975 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 21:28:54.939975 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 21:28:54.939975 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 21:28:54.939975 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 02 21:28:54.939975 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:28:54.939975 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 21:28:54.939975 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:28:54.939975 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:54.939975 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:54.939975 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:54.939975 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:54.939975 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:54.941151 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:54.941151 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:54.941151 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:54.941151 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:54.941151 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:54.941151 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:54.941151 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 21:28:54.941151 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 21:28:54.941151 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 21:28:54.941151 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 21:28:54.941151 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:54.941151 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:54.941151 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:54.941151 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:54.941151 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:54.941151 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:54.942007 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:54.942007 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:54.942007 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:54.942007 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:54.942007 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:54.942007 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:54.942007 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:54.942007 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:54.942007 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:54.942007 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:54.942007 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 21:28:54.942007 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 21:28:54.942007 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 02 21:28:54.942007 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:28:54.942007 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 502/1007] 10.222.0.70 () {56 vars in 1105 bytes} [Tue Aug 2 21:28:54 2022] GET /identity/v3/services/image => generated 86 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 21:28:54.948834 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6dfde0-6f89-4fcf-8423-77f6edb62075 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:54.954787 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fc6acd-90e7-43b7-a25e-877443e98e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:54.955440 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fc6acd-90e7-43b7-a25e-877443e98e0b None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:54.955725 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fc6acd-90e7-43b7-a25e-877443e98e0b None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:54.956003 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fc6acd-90e7-43b7-a25e-877443e98e0b None admin] PATH_INFO: `/v3/services/compute` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:54.956677 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fc6acd-90e7-43b7-a25e-877443e98e0b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:54.958123 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fc6acd-90e7-43b7-a25e-877443e98e0b None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:54.967903 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-93fc6acd-90e7-43b7-a25e-877443e98e0b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 02 21:28:54.967903 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:54.967903 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 21:28:54.967903 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 21:28:54.967903 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 21:28:54.967903 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 21:28:54.967903 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 21:28:54.967903 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 21:28:54.967903 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 02 21:28:54.967903 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:54.967903 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 21:28:54.967903 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:54.967903 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:54.967903 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:54.967903 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:54.967903 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:54.967903 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:54.969231 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:54.969231 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:54.969231 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:54.969231 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:54.969231 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:54.969231 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:54.969231 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 21:28:54.969231 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 21:28:54.969231 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 21:28:54.969231 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 21:28:54.969231 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:54.969231 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:54.969231 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:54.969231 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:54.969231 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:54.969231 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:54.970124 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:54.970124 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:54.970124 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:54.970124 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:54.970124 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:54.970124 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:54.970124 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:54.970124 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:54.970124 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:54.970124 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:54.970124 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 21:28:54.970124 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 21:28:54.970124 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 02 21:28:54.970124 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:54.970124 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 506/1008] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Aug 2 21:28:54 2022] GET /identity/v3/services/compute => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 21:28:54.974889 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fc6acd-90e7-43b7-a25e-877443e98e0b None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:55.059331 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6dfde0-6f89-4fcf-8423-77f6edb62075 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:55.078554 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:55.082024 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fc6acd-90e7-43b7-a25e-877443e98e0b None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:55.097955 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ef915f-7384-4a55-b9ef-ed013eb4eaa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:55.098571 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ef915f-7384-4a55-b9ef-ed013eb4eaa9 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:55.098858 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ef915f-7384-4a55-b9ef-ed013eb4eaa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:55.099143 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ef915f-7384-4a55-b9ef-ed013eb4eaa9 None admin] PATH_INFO: `/v3/services` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:55.099819 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ef915f-7384-4a55-b9ef-ed013eb4eaa9 None admin] RBAC: Adding query filter params (name=image) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:55.100130 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ef915f-7384-4a55-b9ef-ed013eb4eaa9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:55.101562 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ef915f-7384-4a55-b9ef-ed013eb4eaa9 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:55.107319 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 503/1009] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 2 21:28:54 2022] GET /identity/v3/services?name=image => generated 122 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:55.113040 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ef915f-7384-4a55-b9ef-ed013eb4eaa9 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:55.120403 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e395c9-d738-4978-9175-ef33f3d74dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:55.121027 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e395c9-d738-4978-9175-ef33f3d74dca None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:55.121310 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e395c9-d738-4978-9175-ef33f3d74dca None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:55.121588 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e395c9-d738-4978-9175-ef33f3d74dca None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:55.122266 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e395c9-d738-4978-9175-ef33f3d74dca None admin] RBAC: Adding query filter params (name=compute) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:55.122572 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e395c9-d738-4978-9175-ef33f3d74dca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:55.123945 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e395c9-d738-4978-9175-ef33f3d74dca None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:55.129293 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 507/1010] 10.222.0.70 () {56 vars in 1112 bytes} [Tue Aug 2 21:28:54 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:28:55.134839 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e395c9-d738-4978-9175-ef33f3d74dca None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:55.155019 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:55.224437 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ef915f-7384-4a55-b9ef-ed013eb4eaa9 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:55.248984 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e395c9-d738-4978-9175-ef33f3d74dca None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:55.261254 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a180eb-b87c-4a72-81f7-ea6c9ae39ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:55.261827 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a180eb-b87c-4a72-81f7-ea6c9ae39ca2 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:55.262172 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a180eb-b87c-4a72-81f7-ea6c9ae39ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:55.262457 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a180eb-b87c-4a72-81f7-ea6c9ae39ca2 None admin] PATH_INFO: `/v3/services` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:55.263136 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a180eb-b87c-4a72-81f7-ea6c9ae39ca2 None admin] RBAC: Adding query filter params (type=image) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:55.263451 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a180eb-b87c-4a72-81f7-ea6c9ae39ca2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:55.264858 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a180eb-b87c-4a72-81f7-ea6c9ae39ca2 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:55.269709 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 504/1011] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 2 21:28:55 2022] GET /identity/v3/services?type=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:28:55.296067 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d159ade-bb6c-4976-addc-a492daeac15d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:55.296848 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d159ade-bb6c-4976-addc-a492daeac15d None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:55.297199 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d159ade-bb6c-4976-addc-a492daeac15d None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:55.297546 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d159ade-bb6c-4976-addc-a492daeac15d None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:55.298350 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d159ade-bb6c-4976-addc-a492daeac15d None admin] RBAC: Adding query filter params (type=compute) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:55.298720 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d159ade-bb6c-4976-addc-a492daeac15d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:55.300200 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d159ade-bb6c-4976-addc-a492daeac15d None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:55.306337 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 508/1012] 10.222.0.70 () {56 vars in 1112 bytes} [Tue Aug 2 21:28:55 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:28:55.311960 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a180eb-b87c-4a72-81f7-ea6c9ae39ca2 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:55.365278 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:55.424224 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a180eb-b87c-4a72-81f7-ea6c9ae39ca2 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:55.461787 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0a22e5-7072-459d-aff5-8463946bb058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:55.462404 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0a22e5-7072-459d-aff5-8463946bb058 None admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:55.462681 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0a22e5-7072-459d-aff5-8463946bb058 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:55.463684 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0a22e5-7072-459d-aff5-8463946bb058 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:55.464430 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0a22e5-7072-459d-aff5-8463946bb058 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:55.466013 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0a22e5-7072-459d-aff5-8463946bb058 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:55.488120 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 505/1013] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 2 21:28:55 2022] POST /identity/v3/endpoints => generated 334 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:28:56.485536 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c15a46-9bf9-4a01-b87d-43199bf97c63 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:56.486048 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c15a46-9bf9-4a01-b87d-43199bf97c63 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:56.486167 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c15a46-9bf9-4a01-b87d-43199bf97c63 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:56.487474 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 509/1014] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:28:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:28:56.492792 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd937986-1a31-4992-8407-f495011eb8a2 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:56.493171 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd937986-1a31-4992-8407-f495011eb8a2 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:56.493340 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd937986-1a31-4992-8407-f495011eb8a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:56.512526 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-dd937986-1a31-4992-8407-f495011eb8a2 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:28:56.513707 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-dd937986-1a31-4992-8407-f495011eb8a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:28:56.587646 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 506/1015] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:28:56 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 21:28:56.609754 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c15a46-9bf9-4a01-b87d-43199bf97c63 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:56.700588 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:56.721558 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c15a46-9bf9-4a01-b87d-43199bf97c63 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:56.755797 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130cf7ba-8c2e-43c1-b4de-da9908274792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:56.756458 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130cf7ba-8c2e-43c1-b4de-da9908274792 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:56.756743 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130cf7ba-8c2e-43c1-b4de-da9908274792 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:56.757019 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130cf7ba-8c2e-43c1-b4de-da9908274792 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:56.758198 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130cf7ba-8c2e-43c1-b4de-da9908274792 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:56.759624 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130cf7ba-8c2e-43c1-b4de-da9908274792 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:56.761445 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 510/1016] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 2 21:28:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:56.766970 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd937986-1a31-4992-8407-f495011eb8a2 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:56.794655 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:56.869188 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd937986-1a31-4992-8407-f495011eb8a2 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:56.904211 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879ba806-3f12-4be9-9b13-21c4298df1f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:56.904854 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879ba806-3f12-4be9-9b13-21c4298df1f5 None admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:56.905141 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879ba806-3f12-4be9-9b13-21c4298df1f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:56.905418 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879ba806-3f12-4be9-9b13-21c4298df1f5 None admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:56.906110 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879ba806-3f12-4be9-9b13-21c4298df1f5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:56.907544 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879ba806-3f12-4be9-9b13-21c4298df1f5 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:56.935101 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 507/1017] 10.222.0.70 () {60 vars in 1141 bytes} [Tue Aug 2 21:28:56 2022] POST /identity/v3/projects => generated 311 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:28:57.314569 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4037d1c0-d4ae-42aa-a83e-ced7ec8d2950 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:57.314882 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4037d1c0-d4ae-42aa-a83e-ced7ec8d2950 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:57.315131 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4037d1c0-d4ae-42aa-a83e-ced7ec8d2950 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:57.316682 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 511/1018] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:28:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:28:57.321843 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51deed96-61b5-4874-adb6-1931e5e30dc5 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:57.322197 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51deed96-61b5-4874-adb6-1931e5e30dc5 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:57.322981 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51deed96-61b5-4874-adb6-1931e5e30dc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:57.341259 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-51deed96-61b5-4874-adb6-1931e5e30dc5 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:28:57.342450 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-51deed96-61b5-4874-adb6-1931e5e30dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:28:57.410622 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 508/1019] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:28:57 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 21:28:57.433438 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4037d1c0-d4ae-42aa-a83e-ced7ec8d2950 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:57.537820 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4037d1c0-d4ae-42aa-a83e-ced7ec8d2950 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:57.572214 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d720357-0383-4f04-8f80-7f5f1c955c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:57.572765 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d720357-0383-4f04-8f80-7f5f1c955c52 None admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:57.573044 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d720357-0383-4f04-8f80-7f5f1c955c52 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:57.573313 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d720357-0383-4f04-8f80-7f5f1c955c52 None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:57.574006 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d720357-0383-4f04-8f80-7f5f1c955c52 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:57.575372 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d720357-0383-4f04-8f80-7f5f1c955c52 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:57.583824 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3952b0e8-af3d-4501-8bfe-635a662103ff None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:57.584450 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3952b0e8-af3d-4501-8bfe-635a662103ff None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:57.584616 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3952b0e8-af3d-4501-8bfe-635a662103ff None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:57.586437 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 509/1020] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:28:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:28:57.591175 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db31b3b2-8caf-4ff4-a867-ceaccfdd54f1 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:57.591472 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db31b3b2-8caf-4ff4-a867-ceaccfdd54f1 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:57.591730 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db31b3b2-8caf-4ff4-a867-ceaccfdd54f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:57.600601 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 512/1021] 10.222.0.70 () {60 vars in 1141 bytes} [Tue Aug 2 21:28:57 2022] POST /identity/v3/services => generated 242 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:28:57.618367 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-db31b3b2-8caf-4ff4-a867-ceaccfdd54f1 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:28:57.620176 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-db31b3b2-8caf-4ff4-a867-ceaccfdd54f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:28:57.623546 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:57.705275 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 510/1022] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:28:57 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 21:28:57.728137 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d720357-0383-4f04-8f80-7f5f1c955c52 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:57.741235 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:57.842365 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d720357-0383-4f04-8f80-7f5f1c955c52 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:57.876198 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81d4ae1-5254-432d-88b6-8209163dab71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:57.876860 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81d4ae1-5254-432d-88b6-8209163dab71 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:57.877137 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81d4ae1-5254-432d-88b6-8209163dab71 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:57.877410 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81d4ae1-5254-432d-88b6-8209163dab71 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:57.887472 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81d4ae1-5254-432d-88b6-8209163dab71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:28:57.892750 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-b81d4ae1-5254-432d-88b6-8209163dab71 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 02 21:28:57.892750 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:57.892750 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:57.892750 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:57.892750 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:57.892750 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:57.892750 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:57.892750 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:57.892750 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:57.892750 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:57.892750 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:57.892750 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:57.892750 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:28:57.892750 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:28:57.892750 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:28:57.892750 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:28:57.893954 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:28:57.893954 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:28:57.893954 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:28:57.893954 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:28:57.893954 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:57.893954 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:57.893954 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:57.893954 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:57.893954 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:57.893954 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:57.893954 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:57.893954 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:57.893954 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:57.893954 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:57.893954 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:57.893954 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:57.894982 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:57.894982 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:57.894982 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:57.894982 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:57.894982 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:28:57.894982 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:28:57.894982 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:28:57.894982 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:28:57.894982 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:28:57.894982 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:28:57.894982 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 02 21:28:57.894982 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:57.894982 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 513/1023] 10.222.0.70 () {56 vars in 1120 bytes} [Tue Aug 2 21:28:57 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:57.899972 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db31b3b2-8caf-4ff4-a867-ceaccfdd54f1 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:58.000067 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db31b3b2-8caf-4ff4-a867-ceaccfdd54f1 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:58.033602 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa14480b-f4ea-4448-9f0c-6add1edd166e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:58.034220 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa14480b-f4ea-4448-9f0c-6add1edd166e None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:58.034498 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa14480b-f4ea-4448-9f0c-6add1edd166e None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:58.034769 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa14480b-f4ea-4448-9f0c-6add1edd166e None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:58.035485 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa14480b-f4ea-4448-9f0c-6add1edd166e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:58.035782 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa14480b-f4ea-4448-9f0c-6add1edd166e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:58.037172 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa14480b-f4ea-4448-9f0c-6add1edd166e None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:58.039387 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:58.051684 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 511/1024] 10.222.0.70 () {56 vars in 1115 bytes} [Tue Aug 2 21:28:57 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:58.053040 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81d4ae1-5254-432d-88b6-8209163dab71 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:58.123618 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:58.161183 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81d4ae1-5254-432d-88b6-8209163dab71 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:58.196536 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0973c9d9-5d69-4ad5-8639-bc75c4dcd564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:58.197712 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0973c9d9-5d69-4ad5-8639-bc75c4dcd564 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:58.197996 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0973c9d9-5d69-4ad5-8639-bc75c4dcd564 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:58.198272 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0973c9d9-5d69-4ad5-8639-bc75c4dcd564 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:58.208938 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0973c9d9-5d69-4ad5-8639-bc75c4dcd564 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:58.210395 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0973c9d9-5d69-4ad5-8639-bc75c4dcd564 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:58.224979 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-0973c9d9-5d69-4ad5-8639-bc75c4dcd564 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:58.224979 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:58.224979 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:58.224979 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:58.224979 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:58.224979 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:58.224979 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:58.224979 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:58.224979 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:58.224979 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:58.224979 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:58.224979 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:58.224979 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:28:58.224979 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:28:58.224979 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:28:58.225855 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:28:58.225855 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:58.225855 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:58.225855 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:58.225855 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:58.225855 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:58.225855 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:58.225855 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:58.225855 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:58.225855 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:58.225855 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:58.225855 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:58.225855 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:58.225855 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:58.225855 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:58.225855 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:58.225855 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:58.226746 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:28:58.226746 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:28:58.226746 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:58.226746 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:58.228668 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 514/1025] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 2 21:28:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:58.231906 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa14480b-f4ea-4448-9f0c-6add1edd166e None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:58.343926 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa14480b-f4ea-4448-9f0c-6add1edd166e None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:58.378861 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea7bc88-6e0f-4131-ad2d-3a9ba1034855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:58.379415 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea7bc88-6e0f-4131-ad2d-3a9ba1034855 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:58.379703 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea7bc88-6e0f-4131-ad2d-3a9ba1034855 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:58.379983 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea7bc88-6e0f-4131-ad2d-3a9ba1034855 None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:58.380702 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea7bc88-6e0f-4131-ad2d-3a9ba1034855 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:58.381015 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea7bc88-6e0f-4131-ad2d-3a9ba1034855 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:58.382382 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea7bc88-6e0f-4131-ad2d-3a9ba1034855 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:58.399388 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 512/1026] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 2 21:28:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:28:58.401030 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0973c9d9-5d69-4ad5-8639-bc75c4dcd564 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:58.506354 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0973c9d9-5d69-4ad5-8639-bc75c4dcd564 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:58.527721 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:58.543032 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d138e1ef-edec-42f1-9333-8071f56c48b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:58.543731 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d138e1ef-edec-42f1-9333-8071f56c48b6 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:58.543962 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d138e1ef-edec-42f1-9333-8071f56c48b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:58.544261 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d138e1ef-edec-42f1-9333-8071f56c48b6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:58.552031 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d138e1ef-edec-42f1-9333-8071f56c48b6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:58.553512 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d138e1ef-edec-42f1-9333-8071f56c48b6 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:58.565451 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-d138e1ef-edec-42f1-9333-8071f56c48b6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 02 21:28:58.565451 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:58.565451 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:58.565451 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:58.565451 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:58.565451 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:58.565451 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:58.565451 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:58.565451 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:58.565451 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:58.565451 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:58.565451 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:58.565451 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 21:28:58.565451 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 21:28:58.565451 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 21:28:58.565451 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 21:28:58.566398 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:58.566398 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:58.566398 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 21:28:58.566398 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:28:58.566398 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 21:28:58.566398 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:28:58.566398 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:58.566398 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:58.566398 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:58.566398 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:58.566398 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:58.566398 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:58.566398 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:58.566398 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:58.566398 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:58.566398 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:58.566398 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:58.566398 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:58.567390 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:58.567390 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:58.567390 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 21:28:58.567390 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 21:28:58.567390 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 21:28:58.567390 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 21:28:58.567390 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 21:28:58.567390 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 21:28:58.567390 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 02 21:28:58.567390 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:58.567390 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 515/1027] 10.222.0.70 () {56 vars in 1093 bytes} [Tue Aug 2 21:28:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 21:28:58.575042 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea7bc88-6e0f-4131-ad2d-3a9ba1034855 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:58.636882 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:58.682732 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea7bc88-6e0f-4131-ad2d-3a9ba1034855 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:58.720729 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c700f5-40d3-4254-958a-8326f211ccd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:58.721356 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c700f5-40d3-4254-958a-8326f211ccd5 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:58.721641 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c700f5-40d3-4254-958a-8326f211ccd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:58.721919 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c700f5-40d3-4254-958a-8326f211ccd5 None admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:58.722716 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c700f5-40d3-4254-958a-8326f211ccd5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:58.723028 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c700f5-40d3-4254-958a-8326f211ccd5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:58.724489 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c700f5-40d3-4254-958a-8326f211ccd5 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:58.745729 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 513/1028] 10.222.0.70 () {56 vars in 1133 bytes} [Tue Aug 2 21:28:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:28:58.751200 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d138e1ef-edec-42f1-9333-8071f56c48b6 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:58.855171 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d138e1ef-edec-42f1-9333-8071f56c48b6 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:58.890193 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1763b1a9-cdba-4910-a066-f4c6491e8124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:58.890745 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1763b1a9-cdba-4910-a066-f4c6491e8124 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:58.891032 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1763b1a9-cdba-4910-a066-f4c6491e8124 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:58.891310 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1763b1a9-cdba-4910-a066-f4c6491e8124 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:58.940523 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:58.961007 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1763b1a9-cdba-4910-a066-f4c6491e8124 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:58.962506 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1763b1a9-cdba-4910-a066-f4c6491e8124 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:59.025409 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a96ab-cc4b-4e8b-8bbd-b78a243dd87d None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:59.025750 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a96ab-cc4b-4e8b-8bbd-b78a243dd87d None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:59.026004 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253a96ab-cc4b-4e8b-8bbd-b78a243dd87d None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:59.027638 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 514/1029] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:28:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 21:28:59.033037 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5be328-6c09-4401-98fa-5421ff0fb6c9 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:59.033326 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5be328-6c09-4401-98fa-5421ff0fb6c9 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:59.033603 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5be328-6c09-4401-98fa-5421ff0fb6c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:59.052201 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-3c5be328-6c09-4401-98fa-5421ff0fb6c9 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:28:59.053734 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-3c5be328-6c09-4401-98fa-5421ff0fb6c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:28:59.067146 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 516/1030] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 2 21:28:58 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 21:28:59.072782 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1763b1a9-cdba-4910-a066-f4c6491e8124 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:59.127979 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 515/1031] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:28:59 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 21:28:59.152206 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5be328-6c09-4401-98fa-5421ff0fb6c9 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:59.158031 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:59.181309 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1763b1a9-cdba-4910-a066-f4c6491e8124 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:59.205056 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:59.219204 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec69122-bf60-44be-b953-edb1860e4842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:59.219850 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec69122-bf60-44be-b953-edb1860e4842 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:59.220133 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec69122-bf60-44be-b953-edb1860e4842 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:59.220446 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec69122-bf60-44be-b953-edb1860e4842 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:59.230688 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec69122-bf60-44be-b953-edb1860e4842 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:59.232139 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec69122-bf60-44be-b953-edb1860e4842 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:59.248591 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-1ec69122-bf60-44be-b953-edb1860e4842 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:59.248591 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:59.248591 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:59.248591 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:59.248591 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:59.248591 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:59.248591 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:59.248591 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:59.248591 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:59.248591 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:59.248591 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:59.248591 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:59.248591 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:28:59.248591 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:28:59.248591 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:28:59.249546 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:28:59.249546 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:59.249546 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:59.249546 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:59.249546 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:59.249546 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:59.249546 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:59.249546 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:59.249546 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:59.249546 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:59.249546 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:59.249546 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:59.249546 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:59.249546 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:59.249546 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:59.249546 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:59.249546 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:59.250438 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:28:59.250438 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:28:59.250438 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:28:59.250438 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:59.250438 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 517/1032] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 2 21:28:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 21:28:59.255273 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec69122-bf60-44be-b953-edb1860e4842 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:59.270000 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5be328-6c09-4401-98fa-5421ff0fb6c9 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:59.306331 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6932e58e-3acb-4947-8fc0-414053a4d9f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:59.307526 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6932e58e-3acb-4947-8fc0-414053a4d9f2 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:59.307813 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6932e58e-3acb-4947-8fc0-414053a4d9f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:59.308092 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6932e58e-3acb-4947-8fc0-414053a4d9f2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:59.309280 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6932e58e-3acb-4947-8fc0-414053a4d9f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:59.310725 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6932e58e-3acb-4947-8fc0-414053a4d9f2 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:59.312523 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 516/1033] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 2 21:28:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:59.318193 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6932e58e-3acb-4947-8fc0-414053a4d9f2 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:59.373051 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec69122-bf60-44be-b953-edb1860e4842 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:59.406159 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:59.419174 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5992a2-bc0a-41dc-b947-d52b2eb88f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:59.419397 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5992a2-bc0a-41dc-b947-d52b2eb88f72 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:59.419599 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5992a2-bc0a-41dc-b947-d52b2eb88f72 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:59.419896 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5992a2-bc0a-41dc-b947-d52b2eb88f72 None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:59.420596 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5992a2-bc0a-41dc-b947-d52b2eb88f72 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:59.420911 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5992a2-bc0a-41dc-b947-d52b2eb88f72 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:59.422287 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5992a2-bc0a-41dc-b947-d52b2eb88f72 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:59.432856 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6932e58e-3acb-4947-8fc0-414053a4d9f2 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:59.435514 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 518/1034] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 2 21:28:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:28:59.440951 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5992a2-bc0a-41dc-b947-d52b2eb88f72 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:59.450138 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:59.474212 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9bcd5f-8076-4661-9c39-339f3001f01f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:59.475345 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9bcd5f-8076-4661-9c39-339f3001f01f None admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:59.475704 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9bcd5f-8076-4661-9c39-339f3001f01f None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:59.476041 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9bcd5f-8076-4661-9c39-339f3001f01f None admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:59.476830 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9bcd5f-8076-4661-9c39-339f3001f01f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:59.478365 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9bcd5f-8076-4661-9c39-339f3001f01f None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:59.508261 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 517/1035] 10.222.0.70 () {60 vars in 1132 bytes} [Tue Aug 2 21:28:59 2022] POST /identity/v3/users => generated 285 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 21:28:59.569502 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5992a2-bc0a-41dc-b947-d52b2eb88f72 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:59.609067 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfb077a-8df4-4b07-aed1-086828c90ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:59.609732 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfb077a-8df4-4b07-aed1-086828c90ab5 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:59.610014 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfb077a-8df4-4b07-aed1-086828c90ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:59.610289 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfb077a-8df4-4b07-aed1-086828c90ab5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:59.618219 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfb077a-8df4-4b07-aed1-086828c90ab5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:59.619729 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfb077a-8df4-4b07-aed1-086828c90ab5 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:59.632055 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-6bfb077a-8df4-4b07-aed1-086828c90ab5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:28:59.632055 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:59.632055 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:59.632055 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:59.632055 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:59.632055 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:59.632055 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:59.632055 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:59.632055 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:59.632055 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:59.632055 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:59.632055 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:59.632055 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 21:28:59.632055 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 21:28:59.632055 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 21:28:59.633215 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 21:28:59.633215 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:59.633215 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:59.633215 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:59.633215 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:59.633215 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:59.633215 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:59.633215 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:59.633215 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:59.633215 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:59.633215 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:59.633215 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:59.633215 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:59.633215 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:59.633215 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:59.633215 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:59.633215 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:59.639013 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 21:28:59.639013 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 21:28:59.639013 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 21:28:59.639013 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 21:28:59.639013 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 21:28:59.639013 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 21:28:59.639013 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:28:59.639013 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:59.639013 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 519/1036] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Aug 2 21:28:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 21:28:59.639512 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9bcd5f-8076-4661-9c39-339f3001f01f None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:59.642601 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4602246c-e41c-4fd3-8145-d9162a3f05d3 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:59.642893 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4602246c-e41c-4fd3-8145-d9162a3f05d3 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:59.643171 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4602246c-e41c-4fd3-8145-d9162a3f05d3 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:59.644608 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 520/1037] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:28:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 21:28:59.649960 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18142a36-254e-4ad7-8579-9df256865869 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:59.650785 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18142a36-254e-4ad7-8579-9df256865869 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:59.651061 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18142a36-254e-4ad7-8579-9df256865869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:59.669805 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-18142a36-254e-4ad7-8579-9df256865869 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:28:59.670949 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-18142a36-254e-4ad7-8579-9df256865869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:28:59.735657 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:59.758891 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 521/1038] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:28:59 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 21:28:59.773046 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9bcd5f-8076-4661-9c39-339f3001f01f None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:59.784715 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18142a36-254e-4ad7-8579-9df256865869 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:59.810945 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf3b796-dc43-410e-9d2b-b65490a49e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:59.811571 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf3b796-dc43-410e-9d2b-b65490a49e9f None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:59.812102 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf3b796-dc43-410e-9d2b-b65490a49e9f None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:59.812102 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf3b796-dc43-410e-9d2b-b65490a49e9f None admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:59.812887 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf3b796-dc43-410e-9d2b-b65490a49e9f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:59.813191 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf3b796-dc43-410e-9d2b-b65490a49e9f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:59.814634 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf3b796-dc43-410e-9d2b-b65490a49e9f None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:59.827591 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 518/1039] 10.222.0.70 () {56 vars in 1148 bytes} [Tue Aug 2 21:28:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:28:59.833722 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf3b796-dc43-410e-9d2b-b65490a49e9f None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:59.865622 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:28:59.889728 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18142a36-254e-4ad7-8579-9df256865869 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:59.927274 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c4ea75-84d7-436d-a633-e45dd1e2dfac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:59.928008 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c4ea75-84d7-436d-a633-e45dd1e2dfac None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:59.928328 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c4ea75-84d7-436d-a633-e45dd1e2dfac None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:59.928902 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c4ea75-84d7-436d-a633-e45dd1e2dfac None admin] PATH_INFO: `/v3/services/image` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:59.929569 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c4ea75-84d7-436d-a633-e45dd1e2dfac None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:59.930975 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c4ea75-84d7-436d-a633-e45dd1e2dfac None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:28:59.943231 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-a9c4ea75-84d7-436d-a633-e45dd1e2dfac None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 02 21:28:59.943231 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:59.943231 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 21:28:59.943231 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 21:28:59.943231 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 21:28:59.943231 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 21:28:59.943231 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 21:28:59.943231 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 21:28:59.943231 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 02 21:28:59.943231 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:59.943231 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 21:28:59.943231 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:59.943231 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:28:59.943231 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:28:59.943231 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:28:59.943231 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:28:59.943231 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:28:59.944254 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:28:59.944254 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:28:59.944254 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:28:59.944254 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:28:59.944254 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:28:59.944254 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:28:59.944254 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 21:28:59.944254 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 21:28:59.944254 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 21:28:59.944254 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 21:28:59.944254 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:28:59.944254 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:28:59.944254 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:28:59.944254 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:28:59.944254 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:28:59.944254 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:28:59.945434 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:28:59.945434 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:28:59.945434 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:28:59.945434 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:28:59.945434 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:28:59.945434 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:28:59.945434 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:28:59.945434 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:28:59.945434 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:28:59.945434 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:28:59.945434 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 21:28:59.945434 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 21:28:59.945434 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 02 21:28:59.945434 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:28:59.946262 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf3b796-dc43-410e-9d2b-b65490a49e9f None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:28:59.946337 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 522/1040] 10.222.0.70 () {56 vars in 1105 bytes} [Tue Aug 2 21:28:59 2022] GET /identity/v3/services/image => generated 86 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:28:59.952377 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c4ea75-84d7-436d-a633-e45dd1e2dfac None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:28:59.988568 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0777ff9-845f-4a09-9de4-7a694cf5a184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:28:59.989193 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0777ff9-845f-4a09-9de4-7a694cf5a184 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:28:59.989473 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0777ff9-845f-4a09-9de4-7a694cf5a184 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:28:59.989747 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0777ff9-845f-4a09-9de4-7a694cf5a184 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:28:59.990533 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0777ff9-845f-4a09-9de4-7a694cf5a184 None admin] RBAC: Adding query filter params (role.id=13e24a71ee30450ab0dfa871704b0520, scope.project.id=42672e04d6ce4b0ab5f7eccfb0cc946c, user.id=87dd5c1c5e854d4b96e0b7dad6aa3719) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:28:59.990843 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0777ff9-845f-4a09-9de4-7a694cf5a184 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:28:59.992284 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0777ff9-845f-4a09-9de4-7a694cf5a184 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:00.003212 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 519/1041] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Aug 2 21:28:59 2022] GET /identity/v3/role_assignments?user.id=87dd5c1c5e854d4b96e0b7dad6aa3719&scope.project.id=42672e04d6ce4b0ab5f7eccfb0cc946c&role.id=13e24a71ee30450ab0dfa871704b0520 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:29:00.003509 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:29:00.071890 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c4ea75-84d7-436d-a633-e45dd1e2dfac None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:00.109838 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a1752f-866c-416b-9250-46ece43026d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:00.110583 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a1752f-866c-416b-9250-46ece43026d9 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:00.110944 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a1752f-866c-416b-9250-46ece43026d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:00.111298 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a1752f-866c-416b-9250-46ece43026d9 None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:00.112067 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a1752f-866c-416b-9250-46ece43026d9 None admin] RBAC: Adding query filter params (name=image) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:29:00.112480 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a1752f-866c-416b-9250-46ece43026d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:00.114263 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a1752f-866c-416b-9250-46ece43026d9 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:00.124640 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 523/1042] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 2 21:28:59 2022] GET /identity/v3/services?name=image => generated 122 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:29:00.126234 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0777ff9-845f-4a09-9de4-7a694cf5a184 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:00.229285 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:29:00.237116 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0777ff9-845f-4a09-9de4-7a694cf5a184 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:00.271135 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840089eb-9074-4292-9d4c-4cbb3c47bb9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:00.271854 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840089eb-9074-4292-9d4c-4cbb3c47bb9b None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:00.272210 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840089eb-9074-4292-9d4c-4cbb3c47bb9b None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:00.272639 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840089eb-9074-4292-9d4c-4cbb3c47bb9b None admin] PATH_INFO: `/v3/services` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:00.273385 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840089eb-9074-4292-9d4c-4cbb3c47bb9b None admin] RBAC: Adding query filter params (type=image) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:29:00.273808 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840089eb-9074-4292-9d4c-4cbb3c47bb9b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:00.275782 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840089eb-9074-4292-9d4c-4cbb3c47bb9b None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:00.286149 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 520/1043] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 2 21:29:00 2022] GET /identity/v3/services?type=image => generated 350 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:29:00.287880 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a1752f-866c-416b-9250-46ece43026d9 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:00.392298 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a1752f-866c-416b-9250-46ece43026d9 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:00.403907 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:29:00.428946 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb68136-12ef-466e-beff-4205a7be1149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:00.429572 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb68136-12ef-466e-beff-4205a7be1149 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:00.429859 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb68136-12ef-466e-beff-4205a7be1149 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:00.430138 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb68136-12ef-466e-beff-4205a7be1149 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:00.430921 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb68136-12ef-466e-beff-4205a7be1149 None admin] RBAC: Adding query filter params (interface=public, service_id=f39d8e1829d24cfcba7918b098faf572, region_id=RegionOne) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:29:00.431235 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb68136-12ef-466e-beff-4205a7be1149 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:00.432670 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb68136-12ef-466e-beff-4205a7be1149 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:00.443845 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 524/1044] 10.222.0.70 () {56 vars in 1251 bytes} [Tue Aug 2 21:29:00 2022] GET /identity/v3/endpoints?service_id=f39d8e1829d24cfcba7918b098faf572&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:29:00.443996 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840089eb-9074-4292-9d4c-4cbb3c47bb9b None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:00.545982 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840089eb-9074-4292-9d4c-4cbb3c47bb9b None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:00.579463 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd68419-a94a-430a-8460-c2c81a828fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:00.580088 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd68419-a94a-430a-8460-c2c81a828fc0 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:00.580475 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd68419-a94a-430a-8460-c2c81a828fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:00.580756 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd68419-a94a-430a-8460-c2c81a828fc0 None admin] PATH_INFO: `/v3/services` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:00.581414 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd68419-a94a-430a-8460-c2c81a828fc0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:00.582776 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd68419-a94a-430a-8460-c2c81a828fc0 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:00.589853 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 521/1045] 10.222.0.70 () {56 vars in 1087 bytes} [Tue Aug 2 21:29:00 2022] GET /identity/v3/services => generated 1957 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 21:29:01.610059 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91f9f29-63a5-4a4a-ae12-453eded10b36 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:01.610551 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91f9f29-63a5-4a4a-ae12-453eded10b36 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:01.610551 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91f9f29-63a5-4a4a-ae12-453eded10b36 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:01.612027 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 525/1046] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:29:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:29:01.617246 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e62957-e91f-4cf5-99a9-2053f23519f2 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:01.617638 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e62957-e91f-4cf5-99a9-2053f23519f2 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:01.617807 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e62957-e91f-4cf5-99a9-2053f23519f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:01.636763 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-80e62957-e91f-4cf5-99a9-2053f23519f2 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:29:01.637955 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-80e62957-e91f-4cf5-99a9-2053f23519f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:29:01.655383 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:29:01.710699 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 522/1047] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:29:01 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 21:29:01.733331 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91f9f29-63a5-4a4a-ae12-453eded10b36 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:01.838476 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91f9f29-63a5-4a4a-ae12-453eded10b36 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:01.873466 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616014b7-bcf8-4875-943d-72dfb1cdb8cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:01.874035 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616014b7-bcf8-4875-943d-72dfb1cdb8cc None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:01.874318 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616014b7-bcf8-4875-943d-72dfb1cdb8cc None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:01.874596 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616014b7-bcf8-4875-943d-72dfb1cdb8cc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:01.885244 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616014b7-bcf8-4875-943d-72dfb1cdb8cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:29:01.890127 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-616014b7-bcf8-4875-943d-72dfb1cdb8cc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 21:29:01.890127 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:29:01.890127 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:29:01.890127 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:29:01.890127 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:29:01.890127 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:29:01.890127 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:29:01.890127 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:29:01.890127 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:29:01.890127 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:29:01.890127 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:29:01.890127 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:29:01.890127 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:29:01.890127 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:29:01.890127 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:29:01.890127 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:29:01.891068 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:29:01.891068 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:29:01.891068 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:29:01.891068 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:29:01.891068 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:29:01.891068 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:29:01.891068 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:29:01.891068 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:29:01.891068 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:29:01.891068 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:29:01.891068 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:29:01.891068 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:29:01.891068 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:29:01.891068 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:29:01.891068 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:29:01.891068 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:29:01.892005 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:29:01.892005 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:29:01.892005 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:29:01.892005 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:29:01.892005 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:29:01.892005 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:29:01.892005 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:29:01.892005 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:29:01.892005 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:29:01.892005 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:29:01.892005 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 21:29:01.892005 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:29:01.896524 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 526/1048] 10.222.0.70 () {56 vars in 1096 bytes} [Tue Aug 2 21:29:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:29:01.897847 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e62957-e91f-4cf5-99a9-2053f23519f2 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:01.980304 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfd635b-2e54-40d6-8dc9-30e140178c01 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:01.980628 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfd635b-2e54-40d6-8dc9-30e140178c01 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:01.980852 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfd635b-2e54-40d6-8dc9-30e140178c01 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:01.982430 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 527/1049] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:29:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 21:29:01.987129 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba69dd8-e6ba-4a9b-ab87-58bdcd141d4d None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:01.987415 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba69dd8-e6ba-4a9b-ab87-58bdcd141d4d None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:01.987693 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba69dd8-e6ba-4a9b-ab87-58bdcd141d4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:02.003431 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e62957-e91f-4cf5-99a9-2053f23519f2 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:02.006461 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-bba69dd8-e6ba-4a9b-ab87-58bdcd141d4d None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:29:02.007631 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-bba69dd8-e6ba-4a9b-ab87-58bdcd141d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:29:02.034252 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:29:02.039610 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eb82ee-1567-45b5-b92d-6d0a0a9fc8e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:02.040259 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eb82ee-1567-45b5-b92d-6d0a0a9fc8e8 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:02.040547 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eb82ee-1567-45b5-b92d-6d0a0a9fc8e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:02.041364 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eb82ee-1567-45b5-b92d-6d0a0a9fc8e8 None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:02.042079 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eb82ee-1567-45b5-b92d-6d0a0a9fc8e8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:29:02.042409 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eb82ee-1567-45b5-b92d-6d0a0a9fc8e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:02.043755 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eb82ee-1567-45b5-b92d-6d0a0a9fc8e8 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:02.052949 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 523/1050] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 2 21:29:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:29:02.059026 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eb82ee-1567-45b5-b92d-6d0a0a9fc8e8 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:02.074955 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:29:02.088960 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 528/1051] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:29:01 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 21:29:02.101164 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba69dd8-e6ba-4a9b-ab87-58bdcd141d4d None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:02.164338 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eb82ee-1567-45b5-b92d-6d0a0a9fc8e8 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:02.201938 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2978f2c7-0d01-460b-9f7c-2385cd4bd556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:02.202582 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2978f2c7-0d01-460b-9f7c-2385cd4bd556 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:02.202873 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2978f2c7-0d01-460b-9f7c-2385cd4bd556 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:02.203154 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2978f2c7-0d01-460b-9f7c-2385cd4bd556 None admin] PATH_INFO: `/v3/users/5f4efd65f7004fa2ad9fc8c8dd1eca2f` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:02.205455 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba69dd8-e6ba-4a9b-ab87-58bdcd141d4d None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:02.217422 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2978f2c7-0d01-460b-9f7c-2385cd4bd556 None admin] RBAC: Authorizing `identity:get_user(user_id=5f4efd65f7004fa2ad9fc8c8dd1eca2f)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:02.218880 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2978f2c7-0d01-460b-9f7c-2385cd4bd556 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:02.225124 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 524/1052] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Aug 2 21:29:02 2022] GET /identity/v3/users/5f4efd65f7004fa2ad9fc8c8dd1eca2f => generated 285 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:29:02.226090 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2978f2c7-0d01-460b-9f7c-2385cd4bd556 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:02.242274 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd99812b-c8f3-4f63-9237-e7813a480b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:02.242988 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd99812b-c8f3-4f63-9237-e7813a480b9a None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:02.243270 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd99812b-c8f3-4f63-9237-e7813a480b9a None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:02.243544 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd99812b-c8f3-4f63-9237-e7813a480b9a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:02.254473 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd99812b-c8f3-4f63-9237-e7813a480b9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:29:02.259419 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-fd99812b-c8f3-4f63-9237-e7813a480b9a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 02 21:29:02.259419 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:29:02.259419 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:29:02.259419 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:29:02.259419 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:29:02.259419 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:29:02.259419 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:29:02.259419 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:29:02.259419 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:29:02.259419 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:29:02.259419 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:29:02.259419 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:29:02.259419 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:29:02.259419 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:29:02.259419 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:29:02.259419 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:29:02.260412 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:29:02.260412 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:29:02.260412 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:29:02.260412 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:29:02.260412 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:29:02.260412 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:29:02.260412 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:29:02.260412 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:29:02.260412 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:29:02.260412 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:29:02.260412 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:29:02.260412 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:29:02.260412 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:29:02.260412 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:29:02.260412 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:29:02.260412 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:29:02.261286 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:29:02.261286 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:29:02.261286 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:29:02.261286 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:29:02.261286 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:29:02.261286 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:29:02.261286 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:29:02.261286 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:29:02.261286 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:29:02.261286 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:29:02.261286 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 02 21:29:02.261286 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:29:02.266195 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 529/1053] 10.222.0.70 () {56 vars in 1120 bytes} [Tue Aug 2 21:29:02 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 21:29:02.266481 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd99812b-c8f3-4f63-9237-e7813a480b9a None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:02.301532 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:29:02.309854 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:29:02.343433 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2978f2c7-0d01-460b-9f7c-2385cd4bd556 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:02.379971 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd99812b-c8f3-4f63-9237-e7813a480b9a None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:02.381622 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e95c2ba-ed06-4889-a239-114c79cc725c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:02.382244 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e95c2ba-ed06-4889-a239-114c79cc725c None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:02.382528 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e95c2ba-ed06-4889-a239-114c79cc725c None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:02.383381 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e95c2ba-ed06-4889-a239-114c79cc725c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:02.418582 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de06cd7-5768-4711-99d2-9735b8ec2aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:02.420829 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de06cd7-5768-4711-99d2-9735b8ec2aff None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:02.421612 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de06cd7-5768-4711-99d2-9735b8ec2aff None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:02.422290 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de06cd7-5768-4711-99d2-9735b8ec2aff None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:02.423300 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de06cd7-5768-4711-99d2-9735b8ec2aff None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:29:02.423795 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de06cd7-5768-4711-99d2-9735b8ec2aff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:02.426596 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de06cd7-5768-4711-99d2-9735b8ec2aff None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:02.440160 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 530/1054] 10.222.0.70 () {56 vars in 1115 bytes} [Tue Aug 2 21:29:02 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:29:02.445712 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de06cd7-5768-4711-99d2-9735b8ec2aff None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:02.464924 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e95c2ba-ed06-4889-a239-114c79cc725c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:02.466530 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e95c2ba-ed06-4889-a239-114c79cc725c None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:02.536451 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:29:02.538660 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:29:02.557389 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de06cd7-5768-4711-99d2-9735b8ec2aff None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:02.571690 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 525/1055] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 2 21:29:02 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 02 21:29:02.577291 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e95c2ba-ed06-4889-a239-114c79cc725c None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:02.593110 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c21f8f0-355d-46d4-afbe-5787fdb416c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:02.593755 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c21f8f0-355d-46d4-afbe-5787fdb416c2 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:02.594040 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c21f8f0-355d-46d4-afbe-5787fdb416c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:02.594321 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c21f8f0-355d-46d4-afbe-5787fdb416c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:02.605942 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c21f8f0-355d-46d4-afbe-5787fdb416c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:02.607391 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c21f8f0-355d-46d4-afbe-5787fdb416c2 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:02.621826 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-7c21f8f0-355d-46d4-afbe-5787fdb416c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:29:02.621826 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:29:02.621826 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:29:02.621826 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:29:02.621826 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:29:02.621826 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:29:02.621826 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:29:02.621826 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:29:02.621826 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:29:02.621826 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:29:02.621826 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:29:02.621826 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:29:02.621826 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:29:02.621826 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:29:02.621826 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:29:02.623165 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:29:02.623165 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:29:02.623165 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:29:02.623165 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:29:02.623165 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:29:02.623165 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:29:02.623165 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:29:02.623165 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:29:02.623165 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:29:02.623165 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:29:02.623165 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:29:02.623165 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:29:02.623165 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:29:02.623165 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:29:02.623165 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:29:02.623165 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:29:02.623165 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:29:02.624049 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:29:02.624049 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:29:02.624049 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:29:02.624049 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:29:02.624049 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 531/1056] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 2 21:29:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 21:29:02.624482 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f394c91-dbd4-4825-894e-3247980257ae None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:02.624759 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f394c91-dbd4-4825-894e-3247980257ae None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:02.625011 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f394c91-dbd4-4825-894e-3247980257ae None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:02.626239 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 532/1057] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:29:02 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:29:02.628542 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f394c91-dbd4-4825-894e-3247980257ae None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:02.680410 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e95c2ba-ed06-4889-a239-114c79cc725c None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:02.714286 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71e14d4-dbc9-437c-99a3-bf730c4674a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:02.714917 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e14d4-dbc9-437c-99a3-bf730c4674a9 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:02.715237 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e14d4-dbc9-437c-99a3-bf730c4674a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:02.715515 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71e14d4-dbc9-437c-99a3-bf730c4674a9 None admin] PATH_INFO: `/v3/projects/21d3e3d48c7b46a9ba1d8fc2ae85eaf7` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:02.716684 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71e14d4-dbc9-437c-99a3-bf730c4674a9 None admin] RBAC: Authorizing `identity:get_project(project_id=21d3e3d48c7b46a9ba1d8fc2ae85eaf7)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:02.718138 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71e14d4-dbc9-437c-99a3-bf730c4674a9 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:02.719794 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 526/1058] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Aug 2 21:29:02 2022] GET /identity/v3/projects/21d3e3d48c7b46a9ba1d8fc2ae85eaf7 => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:29:02.720930 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f933cfd-cfb1-4b0b-8f22-e932411007da None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:02.721419 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f933cfd-cfb1-4b0b-8f22-e932411007da None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:02.721527 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f933cfd-cfb1-4b0b-8f22-e932411007da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:02.731155 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f394c91-dbd4-4825-894e-3247980257ae None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:02.739984 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-1f933cfd-cfb1-4b0b-8f22-e932411007da None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:29:02.741877 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-1f933cfd-cfb1-4b0b-8f22-e932411007da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:29:02.765672 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcc2c19-22aa-4106-889c-4c747edf5c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:02.766561 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcc2c19-22aa-4106-889c-4c747edf5c3d None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:02.767037 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcc2c19-22aa-4106-889c-4c747edf5c3d None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:02.767473 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcc2c19-22aa-4106-889c-4c747edf5c3d None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:02.768350 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcc2c19-22aa-4106-889c-4c747edf5c3d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:29:02.768810 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcc2c19-22aa-4106-889c-4c747edf5c3d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:02.770223 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcc2c19-22aa-4106-889c-4c747edf5c3d None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:02.778201 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:29:02.780358 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:29:02.785380 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 533/1059] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 2 21:29:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:29:02.786188 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcc2c19-22aa-4106-889c-4c747edf5c3d None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:02.822501 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 527/1060] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:29:02 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 21:29:02.823678 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f933cfd-cfb1-4b0b-8f22-e932411007da None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:02.904105 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcc2c19-22aa-4106-889c-4c747edf5c3d None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:02.939403 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e389f057-d45b-44ea-a01a-f46652ac9829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:02.940318 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e389f057-d45b-44ea-a01a-f46652ac9829 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:02.940546 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f933cfd-cfb1-4b0b-8f22-e932411007da None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:02.940909 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e389f057-d45b-44ea-a01a-f46652ac9829 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:02.941331 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e389f057-d45b-44ea-a01a-f46652ac9829 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:02.942297 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e389f057-d45b-44ea-a01a-f46652ac9829 None admin] RBAC: Adding query filter params (role.id=3e32dbf75f9b41f5adb9fe59851267bb, scope.project.id=21d3e3d48c7b46a9ba1d8fc2ae85eaf7, user.id=5f4efd65f7004fa2ad9fc8c8dd1eca2f) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:29:02.942609 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e389f057-d45b-44ea-a01a-f46652ac9829 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:02.944161 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e389f057-d45b-44ea-a01a-f46652ac9829 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:02.950271 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 534/1061] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Aug 2 21:29:02 2022] GET /identity/v3/role_assignments?user.id=5f4efd65f7004fa2ad9fc8c8dd1eca2f&scope.project.id=21d3e3d48c7b46a9ba1d8fc2ae85eaf7&role.id=3e32dbf75f9b41f5adb9fe59851267bb => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:29:02.951133 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e389f057-d45b-44ea-a01a-f46652ac9829 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:02.990938 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb0af40-6a4e-47ee-b5a6-5d08d0a899c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:02.992545 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb0af40-6a4e-47ee-b5a6-5d08d0a899c1 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:02.994236 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb0af40-6a4e-47ee-b5a6-5d08d0a899c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:02.994748 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb0af40-6a4e-47ee-b5a6-5d08d0a899c1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:03.005134 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb0af40-6a4e-47ee-b5a6-5d08d0a899c1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:03.006654 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb0af40-6a4e-47ee-b5a6-5d08d0a899c1 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:03.026501 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-0bb0af40-6a4e-47ee-b5a6-5d08d0a899c1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 02 21:29:03.026501 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:29:03.026501 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:29:03.026501 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:29:03.026501 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:29:03.026501 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:29:03.026501 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:29:03.026501 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:29:03.026501 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:29:03.026501 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:29:03.026501 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:29:03.026501 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:29:03.026501 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 21:29:03.026501 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 21:29:03.026501 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 21:29:03.026501 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 21:29:03.027528 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:29:03.027528 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:29:03.027528 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 21:29:03.027528 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:29:03.027528 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 21:29:03.027528 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:29:03.027528 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:29:03.027528 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:29:03.027528 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:29:03.027528 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:29:03.027528 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:29:03.027528 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:29:03.027528 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:29:03.027528 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:29:03.027528 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:29:03.027528 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:29:03.027528 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:29:03.027528 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:29:03.029207 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:29:03.029207 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:29:03.029207 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 21:29:03.029207 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 21:29:03.029207 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 21:29:03.029207 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 21:29:03.029207 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 21:29:03.029207 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 21:29:03.029207 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 02 21:29:03.029207 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:29:03.029207 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 528/1062] 10.222.0.70 () {56 vars in 1093 bytes} [Tue Aug 2 21:29:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:29:03.033839 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb0af40-6a4e-47ee-b5a6-5d08d0a899c1 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:03.042653 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:29:03.079317 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:29:03.101763 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e389f057-d45b-44ea-a01a-f46652ac9829 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:03.141243 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c000955e-37b4-4e05-b7d5-8c4caec1140c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:03.141895 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c000955e-37b4-4e05-b7d5-8c4caec1140c None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:03.142179 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c000955e-37b4-4e05-b7d5-8c4caec1140c None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:03.142456 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c000955e-37b4-4e05-b7d5-8c4caec1140c None admin] PATH_INFO: `/v3/services/image` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:03.143083 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c000955e-37b4-4e05-b7d5-8c4caec1140c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:03.144488 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c000955e-37b4-4e05-b7d5-8c4caec1140c None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:03.157277 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-c000955e-37b4-4e05-b7d5-8c4caec1140c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 02 21:29:03.157277 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:29:03.157277 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 21:29:03.157277 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 21:29:03.157277 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 21:29:03.157277 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 21:29:03.157277 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 21:29:03.157277 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 21:29:03.157277 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 02 21:29:03.157277 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:29:03.157277 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 21:29:03.157277 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:29:03.157277 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:29:03.157277 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:29:03.157277 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:29:03.157277 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:29:03.157277 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:29:03.158312 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:29:03.158312 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:29:03.158312 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:29:03.158312 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:29:03.158312 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:29:03.158312 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:29:03.158312 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 21:29:03.158312 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 21:29:03.158312 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 21:29:03.158312 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 21:29:03.158312 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:29:03.158312 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:29:03.158312 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:29:03.158312 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:29:03.158312 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:29:03.158312 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:29:03.159163 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:29:03.159163 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:29:03.159163 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:29:03.159163 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:29:03.159163 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:29:03.159163 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:29:03.159163 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:29:03.159163 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:29:03.159163 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:29:03.159163 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:29:03.159163 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 21:29:03.159163 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 21:29:03.159163 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 02 21:29:03.159163 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:29:03.161026 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 535/1063] 10.222.0.70 () {56 vars in 1105 bytes} [Tue Aug 2 21:29:02 2022] GET /identity/v3/services/image => generated 86 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:29:03.165543 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c000955e-37b4-4e05-b7d5-8c4caec1140c None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:03.174445 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb0af40-6a4e-47ee-b5a6-5d08d0a899c1 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:03.211651 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd69f3e-18d0-4747-8e6c-df45bd745498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:03.212713 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd69f3e-18d0-4747-8e6c-df45bd745498 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:03.213207 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd69f3e-18d0-4747-8e6c-df45bd745498 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:03.213650 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd69f3e-18d0-4747-8e6c-df45bd745498 None admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:03.214750 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd69f3e-18d0-4747-8e6c-df45bd745498 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:29:03.215265 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd69f3e-18d0-4747-8e6c-df45bd745498 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:03.216967 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd69f3e-18d0-4747-8e6c-df45bd745498 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:03.235298 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 529/1064] 10.222.0.70 () {56 vars in 1133 bytes} [Tue Aug 2 21:29:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:29:03.240697 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd69f3e-18d0-4747-8e6c-df45bd745498 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:03.278582 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c000955e-37b4-4e05-b7d5-8c4caec1140c None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:03.309954 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:29:03.319354 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3e83e0-947c-4311-bcc8-53c3864666f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:03.320068 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3e83e0-947c-4311-bcc8-53c3864666f0 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:03.320467 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3e83e0-947c-4311-bcc8-53c3864666f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:03.320827 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3e83e0-947c-4311-bcc8-53c3864666f0 None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:03.321509 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3e83e0-947c-4311-bcc8-53c3864666f0 None admin] RBAC: Adding query filter params (name=image) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:29:03.321821 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3e83e0-947c-4311-bcc8-53c3864666f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:03.323846 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3e83e0-947c-4311-bcc8-53c3864666f0 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:03.329066 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 536/1065] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 2 21:29:03 2022] GET /identity/v3/services?name=image => generated 122 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:29:03.334615 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3e83e0-947c-4311-bcc8-53c3864666f0 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:03.346804 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:29:03.363580 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd69f3e-18d0-4747-8e6c-df45bd745498 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:03.401177 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38d08f8-eb74-40b6-9cb5-a32d1d1a676b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:03.401878 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38d08f8-eb74-40b6-9cb5-a32d1d1a676b None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:03.402206 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38d08f8-eb74-40b6-9cb5-a32d1d1a676b None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:03.402477 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38d08f8-eb74-40b6-9cb5-a32d1d1a676b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:03.413980 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38d08f8-eb74-40b6-9cb5-a32d1d1a676b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:03.416357 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38d08f8-eb74-40b6-9cb5-a32d1d1a676b None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:03.436339 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-a38d08f8-eb74-40b6-9cb5-a32d1d1a676b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:29:03.436339 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:29:03.436339 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:29:03.436339 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:29:03.436339 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:29:03.436339 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:29:03.436339 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:29:03.436339 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:29:03.436339 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:29:03.436339 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:29:03.436339 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:29:03.436339 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:29:03.436339 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:29:03.436339 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:29:03.436339 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:29:03.437342 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:29:03.437342 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:29:03.437342 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:29:03.437342 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:29:03.437342 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:29:03.437342 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:29:03.437342 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:29:03.437342 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:29:03.437342 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:29:03.437342 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:29:03.437342 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:29:03.437342 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:29:03.437342 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:29:03.437342 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:29:03.437342 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:29:03.437342 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:29:03.437342 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:29:03.438392 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:29:03.438392 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:29:03.438392 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:29:03.438392 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:29:03.439872 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 530/1066] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 2 21:29:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:29:03.445489 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38d08f8-eb74-40b6-9cb5-a32d1d1a676b None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:03.447675 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3e83e0-947c-4311-bcc8-53c3864666f0 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:03.484317 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82498b3d-f345-4665-ad8a-18f7871f9847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:03.484863 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82498b3d-f345-4665-ad8a-18f7871f9847 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:03.485147 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82498b3d-f345-4665-ad8a-18f7871f9847 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:03.485425 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82498b3d-f345-4665-ad8a-18f7871f9847 None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:03.486101 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82498b3d-f345-4665-ad8a-18f7871f9847 None admin] RBAC: Adding query filter params (type=image) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:29:03.486408 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82498b3d-f345-4665-ad8a-18f7871f9847 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:03.487812 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82498b3d-f345-4665-ad8a-18f7871f9847 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:03.498223 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 537/1067] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 2 21:29:03 2022] GET /identity/v3/services?type=image => generated 350 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:29:03.499819 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82498b3d-f345-4665-ad8a-18f7871f9847 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:03.563731 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38d08f8-eb74-40b6-9cb5-a32d1d1a676b None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:03.566261 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:29:03.599263 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1913cb-2979-4e49-9db0-d187d2b93d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:03.599883 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1913cb-2979-4e49-9db0-d187d2b93d8e None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:03.600168 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1913cb-2979-4e49-9db0-d187d2b93d8e None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:03.600476 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1913cb-2979-4e49-9db0-d187d2b93d8e None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:03.601175 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1913cb-2979-4e49-9db0-d187d2b93d8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:29:03.601481 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1913cb-2979-4e49-9db0-d187d2b93d8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:03.602849 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1913cb-2979-4e49-9db0-d187d2b93d8e None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:03.613178 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:29:03.614355 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82498b3d-f345-4665-ad8a-18f7871f9847 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:03.622842 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 531/1068] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 2 21:29:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:29:03.624132 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1913cb-2979-4e49-9db0-d187d2b93d8e None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:03.651074 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0925dfbe-019e-49b5-b6bc-ca789f9af8fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:03.651886 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0925dfbe-019e-49b5-b6bc-ca789f9af8fd None admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:03.652074 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0925dfbe-019e-49b5-b6bc-ca789f9af8fd None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:03.652381 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0925dfbe-019e-49b5-b6bc-ca789f9af8fd None admin] PATH_INFO: `/v3/endpoints` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:03.653212 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0925dfbe-019e-49b5-b6bc-ca789f9af8fd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:03.654605 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0925dfbe-019e-49b5-b6bc-ca789f9af8fd None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:03.688265 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 538/1069] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 2 21:29:03 2022] POST /identity/v3/endpoints => generated 327 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 21:29:03.742738 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1913cb-2979-4e49-9db0-d187d2b93d8e None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:03.785940 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccaeac6-3e86-4de0-b3f9-448516d9f17c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:03.786604 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccaeac6-3e86-4de0-b3f9-448516d9f17c None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:03.786888 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccaeac6-3e86-4de0-b3f9-448516d9f17c None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:03.787163 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccaeac6-3e86-4de0-b3f9-448516d9f17c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:03.795304 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccaeac6-3e86-4de0-b3f9-448516d9f17c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:03.796806 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccaeac6-3e86-4de0-b3f9-448516d9f17c None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:03.809370 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-dccaeac6-3e86-4de0-b3f9-448516d9f17c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:29:03.809370 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:29:03.809370 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:29:03.809370 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:29:03.809370 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:29:03.809370 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:29:03.809370 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:29:03.809370 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:29:03.809370 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:29:03.809370 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:29:03.809370 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:29:03.809370 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:29:03.809370 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 21:29:03.809370 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 21:29:03.809370 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 21:29:03.810355 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 21:29:03.810355 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:29:03.810355 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:29:03.810355 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:29:03.810355 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:29:03.810355 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:29:03.810355 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:29:03.810355 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:29:03.810355 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:29:03.810355 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:29:03.810355 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:29:03.810355 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:29:03.810355 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:29:03.810355 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:29:03.810355 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:29:03.810355 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:29:03.810355 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:29:03.811328 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 21:29:03.811328 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 21:29:03.811328 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 21:29:03.811328 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 21:29:03.811328 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 21:29:03.811328 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 21:29:03.811328 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:29:03.811328 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:29:03.811328 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 532/1070] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Aug 2 21:29:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:29:03.821535 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0925dfbe-019e-49b5-b6bc-ca789f9af8fd None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:03.927734 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0925dfbe-019e-49b5-b6bc-ca789f9af8fd None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:03.938585 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:29:03.964460 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5895045b-3d04-4c62-bde0-cecb114dba76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:03.965087 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5895045b-3d04-4c62-bde0-cecb114dba76 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:03.965372 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5895045b-3d04-4c62-bde0-cecb114dba76 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:03.965650 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5895045b-3d04-4c62-bde0-cecb114dba76 None admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:03.966454 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5895045b-3d04-4c62-bde0-cecb114dba76 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:29:03.966769 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5895045b-3d04-4c62-bde0-cecb114dba76 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:03.968256 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5895045b-3d04-4c62-bde0-cecb114dba76 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:03.980994 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 539/1071] 10.222.0.70 () {56 vars in 1148 bytes} [Tue Aug 2 21:29:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:29:03.986667 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccaeac6-3e86-4de0-b3f9-448516d9f17c None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:04.046651 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:29:04.095347 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccaeac6-3e86-4de0-b3f9-448516d9f17c None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:04.129658 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9194027-23c2-43eb-aa0f-4f0707d5becf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:04.130329 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9194027-23c2-43eb-aa0f-4f0707d5becf None admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:04.130613 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9194027-23c2-43eb-aa0f-4f0707d5becf None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:04.130889 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9194027-23c2-43eb-aa0f-4f0707d5becf None admin] PATH_INFO: `/v3/projects/42672e04d6ce4b0ab5f7eccfb0cc946c/users/87dd5c1c5e854d4b96e0b7dad6aa3719/roles/13e24a71ee30450ab0dfa871704b0520` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:04.133090 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9194027-23c2-43eb-aa0f-4f0707d5becf None admin] RBAC: Authorizing `identity:create_grant(project_id=42672e04d6ce4b0ab5f7eccfb0cc946c, user_id=87dd5c1c5e854d4b96e0b7dad6aa3719, role_id=13e24a71ee30450ab0dfa871704b0520)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:04.134548 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9194027-23c2-43eb-aa0f-4f0707d5becf None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:04.147610 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 533/1072] 10.222.0.70 () {58 vars in 1439 bytes} [Tue Aug 2 21:29:03 2022] PUT /identity/v3/projects/42672e04d6ce4b0ab5f7eccfb0cc946c/users/87dd5c1c5e854d4b96e0b7dad6aa3719/roles/13e24a71ee30450ab0dfa871704b0520 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:29:04.962258 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0b9e81-6ea7-40d9-9940-b5af5ea18b92 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:04.962799 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0b9e81-6ea7-40d9-9940-b5af5ea18b92 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:04.962878 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0b9e81-6ea7-40d9-9940-b5af5ea18b92 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:04.964391 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 540/1073] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:29:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:29:04.969504 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65740abe-b55c-456b-89a0-f0fee8b10fb4 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:04.969895 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65740abe-b55c-456b-89a0-f0fee8b10fb4 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:04.970061 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65740abe-b55c-456b-89a0-f0fee8b10fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:04.988603 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-65740abe-b55c-456b-89a0-f0fee8b10fb4 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:29:04.989805 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-65740abe-b55c-456b-89a0-f0fee8b10fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:29:05.057468 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 534/1074] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:29:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 21:29:05.085872 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0b9e81-6ea7-40d9-9940-b5af5ea18b92 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:05.191937 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0b9e81-6ea7-40d9-9940-b5af5ea18b92 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:05.228803 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0fbc17-da59-456f-9d7f-f02782886aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:05.229397 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0fbc17-da59-456f-9d7f-f02782886aad None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:05.229681 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0fbc17-da59-456f-9d7f-f02782886aad None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:05.229954 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0fbc17-da59-456f-9d7f-f02782886aad None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:05.240788 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0fbc17-da59-456f-9d7f-f02782886aad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:29:05.246762 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-6a0fbc17-da59-456f-9d7f-f02782886aad None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 21:29:05.246762 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:29:05.246762 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:29:05.246762 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:29:05.246762 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:29:05.246762 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:29:05.246762 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:29:05.246762 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:29:05.246762 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:29:05.246762 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:29:05.246762 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:29:05.246762 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:29:05.246762 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:29:05.246762 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:29:05.246762 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:29:05.246762 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:29:05.247792 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:29:05.247792 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:29:05.247792 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:29:05.247792 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:29:05.247792 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:29:05.247792 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:29:05.247792 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:29:05.247792 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:29:05.247792 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:29:05.247792 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:29:05.247792 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:29:05.247792 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:29:05.247792 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:29:05.247792 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:29:05.247792 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:29:05.247792 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:29:05.248688 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:29:05.248688 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:29:05.248688 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:29:05.248688 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:29:05.248688 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:29:05.248688 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:29:05.248688 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:29:05.248688 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:29:05.248688 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:29:05.248688 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:29:05.248688 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 21:29:05.248688 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:29:05.248688 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 541/1075] 10.222.0.70 () {56 vars in 1096 bytes} [Tue Aug 2 21:29:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:29:05.257583 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65740abe-b55c-456b-89a0-f0fee8b10fb4 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:05.308345 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:29:05.364658 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65740abe-b55c-456b-89a0-f0fee8b10fb4 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:05.398630 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233e9798-3680-4d63-95e2-c641024a863d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:05.399243 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233e9798-3680-4d63-95e2-c641024a863d None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:05.399530 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233e9798-3680-4d63-95e2-c641024a863d None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:05.399803 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233e9798-3680-4d63-95e2-c641024a863d None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:05.402608 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233e9798-3680-4d63-95e2-c641024a863d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:29:05.402608 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233e9798-3680-4d63-95e2-c641024a863d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:05.404825 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233e9798-3680-4d63-95e2-c641024a863d None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:05.416415 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 535/1076] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 2 21:29:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:29:05.418907 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0fbc17-da59-456f-9d7f-f02782886aad None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:05.456899 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:29:05.528849 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0fbc17-da59-456f-9d7f-f02782886aad None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:05.563386 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d192495-7bfd-4e80-ae56-6bbb17208798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:05.564031 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d192495-7bfd-4e80-ae56-6bbb17208798 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:05.564348 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d192495-7bfd-4e80-ae56-6bbb17208798 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:05.564632 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d192495-7bfd-4e80-ae56-6bbb17208798 None admin] PATH_INFO: `/v3/users/5f4efd65f7004fa2ad9fc8c8dd1eca2f` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:05.565805 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d192495-7bfd-4e80-ae56-6bbb17208798 None admin] RBAC: Authorizing `identity:get_user(user_id=5f4efd65f7004fa2ad9fc8c8dd1eca2f)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:05.567245 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d192495-7bfd-4e80-ae56-6bbb17208798 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:05.573763 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 542/1077] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Aug 2 21:29:05 2022] GET /identity/v3/users/5f4efd65f7004fa2ad9fc8c8dd1eca2f => generated 285 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:29:05.575161 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233e9798-3680-4d63-95e2-c641024a863d None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:05.676810 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233e9798-3680-4d63-95e2-c641024a863d None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:05.685950 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:29:05.715331 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9205131e-e6a8-41ee-8c9a-9385fd47a768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:05.715331 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9205131e-e6a8-41ee-8c9a-9385fd47a768 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:05.715331 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9205131e-e6a8-41ee-8c9a-9385fd47a768 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:05.715331 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9205131e-e6a8-41ee-8c9a-9385fd47a768 None admin] PATH_INFO: `/v3/projects/21d3e3d48c7b46a9ba1d8fc2ae85eaf7` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:05.716622 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9205131e-e6a8-41ee-8c9a-9385fd47a768 None admin] RBAC: Authorizing `identity:get_project(project_id=21d3e3d48c7b46a9ba1d8fc2ae85eaf7)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:05.718070 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9205131e-e6a8-41ee-8c9a-9385fd47a768 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:05.719967 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 536/1078] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Aug 2 21:29:05 2022] GET /identity/v3/projects/21d3e3d48c7b46a9ba1d8fc2ae85eaf7 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:29:05.726024 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d192495-7bfd-4e80-ae56-6bbb17208798 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:05.763205 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfc8330-9ea8-4e5b-bc26-52ae674402de None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:05.763522 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfc8330-9ea8-4e5b-bc26-52ae674402de None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:05.763768 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfc8330-9ea8-4e5b-bc26-52ae674402de None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:05.765427 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 537/1079] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:29:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 21:29:05.770510 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53a0e5f-e31e-4c75-b6e8-a4241c884433 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:05.770808 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53a0e5f-e31e-4c75-b6e8-a4241c884433 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:05.771094 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53a0e5f-e31e-4c75-b6e8-a4241c884433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:05.789888 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-e53a0e5f-e31e-4c75-b6e8-a4241c884433 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:29:05.791037 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-e53a0e5f-e31e-4c75-b6e8-a4241c884433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:29:05.831712 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:29:05.835751 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d192495-7bfd-4e80-ae56-6bbb17208798 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:05.866695 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 538/1080] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:29:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 21:29:05.875133 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97709d1-0b98-4c10-aa6d-21ee6afbd10b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:05.875888 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97709d1-0b98-4c10-aa6d-21ee6afbd10b None admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:05.876250 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97709d1-0b98-4c10-aa6d-21ee6afbd10b None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:05.876609 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97709d1-0b98-4c10-aa6d-21ee6afbd10b None admin] PATH_INFO: `/v3/projects/21d3e3d48c7b46a9ba1d8fc2ae85eaf7/users/5f4efd65f7004fa2ad9fc8c8dd1eca2f/roles/3e32dbf75f9b41f5adb9fe59851267bb` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:05.878568 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97709d1-0b98-4c10-aa6d-21ee6afbd10b None admin] RBAC: Authorizing `identity:create_grant(project_id=21d3e3d48c7b46a9ba1d8fc2ae85eaf7, user_id=5f4efd65f7004fa2ad9fc8c8dd1eca2f, role_id=3e32dbf75f9b41f5adb9fe59851267bb)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:05.880068 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97709d1-0b98-4c10-aa6d-21ee6afbd10b None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:05.890490 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53a0e5f-e31e-4c75-b6e8-a4241c884433 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:05.894087 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 543/1081] 10.222.0.70 () {58 vars in 1439 bytes} [Tue Aug 2 21:29:05 2022] PUT /identity/v3/projects/21d3e3d48c7b46a9ba1d8fc2ae85eaf7/users/5f4efd65f7004fa2ad9fc8c8dd1eca2f/roles/3e32dbf75f9b41f5adb9fe59851267bb => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:29:06.006019 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53a0e5f-e31e-4c75-b6e8-a4241c884433 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:06.015634 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:29:06.072694 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4911bf-7382-4bd5-a739-0e11c4dd94b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:06.073246 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4911bf-7382-4bd5-a739-0e11c4dd94b4 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:06.073527 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4911bf-7382-4bd5-a739-0e11c4dd94b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:06.073796 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4911bf-7382-4bd5-a739-0e11c4dd94b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:06.148783 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4911bf-7382-4bd5-a739-0e11c4dd94b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:06.150296 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4911bf-7382-4bd5-a739-0e11c4dd94b4 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:06.156790 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b57a3c3-3175-43d1-992d-dded370d0b54 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:06.157297 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b57a3c3-3175-43d1-992d-dded370d0b54 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:06.157379 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b57a3c3-3175-43d1-992d-dded370d0b54 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:06.158826 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 544/1082] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:29:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 21:29:06.163354 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bb30d6-049b-4493-b12b-a012e581f06e None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:06.163644 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bb30d6-049b-4493-b12b-a012e581f06e None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:06.163919 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bb30d6-049b-4493-b12b-a012e581f06e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:06.182020 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-00bb30d6-049b-4493-b12b-a012e581f06e None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:29:06.183199 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-00bb30d6-049b-4493-b12b-a012e581f06e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:29:06.255372 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 539/1083] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 2 21:29:05 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 02 21:29:06.261570 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4911bf-7382-4bd5-a739-0e11c4dd94b4 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:06.262044 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 545/1084] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:29:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 21:29:06.269893 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:29:06.285431 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bb30d6-049b-4493-b12b-a012e581f06e None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:06.372887 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4911bf-7382-4bd5-a739-0e11c4dd94b4 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:06.382308 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:29:06.397311 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bb30d6-049b-4493-b12b-a012e581f06e None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:06.410100 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e2400a-4183-4066-a0d9-4ff101daf39b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:06.411134 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e2400a-4183-4066-a0d9-4ff101daf39b None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:06.411393 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e2400a-4183-4066-a0d9-4ff101daf39b None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:06.411605 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e2400a-4183-4066-a0d9-4ff101daf39b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:06.422843 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e2400a-4183-4066-a0d9-4ff101daf39b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:06.424491 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e2400a-4183-4066-a0d9-4ff101daf39b None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:06.436329 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87c0baa-c4a6-4588-8e12-1e49caab49e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:06.436977 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87c0baa-c4a6-4588-8e12-1e49caab49e5 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:06.437259 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87c0baa-c4a6-4588-8e12-1e49caab49e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:06.437534 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87c0baa-c4a6-4588-8e12-1e49caab49e5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:06.439756 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-c2e2400a-4183-4066-a0d9-4ff101daf39b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:29:06.439756 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:29:06.439756 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:29:06.439756 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:29:06.439756 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:29:06.439756 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:29:06.439756 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:29:06.439756 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:29:06.439756 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:29:06.439756 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:29:06.439756 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:29:06.439756 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:29:06.439756 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:29:06.439756 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:29:06.439756 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:29:06.440723 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:29:06.440723 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:29:06.440723 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:29:06.440723 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:29:06.440723 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:29:06.440723 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:29:06.440723 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:29:06.440723 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:29:06.440723 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:29:06.440723 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:29:06.440723 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:29:06.440723 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:29:06.440723 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:29:06.440723 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:29:06.440723 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:29:06.440723 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:29:06.440723 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:29:06.442349 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:29:06.442349 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:29:06.442349 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:29:06.442349 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:29:06.442349 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 540/1085] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 2 21:29:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 21:29:06.446691 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e2400a-4183-4066-a0d9-4ff101daf39b None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:06.451111 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87c0baa-c4a6-4588-8e12-1e49caab49e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:29:06.456120 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-f87c0baa-c4a6-4588-8e12-1e49caab49e5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 02 21:29:06.456120 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:29:06.456120 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:29:06.456120 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:29:06.456120 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:29:06.456120 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:29:06.456120 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:29:06.456120 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:29:06.456120 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:29:06.456120 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:29:06.456120 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:29:06.456120 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:29:06.456120 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:29:06.456120 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:29:06.456120 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:29:06.456120 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:29:06.457085 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:29:06.457085 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:29:06.457085 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:29:06.457085 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:29:06.457085 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:29:06.457085 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:29:06.457085 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:29:06.457085 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:29:06.457085 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:29:06.457085 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:29:06.457085 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:29:06.457085 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:29:06.457085 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:29:06.457085 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:29:06.457085 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:29:06.457085 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:29:06.457926 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:29:06.457926 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:29:06.457926 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:29:06.457926 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:29:06.457926 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:29:06.457926 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:29:06.457926 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:29:06.457926 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:29:06.457926 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:29:06.457926 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:29:06.457926 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 02 21:29:06.457926 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:29:06.462439 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 546/1086] 10.222.0.70 () {56 vars in 1120 bytes} [Tue Aug 2 21:29:06 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:29:06.463200 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87c0baa-c4a6-4588-8e12-1e49caab49e5 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:06.514311 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:29:06.559275 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e2400a-4183-4066-a0d9-4ff101daf39b None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:06.572662 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87c0baa-c4a6-4588-8e12-1e49caab49e5 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:06.592297 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478f74cb-b3a0-484c-95fa-7deaba0dd46d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:06.592929 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478f74cb-b3a0-484c-95fa-7deaba0dd46d None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:06.593214 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478f74cb-b3a0-484c-95fa-7deaba0dd46d None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:06.593492 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478f74cb-b3a0-484c-95fa-7deaba0dd46d None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:06.594187 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478f74cb-b3a0-484c-95fa-7deaba0dd46d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:29:06.594500 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478f74cb-b3a0-484c-95fa-7deaba0dd46d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:06.595870 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478f74cb-b3a0-484c-95fa-7deaba0dd46d None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:06.615199 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 541/1087] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 2 21:29:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:29:06.615429 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e876fdc3-c8b3-4a48-b198-379f11949fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:06.615429 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e876fdc3-c8b3-4a48-b198-379f11949fed None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:06.615429 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e876fdc3-c8b3-4a48-b198-379f11949fed None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:06.615429 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e876fdc3-c8b3-4a48-b198-379f11949fed None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:06.615769 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e876fdc3-c8b3-4a48-b198-379f11949fed None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:29:06.615769 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e876fdc3-c8b3-4a48-b198-379f11949fed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:06.615769 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e876fdc3-c8b3-4a48-b198-379f11949fed None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:06.627727 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 547/1088] 10.222.0.70 () {56 vars in 1115 bytes} [Tue Aug 2 21:29:06 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:29:06.633531 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478f74cb-b3a0-484c-95fa-7deaba0dd46d None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:06.740904 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478f74cb-b3a0-484c-95fa-7deaba0dd46d None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:06.759806 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:29:06.778963 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f43476-81b9-4370-ab96-33d1ba332023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:06.779615 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f43476-81b9-4370-ab96-33d1ba332023 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:06.779898 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f43476-81b9-4370-ab96-33d1ba332023 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:06.780175 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f43476-81b9-4370-ab96-33d1ba332023 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:06.790486 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f43476-81b9-4370-ab96-33d1ba332023 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:06.792524 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f43476-81b9-4370-ab96-33d1ba332023 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:06.808564 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-24f43476-81b9-4370-ab96-33d1ba332023 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:29:06.808564 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:29:06.808564 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:29:06.808564 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:29:06.808564 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:29:06.808564 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:29:06.808564 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:29:06.808564 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:29:06.808564 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:29:06.808564 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:29:06.808564 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:29:06.808564 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:29:06.808564 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:29:06.808564 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:29:06.808564 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:29:06.809501 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:29:06.809501 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:29:06.809501 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:29:06.809501 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:29:06.809501 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:29:06.809501 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:29:06.809501 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:29:06.809501 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:29:06.809501 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:29:06.809501 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:29:06.809501 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:29:06.809501 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:29:06.809501 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:29:06.809501 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:29:06.809501 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:29:06.809501 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:29:06.809501 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:29:06.810591 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:29:06.810591 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:29:06.810591 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:29:06.810591 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:29:06.810591 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 542/1089] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 2 21:29:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:29:06.815462 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e876fdc3-c8b3-4a48-b198-379f11949fed None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:06.830211 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:29:06.925579 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e876fdc3-c8b3-4a48-b198-379f11949fed None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:06.957900 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91258f9d-470c-43b8-b84d-e42c685decc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:06.958522 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91258f9d-470c-43b8-b84d-e42c685decc9 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:06.958805 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91258f9d-470c-43b8-b84d-e42c685decc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:06.959084 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91258f9d-470c-43b8-b84d-e42c685decc9 None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:06.959775 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91258f9d-470c-43b8-b84d-e42c685decc9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:29:06.960083 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91258f9d-470c-43b8-b84d-e42c685decc9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:06.961484 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91258f9d-470c-43b8-b84d-e42c685decc9 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:06.973758 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 548/1090] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 2 21:29:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:29:06.979891 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f43476-81b9-4370-ab96-33d1ba332023 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:07.085112 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f43476-81b9-4370-ab96-33d1ba332023 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:07.118873 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd6e5fd-c73b-48ff-82e8-d88329821041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:07.119497 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd6e5fd-c73b-48ff-82e8-d88329821041 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:07.119788 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd6e5fd-c73b-48ff-82e8-d88329821041 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:07.120067 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd6e5fd-c73b-48ff-82e8-d88329821041 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:07.127325 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd6e5fd-c73b-48ff-82e8-d88329821041 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:07.128811 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd6e5fd-c73b-48ff-82e8-d88329821041 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:07.139750 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-2fd6e5fd-c73b-48ff-82e8-d88329821041 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 02 21:29:07.139750 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:29:07.139750 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:29:07.139750 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:29:07.139750 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:29:07.139750 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:29:07.139750 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:29:07.139750 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:29:07.139750 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:29:07.139750 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:29:07.139750 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:29:07.139750 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:29:07.139750 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 21:29:07.139750 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 21:29:07.139750 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 21:29:07.139750 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 21:29:07.140751 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:29:07.140751 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:29:07.140751 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 21:29:07.140751 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:29:07.140751 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 21:29:07.140751 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:29:07.140751 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:29:07.140751 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:29:07.140751 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:29:07.140751 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:29:07.140751 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:29:07.140751 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:29:07.140751 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:29:07.140751 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:29:07.140751 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:29:07.140751 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:29:07.140751 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:29:07.140751 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:29:07.141718 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:29:07.141718 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:29:07.141718 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 21:29:07.141718 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 21:29:07.141718 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 21:29:07.141718 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 21:29:07.141718 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 21:29:07.141718 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 21:29:07.141718 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 02 21:29:07.141718 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:29:07.141718 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 543/1091] 10.222.0.70 () {56 vars in 1093 bytes} [Tue Aug 2 21:29:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 21:29:07.146597 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91258f9d-470c-43b8-b84d-e42c685decc9 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:07.214817 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:29:07.244316 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91258f9d-470c-43b8-b84d-e42c685decc9 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:07.277360 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8d5d2f-9ab4-4931-8243-0d987aad7090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:07.277965 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8d5d2f-9ab4-4931-8243-0d987aad7090 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:07.278245 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8d5d2f-9ab4-4931-8243-0d987aad7090 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:07.278517 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8d5d2f-9ab4-4931-8243-0d987aad7090 None admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:07.279294 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8d5d2f-9ab4-4931-8243-0d987aad7090 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:29:07.279599 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8d5d2f-9ab4-4931-8243-0d987aad7090 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:07.281042 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8d5d2f-9ab4-4931-8243-0d987aad7090 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:07.298142 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 549/1092] 10.222.0.70 () {56 vars in 1133 bytes} [Tue Aug 2 21:29:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:29:07.303850 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd6e5fd-c73b-48ff-82e8-d88329821041 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:07.334271 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:29:07.403488 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd6e5fd-c73b-48ff-82e8-d88329821041 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:07.435697 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1b7261-c044-443e-94a4-fbd1eb690f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:07.436371 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1b7261-c044-443e-94a4-fbd1eb690f58 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:07.436660 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1b7261-c044-443e-94a4-fbd1eb690f58 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:07.436941 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1b7261-c044-443e-94a4-fbd1eb690f58 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:07.502649 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1b7261-c044-443e-94a4-fbd1eb690f58 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:07.504032 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1b7261-c044-443e-94a4-fbd1eb690f58 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:07.532951 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:29:07.603868 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 544/1093] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 2 21:29:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 21:29:07.609616 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8d5d2f-9ab4-4931-8243-0d987aad7090 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:07.708489 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8d5d2f-9ab4-4931-8243-0d987aad7090 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:07.734980 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:29:07.743345 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc5f1f7-2695-45c1-95ae-56507e19de7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:07.744545 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc5f1f7-2695-45c1-95ae-56507e19de7d None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:07.744831 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc5f1f7-2695-45c1-95ae-56507e19de7d None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:07.745104 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc5f1f7-2695-45c1-95ae-56507e19de7d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:07.754988 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc5f1f7-2695-45c1-95ae-56507e19de7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:07.756415 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc5f1f7-2695-45c1-95ae-56507e19de7d None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:07.771402 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-fdc5f1f7-2695-45c1-95ae-56507e19de7d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:29:07.771402 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:29:07.771402 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:29:07.771402 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:29:07.771402 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:29:07.771402 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:29:07.771402 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:29:07.771402 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:29:07.771402 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:29:07.771402 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:29:07.771402 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:29:07.771402 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:29:07.771402 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:29:07.771402 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:29:07.771402 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:29:07.772611 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:29:07.772611 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:29:07.772611 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:29:07.772611 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:29:07.772611 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:29:07.772611 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:29:07.772611 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:29:07.772611 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:29:07.772611 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:29:07.772611 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:29:07.772611 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:29:07.772611 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:29:07.772611 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:29:07.772611 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:29:07.772611 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:29:07.772611 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:29:07.772611 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:29:07.773665 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:29:07.773665 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:29:07.773665 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:29:07.773665 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:29:07.773665 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 550/1094] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 2 21:29:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 21:29:07.778276 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1b7261-c044-443e-94a4-fbd1eb690f58 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:07.876449 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1b7261-c044-443e-94a4-fbd1eb690f58 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:07.905263 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:29:07.911581 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554ca0c3-365a-4aa5-8506-818c24155c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:07.912196 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554ca0c3-365a-4aa5-8506-818c24155c39 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:07.912555 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554ca0c3-365a-4aa5-8506-818c24155c39 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:07.912835 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554ca0c3-365a-4aa5-8506-818c24155c39 None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:07.913526 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554ca0c3-365a-4aa5-8506-818c24155c39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:29:07.913836 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554ca0c3-365a-4aa5-8506-818c24155c39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:07.915214 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554ca0c3-365a-4aa5-8506-818c24155c39 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:07.924325 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91439f8c-15d7-4734-b4ec-714e5afc1e93 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:07.924627 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91439f8c-15d7-4734-b4ec-714e5afc1e93 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:07.924906 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91439f8c-15d7-4734-b4ec-714e5afc1e93 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:07.926247 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 551/1095] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:29:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 21:29:07.931254 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bd9a67-9b44-45ca-9311-610cae57bcc1 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:07.932942 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bd9a67-9b44-45ca-9311-610cae57bcc1 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:07.933068 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 545/1096] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 2 21:29:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:29:07.933159 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bd9a67-9b44-45ca-9311-610cae57bcc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:07.937276 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554ca0c3-365a-4aa5-8506-818c24155c39 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:07.950064 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-e9bd9a67-9b44-45ca-9311-610cae57bcc1 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:29:07.951252 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-e9bd9a67-9b44-45ca-9311-610cae57bcc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:29:08.017351 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 552/1097] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:29:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 21:29:08.035178 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554ca0c3-365a-4aa5-8506-818c24155c39 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:08.040254 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bd9a67-9b44-45ca-9311-610cae57bcc1 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:08.069106 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b0773d-dbca-46be-8954-70bba97ad279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:08.069748 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b0773d-dbca-46be-8954-70bba97ad279 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:08.070034 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b0773d-dbca-46be-8954-70bba97ad279 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:08.070313 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b0773d-dbca-46be-8954-70bba97ad279 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:08.076886 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b0773d-dbca-46be-8954-70bba97ad279 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:08.078328 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b0773d-dbca-46be-8954-70bba97ad279 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:08.090606 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-07b0773d-dbca-46be-8954-70bba97ad279 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:29:08.090606 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:29:08.090606 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:29:08.090606 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:29:08.090606 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:29:08.090606 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:29:08.090606 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:29:08.090606 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:29:08.090606 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:29:08.090606 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:29:08.090606 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:29:08.090606 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:29:08.090606 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 21:29:08.090606 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 21:29:08.090606 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 21:29:08.092012 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 21:29:08.092012 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:29:08.092012 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:29:08.092012 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:29:08.092012 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:29:08.092012 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:29:08.092012 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:29:08.092012 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:29:08.092012 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:29:08.092012 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:29:08.092012 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:29:08.092012 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:29:08.092012 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:29:08.092012 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:29:08.092012 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:29:08.092012 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:29:08.092012 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:29:08.092977 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 21:29:08.092977 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 21:29:08.092977 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 21:29:08.092977 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 21:29:08.092977 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 21:29:08.092977 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 21:29:08.092977 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:29:08.092977 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:29:08.092977 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 546/1098] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Aug 2 21:29:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 21:29:08.097490 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b0773d-dbca-46be-8954-70bba97ad279 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:08.140386 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bd9a67-9b44-45ca-9311-610cae57bcc1 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:08.148334 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:29:08.151208 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:29:08.174874 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2548276-e4e9-4cd7-a566-31a742a4afe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:08.175515 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2548276-e4e9-4cd7-a566-31a742a4afe1 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:08.175798 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2548276-e4e9-4cd7-a566-31a742a4afe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:08.176075 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2548276-e4e9-4cd7-a566-31a742a4afe1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:08.186988 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2548276-e4e9-4cd7-a566-31a742a4afe1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:29:08.191848 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-a2548276-e4e9-4cd7-a566-31a742a4afe1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 21:29:08.191848 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:29:08.191848 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:29:08.191848 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:29:08.191848 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:29:08.191848 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:29:08.191848 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:29:08.191848 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:29:08.191848 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:29:08.191848 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:29:08.191848 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:29:08.191848 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:29:08.191848 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:29:08.191848 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:29:08.191848 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:29:08.191848 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:29:08.192825 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:29:08.192825 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:29:08.192825 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:29:08.192825 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:29:08.192825 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:29:08.192825 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:29:08.192825 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:29:08.192825 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:29:08.192825 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:29:08.192825 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:29:08.192825 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:29:08.192825 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:29:08.192825 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:29:08.192825 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:29:08.192825 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:29:08.192825 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:29:08.193692 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:29:08.193692 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:29:08.193692 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:29:08.193692 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:29:08.193692 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:29:08.193692 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:29:08.193692 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:29:08.193692 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:29:08.193692 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:29:08.193692 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:29:08.193692 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 21:29:08.193692 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:29:08.193692 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 553/1099] 10.222.0.70 () {56 vars in 1096 bytes} [Tue Aug 2 21:29:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 21:29:08.199511 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2548276-e4e9-4cd7-a566-31a742a4afe1 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:08.200374 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b0773d-dbca-46be-8954-70bba97ad279 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:08.233750 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046c2b2e-d513-4a68-a4c0-88089f705784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:08.234369 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046c2b2e-d513-4a68-a4c0-88089f705784 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:08.234649 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046c2b2e-d513-4a68-a4c0-88089f705784 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:08.234926 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046c2b2e-d513-4a68-a4c0-88089f705784 None admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:08.235670 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046c2b2e-d513-4a68-a4c0-88089f705784 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:29:08.235981 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046c2b2e-d513-4a68-a4c0-88089f705784 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:08.237448 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046c2b2e-d513-4a68-a4c0-88089f705784 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:08.249352 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 547/1100] 10.222.0.70 () {56 vars in 1148 bytes} [Tue Aug 2 21:29:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:29:08.255299 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046c2b2e-d513-4a68-a4c0-88089f705784 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:08.299281 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2548276-e4e9-4cd7-a566-31a742a4afe1 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:08.333883 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c02df0-4718-4b76-9f85-e7ca4c0659f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:08.334502 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c02df0-4718-4b76-9f85-e7ca4c0659f7 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:08.334788 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c02df0-4718-4b76-9f85-e7ca4c0659f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:08.335068 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c02df0-4718-4b76-9f85-e7ca4c0659f7 None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:08.335787 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c02df0-4718-4b76-9f85-e7ca4c0659f7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:29:08.336096 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c02df0-4718-4b76-9f85-e7ca4c0659f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:08.337518 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c02df0-4718-4b76-9f85-e7ca4c0659f7 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:08.345443 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 554/1101] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 2 21:29:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:29:08.351253 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c02df0-4718-4b76-9f85-e7ca4c0659f7 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:08.357350 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046c2b2e-d513-4a68-a4c0-88089f705784 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:08.368318 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:29:08.382317 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:29:08.393503 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bc5b45-069f-4a63-b263-db5f08204728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:08.394124 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bc5b45-069f-4a63-b263-db5f08204728 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:08.394404 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bc5b45-069f-4a63-b263-db5f08204728 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:08.394680 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bc5b45-069f-4a63-b263-db5f08204728 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:08.395461 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bc5b45-069f-4a63-b263-db5f08204728 None admin] RBAC: Adding query filter params (role.id=13e24a71ee30450ab0dfa871704b0520, scope.project.id=42672e04d6ce4b0ab5f7eccfb0cc946c, user.id=87dd5c1c5e854d4b96e0b7dad6aa3719) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:29:08.395773 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bc5b45-069f-4a63-b263-db5f08204728 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:08.397239 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bc5b45-069f-4a63-b263-db5f08204728 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:08.402917 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 548/1102] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Aug 2 21:29:08 2022] GET /identity/v3/role_assignments?user.id=87dd5c1c5e854d4b96e0b7dad6aa3719&scope.project.id=42672e04d6ce4b0ab5f7eccfb0cc946c&role.id=13e24a71ee30450ab0dfa871704b0520 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:29:08.454399 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c02df0-4718-4b76-9f85-e7ca4c0659f7 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:08.490099 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6540633-cf8c-483d-a323-359208868f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:08.490745 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6540633-cf8c-483d-a323-359208868f78 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:08.491023 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6540633-cf8c-483d-a323-359208868f78 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:08.491297 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6540633-cf8c-483d-a323-359208868f78 None admin] PATH_INFO: `/v3/users/5f4efd65f7004fa2ad9fc8c8dd1eca2f` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:08.492710 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6540633-cf8c-483d-a323-359208868f78 None admin] RBAC: Authorizing `identity:get_user(user_id=5f4efd65f7004fa2ad9fc8c8dd1eca2f)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:08.494703 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6540633-cf8c-483d-a323-359208868f78 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:08.496360 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 555/1103] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Aug 2 21:29:08 2022] GET /identity/v3/users/5f4efd65f7004fa2ad9fc8c8dd1eca2f => generated 285 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:29:08.502277 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bc5b45-069f-4a63-b263-db5f08204728 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:08.604343 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bc5b45-069f-4a63-b263-db5f08204728 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:08.638989 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f3cd70-a0f6-411d-863c-fa9882beb159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:08.639618 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f3cd70-a0f6-411d-863c-fa9882beb159 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:08.639906 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f3cd70-a0f6-411d-863c-fa9882beb159 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:08.640186 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f3cd70-a0f6-411d-863c-fa9882beb159 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:08.683366 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:29:08.708931 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f3cd70-a0f6-411d-863c-fa9882beb159 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:08.710400 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f3cd70-a0f6-411d-863c-fa9882beb159 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:08.811423 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 549/1104] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 2 21:29:08 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 21:29:08.818050 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6540633-cf8c-483d-a323-359208868f78 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:08.918600 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:29:08.921787 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6540633-cf8c-483d-a323-359208868f78 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:08.957244 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e108a027-4288-46d5-ba1b-32e021febb47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:08.957925 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e108a027-4288-46d5-ba1b-32e021febb47 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:08.958192 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e108a027-4288-46d5-ba1b-32e021febb47 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:08.958467 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e108a027-4288-46d5-ba1b-32e021febb47 None admin] PATH_INFO: `/v3/projects/21d3e3d48c7b46a9ba1d8fc2ae85eaf7` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:08.959618 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e108a027-4288-46d5-ba1b-32e021febb47 None admin] RBAC: Authorizing `identity:get_project(project_id=21d3e3d48c7b46a9ba1d8fc2ae85eaf7)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:08.961101 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e108a027-4288-46d5-ba1b-32e021febb47 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:08.963336 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 556/1105] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Aug 2 21:29:08 2022] GET /identity/v3/projects/21d3e3d48c7b46a9ba1d8fc2ae85eaf7 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:29:08.969709 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f3cd70-a0f6-411d-863c-fa9882beb159 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:09.047225 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:29:09.074453 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f3cd70-a0f6-411d-863c-fa9882beb159 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:09.108685 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183a8775-ed5f-45af-a63f-ae2bd0ca71c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:09.109360 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183a8775-ed5f-45af-a63f-ae2bd0ca71c0 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:09.109651 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183a8775-ed5f-45af-a63f-ae2bd0ca71c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:09.109929 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183a8775-ed5f-45af-a63f-ae2bd0ca71c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:09.110715 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183a8775-ed5f-45af-a63f-ae2bd0ca71c0 None admin] RBAC: Adding query filter params (role.id=3e32dbf75f9b41f5adb9fe59851267bb, scope.project.id=21d3e3d48c7b46a9ba1d8fc2ae85eaf7, user.id=5f4efd65f7004fa2ad9fc8c8dd1eca2f) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:29:09.111027 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183a8775-ed5f-45af-a63f-ae2bd0ca71c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:09.112482 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183a8775-ed5f-45af-a63f-ae2bd0ca71c0 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:09.119282 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 550/1106] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Aug 2 21:29:08 2022] GET /identity/v3/role_assignments?user.id=5f4efd65f7004fa2ad9fc8c8dd1eca2f&scope.project.id=21d3e3d48c7b46a9ba1d8fc2ae85eaf7&role.id=3e32dbf75f9b41f5adb9fe59851267bb => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:29:11.126986 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e277e4e1-247e-4e29-a7e3-d429fb5ca5e9 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:11.127555 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e277e4e1-247e-4e29-a7e3-d429fb5ca5e9 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:11.127555 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e277e4e1-247e-4e29-a7e3-d429fb5ca5e9 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:11.128911 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 557/1107] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:29:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:29:11.134097 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bea2f8-9210-43fc-8998-cbe8e4ad7ed2 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:11.134481 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bea2f8-9210-43fc-8998-cbe8e4ad7ed2 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:11.134691 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bea2f8-9210-43fc-8998-cbe8e4ad7ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:11.153165 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-e0bea2f8-9210-43fc-8998-cbe8e4ad7ed2 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:29:11.154361 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-e0bea2f8-9210-43fc-8998-cbe8e4ad7ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:29:11.219434 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 551/1108] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:29:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 21:29:11.244587 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e277e4e1-247e-4e29-a7e3-d429fb5ca5e9 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:11.342846 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e277e4e1-247e-4e29-a7e3-d429fb5ca5e9 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:11.375299 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440c9830-e3b8-4aba-b0b9-e70015df8d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:11.375921 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440c9830-e3b8-4aba-b0b9-e70015df8d05 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:11.376197 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440c9830-e3b8-4aba-b0b9-e70015df8d05 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:11.376495 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440c9830-e3b8-4aba-b0b9-e70015df8d05 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:11.377677 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440c9830-e3b8-4aba-b0b9-e70015df8d05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:11.379029 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440c9830-e3b8-4aba-b0b9-e70015df8d05 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:11.380616 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 558/1109] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 2 21:29:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:29:11.386364 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bea2f8-9210-43fc-8998-cbe8e4ad7ed2 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:11.453075 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:29:11.490967 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bea2f8-9210-43fc-8998-cbe8e4ad7ed2 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:11.525859 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2335392-aaed-42f8-977f-fb395a37f4db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:11.526468 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2335392-aaed-42f8-977f-fb395a37f4db None admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:11.526750 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2335392-aaed-42f8-977f-fb395a37f4db None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:11.527025 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2335392-aaed-42f8-977f-fb395a37f4db None admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:11.527710 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2335392-aaed-42f8-977f-fb395a37f4db None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:11.529186 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2335392-aaed-42f8-977f-fb395a37f4db None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:11.550079 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 552/1110] 10.222.0.70 () {60 vars in 1132 bytes} [Tue Aug 2 21:29:11 2022] POST /identity/v3/users => generated 286 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:29:13.584563 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca1964f-95ba-49e3-b752-be86f39e2d38 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:13.585082 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca1964f-95ba-49e3-b752-be86f39e2d38 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:13.585082 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca1964f-95ba-49e3-b752-be86f39e2d38 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:13.586386 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 559/1111] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:29:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:29:13.591910 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f81d28c-9120-411b-acef-2bb2ca769a7c None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:13.592342 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f81d28c-9120-411b-acef-2bb2ca769a7c None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:13.592500 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f81d28c-9120-411b-acef-2bb2ca769a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:13.610252 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-9f81d28c-9120-411b-acef-2bb2ca769a7c None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:29:13.611438 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-9f81d28c-9120-411b-acef-2bb2ca769a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:29:13.676347 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 553/1112] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:29:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 21:29:13.699973 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca1964f-95ba-49e3-b752-be86f39e2d38 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:13.734693 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:29:13.802979 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca1964f-95ba-49e3-b752-be86f39e2d38 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:13.836671 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4040c9-4bfe-4d5c-b930-c5e8af1d78c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:13.837235 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4040c9-4bfe-4d5c-b930-c5e8af1d78c9 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:13.837574 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4040c9-4bfe-4d5c-b930-c5e8af1d78c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:13.837854 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4040c9-4bfe-4d5c-b930-c5e8af1d78c9 None admin] PATH_INFO: `/v3/roles/14ed906e656a4c1cabd17ceae4a1f872` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:13.839300 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4040c9-4bfe-4d5c-b930-c5e8af1d78c9 None admin] RBAC: Authorizing `identity:get_role(role_id=14ed906e656a4c1cabd17ceae4a1f872)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:13.840690 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b4040c9-4bfe-4d5c-b930-c5e8af1d78c9 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:13.842018 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 560/1113] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Aug 2 21:29:13 2022] GET /identity/v3/roles/14ed906e656a4c1cabd17ceae4a1f872 => generated 223 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:29:13.847929 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f81d28c-9120-411b-acef-2bb2ca769a7c None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:13.905762 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:29:13.953531 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f81d28c-9120-411b-acef-2bb2ca769a7c None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:13.987259 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c111424-e919-4590-a9ed-a12c40c22d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:13.987888 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c111424-e919-4590-a9ed-a12c40c22d9a None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:13.988168 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c111424-e919-4590-a9ed-a12c40c22d9a None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:13.988722 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c111424-e919-4590-a9ed-a12c40c22d9a None admin] PATH_INFO: `/v3/users/cd379d80f7b1434c980628a9f7ca55b5` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:14.002166 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c111424-e919-4590-a9ed-a12c40c22d9a None admin] RBAC: Authorizing `identity:get_user(user_id=cd379d80f7b1434c980628a9f7ca55b5)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:14.003683 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c111424-e919-4590-a9ed-a12c40c22d9a None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:14.005359 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 554/1114] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Aug 2 21:29:13 2022] GET /identity/v3/users/cd379d80f7b1434c980628a9f7ca55b5 => generated 286 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:29:14.011740 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4040c9-4bfe-4d5c-b930-c5e8af1d78c9 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:14.115118 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b4040c9-4bfe-4d5c-b930-c5e8af1d78c9 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:14.117488 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:29:14.152538 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5308c89c-6734-4c65-8015-8fae08b0b1c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:14.153157 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5308c89c-6734-4c65-8015-8fae08b0b1c4 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:14.153441 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5308c89c-6734-4c65-8015-8fae08b0b1c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:14.153717 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5308c89c-6734-4c65-8015-8fae08b0b1c4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:14.223218 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5308c89c-6734-4c65-8015-8fae08b0b1c4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:14.224710 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5308c89c-6734-4c65-8015-8fae08b0b1c4 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:14.334488 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 561/1115] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 2 21:29:14 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 21:29:14.340540 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c111424-e919-4590-a9ed-a12c40c22d9a None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:14.438342 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c111424-e919-4590-a9ed-a12c40c22d9a None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:14.451908 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:29:14.473687 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b6a04e-8a64-4bb3-9cca-22de4474dc5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:14.474318 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b6a04e-8a64-4bb3-9cca-22de4474dc5c None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:14.474598 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b6a04e-8a64-4bb3-9cca-22de4474dc5c None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:14.474868 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b6a04e-8a64-4bb3-9cca-22de4474dc5c None admin] PATH_INFO: `/v3/projects/21d3e3d48c7b46a9ba1d8fc2ae85eaf7` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:14.475998 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b6a04e-8a64-4bb3-9cca-22de4474dc5c None admin] RBAC: Authorizing `identity:get_project(project_id=21d3e3d48c7b46a9ba1d8fc2ae85eaf7)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:14.477455 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b6a04e-8a64-4bb3-9cca-22de4474dc5c None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:14.479232 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 555/1116] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Aug 2 21:29:14 2022] GET /identity/v3/projects/21d3e3d48c7b46a9ba1d8fc2ae85eaf7 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:29:14.485476 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5308c89c-6734-4c65-8015-8fae08b0b1c4 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:14.488860 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:29:14.588190 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5308c89c-6734-4c65-8015-8fae08b0b1c4 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:14.622823 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d184af2a-e8b0-4652-a3f1-41ddfb5d09e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:14.623431 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d184af2a-e8b0-4652-a3f1-41ddfb5d09e8 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:14.623717 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d184af2a-e8b0-4652-a3f1-41ddfb5d09e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:14.623995 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d184af2a-e8b0-4652-a3f1-41ddfb5d09e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:14.624808 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d184af2a-e8b0-4652-a3f1-41ddfb5d09e8 None admin] RBAC: Adding query filter params (role.id=14ed906e656a4c1cabd17ceae4a1f872, scope.project.id=21d3e3d48c7b46a9ba1d8fc2ae85eaf7, user.id=cd379d80f7b1434c980628a9f7ca55b5) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:29:14.625124 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d184af2a-e8b0-4652-a3f1-41ddfb5d09e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:14.626545 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d184af2a-e8b0-4652-a3f1-41ddfb5d09e8 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:14.631874 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 562/1117] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Aug 2 21:29:14 2022] GET /identity/v3/role_assignments?user.id=cd379d80f7b1434c980628a9f7ca55b5&scope.project.id=21d3e3d48c7b46a9ba1d8fc2ae85eaf7&role.id=14ed906e656a4c1cabd17ceae4a1f872 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:29:16.607028 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caa8a6d-b0d8-42d9-a045-40c349f07539 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:16.607571 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caa8a6d-b0d8-42d9-a045-40c349f07539 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:16.607571 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caa8a6d-b0d8-42d9-a045-40c349f07539 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:16.608885 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 556/1118] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:29:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:29:16.614235 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6406e159-0823-4996-b1fe-43a8ce2a0b85 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:16.614661 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6406e159-0823-4996-b1fe-43a8ce2a0b85 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:16.614788 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6406e159-0823-4996-b1fe-43a8ce2a0b85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:16.632490 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-6406e159-0823-4996-b1fe-43a8ce2a0b85 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:29:16.633681 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-6406e159-0823-4996-b1fe-43a8ce2a0b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:29:16.693290 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:29:16.699593 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 563/1119] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:29:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 21:29:16.721275 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caa8a6d-b0d8-42d9-a045-40c349f07539 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:16.819066 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caa8a6d-b0d8-42d9-a045-40c349f07539 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:16.852144 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da27eb68-e4c2-4a74-88f8-578341e8b4e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:16.852786 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da27eb68-e4c2-4a74-88f8-578341e8b4e7 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:16.853118 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da27eb68-e4c2-4a74-88f8-578341e8b4e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:16.853397 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da27eb68-e4c2-4a74-88f8-578341e8b4e7 None admin] PATH_INFO: `/v3/roles/14ed906e656a4c1cabd17ceae4a1f872` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:16.854819 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da27eb68-e4c2-4a74-88f8-578341e8b4e7 None admin] RBAC: Authorizing `identity:get_role(role_id=14ed906e656a4c1cabd17ceae4a1f872)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:16.856167 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da27eb68-e4c2-4a74-88f8-578341e8b4e7 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:16.857549 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 557/1120] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Aug 2 21:29:16 2022] GET /identity/v3/roles/14ed906e656a4c1cabd17ceae4a1f872 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:29:16.863217 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6406e159-0823-4996-b1fe-43a8ce2a0b85 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:16.958355 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6406e159-0823-4996-b1fe-43a8ce2a0b85 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:16.990821 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff6c67e-56e3-4f14-9120-f88d449dd8d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:16.991436 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff6c67e-56e3-4f14-9120-f88d449dd8d5 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:16.991710 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff6c67e-56e3-4f14-9120-f88d449dd8d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:16.991981 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff6c67e-56e3-4f14-9120-f88d449dd8d5 None admin] PATH_INFO: `/v3/users/cd379d80f7b1434c980628a9f7ca55b5` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:16.993202 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff6c67e-56e3-4f14-9120-f88d449dd8d5 None admin] RBAC: Authorizing `identity:get_user(user_id=cd379d80f7b1434c980628a9f7ca55b5)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:16.995198 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff6c67e-56e3-4f14-9120-f88d449dd8d5 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:16.996827 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 564/1121] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Aug 2 21:29:16 2022] GET /identity/v3/users/cd379d80f7b1434c980628a9f7ca55b5 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:29:17.002292 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da27eb68-e4c2-4a74-88f8-578341e8b4e7 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:17.049589 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:29:17.097881 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da27eb68-e4c2-4a74-88f8-578341e8b4e7 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:17.131322 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e92e244-a9a0-4b88-b4bb-f12a0de7035f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:17.131892 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e92e244-a9a0-4b88-b4bb-f12a0de7035f None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:17.132174 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e92e244-a9a0-4b88-b4bb-f12a0de7035f None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:17.132476 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e92e244-a9a0-4b88-b4bb-f12a0de7035f None admin] PATH_INFO: `/v3/projects/21d3e3d48c7b46a9ba1d8fc2ae85eaf7` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:17.133699 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e92e244-a9a0-4b88-b4bb-f12a0de7035f None admin] RBAC: Authorizing `identity:get_project(project_id=21d3e3d48c7b46a9ba1d8fc2ae85eaf7)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:17.135241 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e92e244-a9a0-4b88-b4bb-f12a0de7035f None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:17.136941 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 558/1122] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Aug 2 21:29:17 2022] GET /identity/v3/projects/21d3e3d48c7b46a9ba1d8fc2ae85eaf7 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:29:17.142809 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff6c67e-56e3-4f14-9120-f88d449dd8d5 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:17.205766 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:29:17.239560 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff6c67e-56e3-4f14-9120-f88d449dd8d5 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:17.272634 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb85432f-cfa6-47e5-a15a-8284b71af306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:17.273289 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb85432f-cfa6-47e5-a15a-8284b71af306 None admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:17.273572 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb85432f-cfa6-47e5-a15a-8284b71af306 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:17.273851 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb85432f-cfa6-47e5-a15a-8284b71af306 None admin] PATH_INFO: `/v3/projects/21d3e3d48c7b46a9ba1d8fc2ae85eaf7/users/cd379d80f7b1434c980628a9f7ca55b5/roles/14ed906e656a4c1cabd17ceae4a1f872` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:17.276018 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb85432f-cfa6-47e5-a15a-8284b71af306 None admin] RBAC: Authorizing `identity:create_grant(project_id=21d3e3d48c7b46a9ba1d8fc2ae85eaf7, user_id=cd379d80f7b1434c980628a9f7ca55b5, role_id=14ed906e656a4c1cabd17ceae4a1f872)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:17.277480 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb85432f-cfa6-47e5-a15a-8284b71af306 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:17.289795 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 565/1123] 10.222.0.70 () {58 vars in 1439 bytes} [Tue Aug 2 21:29:17 2022] PUT /identity/v3/projects/21d3e3d48c7b46a9ba1d8fc2ae85eaf7/users/cd379d80f7b1434c980628a9f7ca55b5/roles/14ed906e656a4c1cabd17ceae4a1f872 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:29:19.254871 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac97c76-1e3a-4813-bd69-7c1d1d8bc72a None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:19.255422 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac97c76-1e3a-4813-bd69-7c1d1d8bc72a None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:19.255422 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac97c76-1e3a-4813-bd69-7c1d1d8bc72a None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:19.256826 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 559/1124] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:29:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:29:19.262509 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a7c564-39cb-4239-a4e5-0b2d53cfa567 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:19.262910 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a7c564-39cb-4239-a4e5-0b2d53cfa567 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:19.263066 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a7c564-39cb-4239-a4e5-0b2d53cfa567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:19.281482 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-68a7c564-39cb-4239-a4e5-0b2d53cfa567 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:29:19.282676 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-68a7c564-39cb-4239-a4e5-0b2d53cfa567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:29:19.348126 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 566/1125] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:29:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 21:29:19.371125 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac97c76-1e3a-4813-bd69-7c1d1d8bc72a None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:19.470324 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac97c76-1e3a-4813-bd69-7c1d1d8bc72a None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:19.486190 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:29:19.504038 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bec2600-68d3-43f5-87d8-796f6d4a303c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:19.504695 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bec2600-68d3-43f5-87d8-796f6d4a303c None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:19.505028 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bec2600-68d3-43f5-87d8-796f6d4a303c None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:19.505255 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bec2600-68d3-43f5-87d8-796f6d4a303c None admin] PATH_INFO: `/v3/roles/14ed906e656a4c1cabd17ceae4a1f872` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:19.506686 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bec2600-68d3-43f5-87d8-796f6d4a303c None admin] RBAC: Authorizing `identity:get_role(role_id=14ed906e656a4c1cabd17ceae4a1f872)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:19.508048 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bec2600-68d3-43f5-87d8-796f6d4a303c None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:19.509955 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 560/1126] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Aug 2 21:29:19 2022] GET /identity/v3/roles/14ed906e656a4c1cabd17ceae4a1f872 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:29:19.515802 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a7c564-39cb-4239-a4e5-0b2d53cfa567 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:19.574819 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:29:19.618294 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a7c564-39cb-4239-a4e5-0b2d53cfa567 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:19.651971 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9558a918-a39e-4efc-ad61-0f7b5c7bd6c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:19.652641 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9558a918-a39e-4efc-ad61-0f7b5c7bd6c9 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:19.652927 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9558a918-a39e-4efc-ad61-0f7b5c7bd6c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:19.653206 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9558a918-a39e-4efc-ad61-0f7b5c7bd6c9 None admin] PATH_INFO: `/v3/users/cd379d80f7b1434c980628a9f7ca55b5` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:19.654370 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9558a918-a39e-4efc-ad61-0f7b5c7bd6c9 None admin] RBAC: Authorizing `identity:get_user(user_id=cd379d80f7b1434c980628a9f7ca55b5)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:19.655795 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9558a918-a39e-4efc-ad61-0f7b5c7bd6c9 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:19.657420 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 567/1127] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Aug 2 21:29:19 2022] GET /identity/v3/users/cd379d80f7b1434c980628a9f7ca55b5 => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:29:19.663318 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bec2600-68d3-43f5-87d8-796f6d4a303c None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:19.758559 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bec2600-68d3-43f5-87d8-796f6d4a303c None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:19.790957 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421c8d54-e39e-41e8-96e7-39ad5ff9e6ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:19.791559 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421c8d54-e39e-41e8-96e7-39ad5ff9e6ea None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:19.791843 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421c8d54-e39e-41e8-96e7-39ad5ff9e6ea None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:19.792118 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421c8d54-e39e-41e8-96e7-39ad5ff9e6ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:19.841723 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:29:19.856908 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421c8d54-e39e-41e8-96e7-39ad5ff9e6ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:19.858355 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421c8d54-e39e-41e8-96e7-39ad5ff9e6ea None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:19.953130 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 561/1128] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 2 21:29:19 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 21:29:19.958924 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9558a918-a39e-4efc-ad61-0f7b5c7bd6c9 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:20.056024 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9558a918-a39e-4efc-ad61-0f7b5c7bd6c9 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:20.080375 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:29:20.091340 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720548bb-381f-4af7-8304-abf4a24c5d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:20.091970 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720548bb-381f-4af7-8304-abf4a24c5d89 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:20.092277 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720548bb-381f-4af7-8304-abf4a24c5d89 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:20.092558 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720548bb-381f-4af7-8304-abf4a24c5d89 None admin] PATH_INFO: `/v3/projects/21d3e3d48c7b46a9ba1d8fc2ae85eaf7` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:20.093693 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720548bb-381f-4af7-8304-abf4a24c5d89 None admin] RBAC: Authorizing `identity:get_project(project_id=21d3e3d48c7b46a9ba1d8fc2ae85eaf7)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:20.095119 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720548bb-381f-4af7-8304-abf4a24c5d89 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:20.096764 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 568/1129] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Aug 2 21:29:19 2022] GET /identity/v3/projects/21d3e3d48c7b46a9ba1d8fc2ae85eaf7 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:29:20.102803 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421c8d54-e39e-41e8-96e7-39ad5ff9e6ea None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:20.185678 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:29:20.201689 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421c8d54-e39e-41e8-96e7-39ad5ff9e6ea None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:20.235058 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26b325a-56e9-4e69-85d7-0368f4680536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:20.235669 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26b325a-56e9-4e69-85d7-0368f4680536 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:20.235954 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26b325a-56e9-4e69-85d7-0368f4680536 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:20.236252 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26b325a-56e9-4e69-85d7-0368f4680536 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:20.237042 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26b325a-56e9-4e69-85d7-0368f4680536 None admin] RBAC: Adding query filter params (role.id=14ed906e656a4c1cabd17ceae4a1f872, scope.project.id=21d3e3d48c7b46a9ba1d8fc2ae85eaf7, user.id=cd379d80f7b1434c980628a9f7ca55b5) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:29:20.237357 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26b325a-56e9-4e69-85d7-0368f4680536 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:20.239044 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26b325a-56e9-4e69-85d7-0368f4680536 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:20.245365 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 562/1130] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Aug 2 21:29:20 2022] GET /identity/v3/role_assignments?user.id=cd379d80f7b1434c980628a9f7ca55b5&scope.project.id=21d3e3d48c7b46a9ba1d8fc2ae85eaf7&role.id=14ed906e656a4c1cabd17ceae4a1f872 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:29:22.265063 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef925b0-6f17-4857-b67b-7836f99fef18 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:22.265612 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef925b0-6f17-4857-b67b-7836f99fef18 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:22.265612 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef925b0-6f17-4857-b67b-7836f99fef18 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:22.266948 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 569/1131] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:29:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:29:22.272131 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24764d33-628c-49ec-b13a-5636cd779263 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:22.272569 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24764d33-628c-49ec-b13a-5636cd779263 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:22.272729 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24764d33-628c-49ec-b13a-5636cd779263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:22.291886 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-24764d33-628c-49ec-b13a-5636cd779263 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:29:22.293119 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-24764d33-628c-49ec-b13a-5636cd779263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:29:22.358181 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 563/1132] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:29:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 21:29:22.381661 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef925b0-6f17-4857-b67b-7836f99fef18 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:22.479644 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef925b0-6f17-4857-b67b-7836f99fef18 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:22.512615 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab6257b-2a47-451b-a22b-719d0113641f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:22.513240 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab6257b-2a47-451b-a22b-719d0113641f None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:22.513522 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab6257b-2a47-451b-a22b-719d0113641f None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:22.513800 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab6257b-2a47-451b-a22b-719d0113641f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:22.514941 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab6257b-2a47-451b-a22b-719d0113641f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:22.516441 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab6257b-2a47-451b-a22b-719d0113641f None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:22.517933 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 570/1133] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 2 21:29:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:29:22.523553 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24764d33-628c-49ec-b13a-5636cd779263 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:22.598418 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:29:22.620303 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24764d33-628c-49ec-b13a-5636cd779263 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:22.653035 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151f0669-ac6e-483f-b439-ad48c0b3d60f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:22.653642 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f0669-ac6e-483f-b439-ad48c0b3d60f None admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:22.653928 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f0669-ac6e-483f-b439-ad48c0b3d60f None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:22.654205 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151f0669-ac6e-483f-b439-ad48c0b3d60f None admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:22.654878 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151f0669-ac6e-483f-b439-ad48c0b3d60f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:22.656338 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151f0669-ac6e-483f-b439-ad48c0b3d60f None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:22.682619 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 564/1134] 10.222.0.70 () {60 vars in 1141 bytes} [Tue Aug 2 21:29:22 2022] POST /identity/v3/projects => generated 311 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:29:24.702757 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f80f64-793b-416a-8845-f15ec9d26bba None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:24.703256 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f80f64-793b-416a-8845-f15ec9d26bba None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:24.703363 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f80f64-793b-416a-8845-f15ec9d26bba None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:24.704707 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 571/1135] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:29:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:29:24.709867 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f939bddd-4b02-411d-ba1b-d30cd0a20f35 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:24.710293 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f939bddd-4b02-411d-ba1b-d30cd0a20f35 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:24.710434 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f939bddd-4b02-411d-ba1b-d30cd0a20f35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:24.729284 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-f939bddd-4b02-411d-ba1b-d30cd0a20f35 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:29:24.730471 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-f939bddd-4b02-411d-ba1b-d30cd0a20f35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:29:24.799753 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 565/1136] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:29:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 21:29:24.824407 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f80f64-793b-416a-8845-f15ec9d26bba None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:24.889551 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:29:24.931291 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f80f64-793b-416a-8845-f15ec9d26bba None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:24.964541 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e5c78f-b315-4148-ba0b-a9a7638f9125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:24.965108 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e5c78f-b315-4148-ba0b-a9a7638f9125 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:24.965389 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e5c78f-b315-4148-ba0b-a9a7638f9125 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:24.965665 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e5c78f-b315-4148-ba0b-a9a7638f9125 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:24.966811 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e5c78f-b315-4148-ba0b-a9a7638f9125 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:24.968272 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e5c78f-b315-4148-ba0b-a9a7638f9125 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:24.969832 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 572/1137] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 2 21:29:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:29:24.975722 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f939bddd-4b02-411d-ba1b-d30cd0a20f35 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:25.032643 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:29:25.072289 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f939bddd-4b02-411d-ba1b-d30cd0a20f35 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:25.105401 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9db9e6-cf47-44a8-bd33-2e0f335701e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:25.106010 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9db9e6-cf47-44a8-bd33-2e0f335701e2 None admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:25.106295 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9db9e6-cf47-44a8-bd33-2e0f335701e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:25.106571 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9db9e6-cf47-44a8-bd33-2e0f335701e2 None admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:25.107242 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9db9e6-cf47-44a8-bd33-2e0f335701e2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:25.108700 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9db9e6-cf47-44a8-bd33-2e0f335701e2 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:25.128661 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 566/1138] 10.222.0.70 () {60 vars in 1132 bytes} [Tue Aug 2 21:29:24 2022] POST /identity/v3/users => generated 286 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:29:27.162900 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a5f45-5707-45f7-9fb4-b2dbfa011ec5 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:27.163452 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a5f45-5707-45f7-9fb4-b2dbfa011ec5 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:27.163452 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a5f45-5707-45f7-9fb4-b2dbfa011ec5 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:27.164840 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 573/1139] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:29:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:29:27.169891 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682affab-eb89-4b64-8ba5-d881cf091b98 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:27.170280 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682affab-eb89-4b64-8ba5-d881cf091b98 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:27.170445 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682affab-eb89-4b64-8ba5-d881cf091b98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:27.189051 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-682affab-eb89-4b64-8ba5-d881cf091b98 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:29:27.190231 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-682affab-eb89-4b64-8ba5-d881cf091b98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:29:27.261085 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 567/1140] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:29:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 21:29:27.284025 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888a5f45-5707-45f7-9fb4-b2dbfa011ec5 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:27.383213 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888a5f45-5707-45f7-9fb4-b2dbfa011ec5 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:27.409011 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:29:27.417383 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9febfc20-1170-439d-b5ac-469ade41cee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:27.417958 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9febfc20-1170-439d-b5ac-469ade41cee5 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:27.418242 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9febfc20-1170-439d-b5ac-469ade41cee5 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:27.418519 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9febfc20-1170-439d-b5ac-469ade41cee5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:27.428544 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9febfc20-1170-439d-b5ac-469ade41cee5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:29:27.433976 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-9febfc20-1170-439d-b5ac-469ade41cee5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 21:29:27.433976 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:29:27.433976 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:29:27.433976 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:29:27.433976 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:29:27.433976 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:29:27.433976 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:29:27.433976 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:29:27.433976 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:29:27.433976 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:29:27.433976 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:29:27.433976 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:29:27.433976 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:29:27.433976 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:29:27.433976 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:29:27.433976 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:29:27.435186 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:29:27.435186 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:29:27.435186 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:29:27.435186 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:29:27.435186 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:29:27.435186 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:29:27.435186 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:29:27.435186 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:29:27.435186 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:29:27.435186 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:29:27.435186 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:29:27.435186 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:29:27.435186 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:29:27.435186 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:29:27.435186 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:29:27.435186 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:29:27.436222 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:29:27.436222 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:29:27.436222 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:29:27.436222 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:29:27.436222 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:29:27.436222 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:29:27.436222 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:29:27.436222 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:29:27.436222 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:29:27.436222 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:29:27.436222 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 21:29:27.436222 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:29:27.436222 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 574/1141] 10.222.0.70 () {56 vars in 1096 bytes} [Tue Aug 2 21:29:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:29:27.441299 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682affab-eb89-4b64-8ba5-d881cf091b98 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:27.486165 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:29:27.538480 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682affab-eb89-4b64-8ba5-d881cf091b98 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:27.571933 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce87539f-3787-4ef4-bbc9-b30f50dad840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:27.572571 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce87539f-3787-4ef4-bbc9-b30f50dad840 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:27.572858 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce87539f-3787-4ef4-bbc9-b30f50dad840 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:27.573136 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce87539f-3787-4ef4-bbc9-b30f50dad840 None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:27.573853 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce87539f-3787-4ef4-bbc9-b30f50dad840 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:29:27.574162 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce87539f-3787-4ef4-bbc9-b30f50dad840 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:27.575524 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce87539f-3787-4ef4-bbc9-b30f50dad840 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:27.583327 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 568/1142] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 2 21:29:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:29:27.589046 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9febfc20-1170-439d-b5ac-469ade41cee5 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:27.687513 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9febfc20-1170-439d-b5ac-469ade41cee5 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:27.720656 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fe27df-d364-4cf7-9f04-483b416eb6ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:27.721282 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fe27df-d364-4cf7-9f04-483b416eb6ad None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:27.721564 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fe27df-d364-4cf7-9f04-483b416eb6ad None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:27.721843 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fe27df-d364-4cf7-9f04-483b416eb6ad None admin] PATH_INFO: `/v3/users/4ce4fde45a7e4ae386fa5025ff20a661` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:27.734942 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fe27df-d364-4cf7-9f04-483b416eb6ad None admin] RBAC: Authorizing `identity:get_user(user_id=4ce4fde45a7e4ae386fa5025ff20a661)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:27.736396 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fe27df-d364-4cf7-9f04-483b416eb6ad None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:27.737984 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 575/1143] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Aug 2 21:29:27 2022] GET /identity/v3/users/4ce4fde45a7e4ae386fa5025ff20a661 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:29:27.744763 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce87539f-3787-4ef4-bbc9-b30f50dad840 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:27.842792 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce87539f-3787-4ef4-bbc9-b30f50dad840 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:27.851352 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:29:27.877064 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24af675-9d31-403d-881f-03ec298ab917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:27.877670 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24af675-9d31-403d-881f-03ec298ab917 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:27.877957 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24af675-9d31-403d-881f-03ec298ab917 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:27.878236 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24af675-9d31-403d-881f-03ec298ab917 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:27.949497 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24af675-9d31-403d-881f-03ec298ab917 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:27.950893 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24af675-9d31-403d-881f-03ec298ab917 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:28.046784 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 569/1144] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 2 21:29:27 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 21:29:28.052895 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fe27df-d364-4cf7-9f04-483b416eb6ad None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:28.098040 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:29:28.151866 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fe27df-d364-4cf7-9f04-483b416eb6ad None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:28.185462 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32cc56f-15c5-45ef-9cd4-42ff6e1038cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:28.186092 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32cc56f-15c5-45ef-9cd4-42ff6e1038cf None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:28.186372 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32cc56f-15c5-45ef-9cd4-42ff6e1038cf None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:28.186648 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32cc56f-15c5-45ef-9cd4-42ff6e1038cf None admin] PATH_INFO: `/v3/projects/304767c6e2e040f08692fdeea1a0b3c9` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:28.187782 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32cc56f-15c5-45ef-9cd4-42ff6e1038cf None admin] RBAC: Authorizing `identity:get_project(project_id=304767c6e2e040f08692fdeea1a0b3c9)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:28.189232 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32cc56f-15c5-45ef-9cd4-42ff6e1038cf None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:28.190850 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 576/1145] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Aug 2 21:29:28 2022] GET /identity/v3/projects/304767c6e2e040f08692fdeea1a0b3c9 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:29:28.197416 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24af675-9d31-403d-881f-03ec298ab917 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:28.207270 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:29:28.297276 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24af675-9d31-403d-881f-03ec298ab917 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:28.330593 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842fdf55-23ef-4314-b373-476bf79c8011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:28.331208 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842fdf55-23ef-4314-b373-476bf79c8011 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:28.331498 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842fdf55-23ef-4314-b373-476bf79c8011 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:28.331774 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842fdf55-23ef-4314-b373-476bf79c8011 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:28.332587 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842fdf55-23ef-4314-b373-476bf79c8011 None admin] RBAC: Adding query filter params (role.id=3e32dbf75f9b41f5adb9fe59851267bb, scope.project.id=304767c6e2e040f08692fdeea1a0b3c9, user.id=4ce4fde45a7e4ae386fa5025ff20a661) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:29:28.332909 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842fdf55-23ef-4314-b373-476bf79c8011 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:28.334336 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842fdf55-23ef-4314-b373-476bf79c8011 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:28.340109 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 570/1146] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Aug 2 21:29:28 2022] GET /identity/v3/role_assignments?user.id=4ce4fde45a7e4ae386fa5025ff20a661&scope.project.id=304767c6e2e040f08692fdeea1a0b3c9&role.id=3e32dbf75f9b41f5adb9fe59851267bb => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:29:30.283841 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed55bed7-3914-40cc-b333-dfb695e44a78 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:30.284389 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed55bed7-3914-40cc-b333-dfb695e44a78 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:30.284497 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed55bed7-3914-40cc-b333-dfb695e44a78 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:30.285790 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 577/1147] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:29:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:29:30.291098 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1f987e-b6eb-4861-a038-01fd0b14305a None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:30.291492 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1f987e-b6eb-4861-a038-01fd0b14305a None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:30.291653 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1f987e-b6eb-4861-a038-01fd0b14305a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:30.309767 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-ee1f987e-b6eb-4861-a038-01fd0b14305a None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:29:30.310946 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-ee1f987e-b6eb-4861-a038-01fd0b14305a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:29:30.375401 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 571/1148] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:29:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 21:29:30.397824 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed55bed7-3914-40cc-b333-dfb695e44a78 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:30.497706 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed55bed7-3914-40cc-b333-dfb695e44a78 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:30.511264 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:29:30.531157 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fb83a4-5f7c-410c-960e-2f1a7a21a614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:30.531805 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb83a4-5f7c-410c-960e-2f1a7a21a614 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:30.532088 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb83a4-5f7c-410c-960e-2f1a7a21a614 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:30.532393 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fb83a4-5f7c-410c-960e-2f1a7a21a614 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:30.542827 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fb83a4-5f7c-410c-960e-2f1a7a21a614 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:29:30.547645 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-f8fb83a4-5f7c-410c-960e-2f1a7a21a614 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 21:29:30.547645 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:29:30.547645 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:29:30.547645 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:29:30.547645 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:29:30.547645 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:29:30.547645 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:29:30.547645 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:29:30.547645 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:29:30.547645 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:29:30.547645 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:29:30.547645 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:29:30.547645 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:29:30.547645 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:29:30.547645 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:29:30.547645 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:29:30.548817 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:29:30.548817 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:29:30.548817 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:29:30.548817 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:29:30.548817 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:29:30.548817 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:29:30.548817 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:29:30.548817 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:29:30.548817 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:29:30.548817 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:29:30.548817 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:29:30.548817 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:29:30.548817 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:29:30.548817 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:29:30.548817 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:29:30.548817 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:29:30.549679 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:29:30.549679 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:29:30.549679 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:29:30.549679 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:29:30.549679 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:29:30.549679 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:29:30.549679 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:29:30.549679 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:29:30.549679 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:29:30.549679 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:29:30.549679 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 21:29:30.549679 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:29:30.549679 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 578/1149] 10.222.0.70 () {56 vars in 1096 bytes} [Tue Aug 2 21:29:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:29:30.555017 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1f987e-b6eb-4861-a038-01fd0b14305a None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:30.558626 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:29:30.656428 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1f987e-b6eb-4861-a038-01fd0b14305a None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:30.689975 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85666a4e-f0ad-4a9a-9fce-90ffab804edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:30.690587 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85666a4e-f0ad-4a9a-9fce-90ffab804edd None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:30.690872 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85666a4e-f0ad-4a9a-9fce-90ffab804edd None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:30.691147 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85666a4e-f0ad-4a9a-9fce-90ffab804edd None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:30.691859 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85666a4e-f0ad-4a9a-9fce-90ffab804edd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:29:30.692166 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85666a4e-f0ad-4a9a-9fce-90ffab804edd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:30.693555 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85666a4e-f0ad-4a9a-9fce-90ffab804edd None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:30.701359 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 572/1150] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 2 21:29:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:29:30.707124 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fb83a4-5f7c-410c-960e-2f1a7a21a614 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:30.803046 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fb83a4-5f7c-410c-960e-2f1a7a21a614 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:30.835638 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1882f7-8f6d-47c0-b5e4-b36a697bfb52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:30.836283 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1882f7-8f6d-47c0-b5e4-b36a697bfb52 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:30.836562 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1882f7-8f6d-47c0-b5e4-b36a697bfb52 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:30.836833 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1882f7-8f6d-47c0-b5e4-b36a697bfb52 None admin] PATH_INFO: `/v3/users/4ce4fde45a7e4ae386fa5025ff20a661` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:30.838491 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1882f7-8f6d-47c0-b5e4-b36a697bfb52 None admin] RBAC: Authorizing `identity:get_user(user_id=4ce4fde45a7e4ae386fa5025ff20a661)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:30.839905 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1882f7-8f6d-47c0-b5e4-b36a697bfb52 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:30.841486 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 579/1151] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Aug 2 21:29:30 2022] GET /identity/v3/users/4ce4fde45a7e4ae386fa5025ff20a661 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:29:30.847048 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85666a4e-f0ad-4a9a-9fce-90ffab804edd None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:30.909880 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:29:30.950911 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85666a4e-f0ad-4a9a-9fce-90ffab804edd None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:30.983922 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cb849d-5f08-4bde-b707-bec9b237a5f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:30.984581 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cb849d-5f08-4bde-b707-bec9b237a5f3 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:30.984872 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cb849d-5f08-4bde-b707-bec9b237a5f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:30.985140 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cb849d-5f08-4bde-b707-bec9b237a5f3 None admin] PATH_INFO: `/v3/projects/304767c6e2e040f08692fdeea1a0b3c9` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:30.986338 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cb849d-5f08-4bde-b707-bec9b237a5f3 None admin] RBAC: Authorizing `identity:get_project(project_id=304767c6e2e040f08692fdeea1a0b3c9)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:30.988202 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cb849d-5f08-4bde-b707-bec9b237a5f3 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:30.990500 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 573/1152] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Aug 2 21:29:30 2022] GET /identity/v3/projects/304767c6e2e040f08692fdeea1a0b3c9 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:29:30.996568 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1882f7-8f6d-47c0-b5e4-b36a697bfb52 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:31.042164 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:29:31.096841 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1882f7-8f6d-47c0-b5e4-b36a697bfb52 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:31.129804 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530b81fa-7923-4660-84b9-49499216339d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:31.130462 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530b81fa-7923-4660-84b9-49499216339d None admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:31.130746 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530b81fa-7923-4660-84b9-49499216339d None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:31.131024 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530b81fa-7923-4660-84b9-49499216339d None admin] PATH_INFO: `/v3/projects/304767c6e2e040f08692fdeea1a0b3c9/users/4ce4fde45a7e4ae386fa5025ff20a661/roles/3e32dbf75f9b41f5adb9fe59851267bb` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:31.132972 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530b81fa-7923-4660-84b9-49499216339d None admin] RBAC: Authorizing `identity:create_grant(project_id=304767c6e2e040f08692fdeea1a0b3c9, user_id=4ce4fde45a7e4ae386fa5025ff20a661, role_id=3e32dbf75f9b41f5adb9fe59851267bb)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:31.134428 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530b81fa-7923-4660-84b9-49499216339d None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:31.147262 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 580/1153] 10.222.0.70 () {58 vars in 1439 bytes} [Tue Aug 2 21:29:30 2022] PUT /identity/v3/projects/304767c6e2e040f08692fdeea1a0b3c9/users/4ce4fde45a7e4ae386fa5025ff20a661/roles/3e32dbf75f9b41f5adb9fe59851267bb => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:29:33.114840 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9090a5-aea7-489a-b755-2363deb43726 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:33.115364 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9090a5-aea7-489a-b755-2363deb43726 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:33.115364 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9090a5-aea7-489a-b755-2363deb43726 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:33.116780 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 574/1154] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:29:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:29:33.121883 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c84af5-6ef7-44fe-a1d5-76ee28da95b6 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:33.122280 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c84af5-6ef7-44fe-a1d5-76ee28da95b6 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:33.122442 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c84af5-6ef7-44fe-a1d5-76ee28da95b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:33.140224 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-15c84af5-6ef7-44fe-a1d5-76ee28da95b6 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:29:33.141443 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-15c84af5-6ef7-44fe-a1d5-76ee28da95b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:29:33.207000 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 581/1155] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:29:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 21:29:33.229534 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9090a5-aea7-489a-b755-2363deb43726 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:33.341336 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9090a5-aea7-489a-b755-2363deb43726 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:33.369768 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:29:33.374899 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b09d211-e9f0-499d-8a12-4eb8e9a94354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:33.375528 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b09d211-e9f0-499d-8a12-4eb8e9a94354 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:33.375809 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b09d211-e9f0-499d-8a12-4eb8e9a94354 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:33.376082 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b09d211-e9f0-499d-8a12-4eb8e9a94354 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:33.386835 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b09d211-e9f0-499d-8a12-4eb8e9a94354 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:29:33.391645 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-8b09d211-e9f0-499d-8a12-4eb8e9a94354 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 21:29:33.391645 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:29:33.391645 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:29:33.391645 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:29:33.391645 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:29:33.391645 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:29:33.391645 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:29:33.391645 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:29:33.391645 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:29:33.391645 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:29:33.391645 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:29:33.391645 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:29:33.391645 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:29:33.391645 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:29:33.391645 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:29:33.391645 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:29:33.392768 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:29:33.392768 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:29:33.392768 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:29:33.392768 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:29:33.392768 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:29:33.392768 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:29:33.392768 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:29:33.392768 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:29:33.392768 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:29:33.392768 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:29:33.392768 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:29:33.392768 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:29:33.392768 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:29:33.392768 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:29:33.392768 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:29:33.392768 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:29:33.394091 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:29:33.394091 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:29:33.394091 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:29:33.394091 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:29:33.394091 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:29:33.394091 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:29:33.394091 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:29:33.394091 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:29:33.394091 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:29:33.394091 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:29:33.394091 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 21:29:33.394091 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:29:33.394091 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 575/1156] 10.222.0.70 () {56 vars in 1096 bytes} [Tue Aug 2 21:29:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:29:33.398810 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c84af5-6ef7-44fe-a1d5-76ee28da95b6 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:33.428638 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:29:33.498142 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c84af5-6ef7-44fe-a1d5-76ee28da95b6 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:33.530971 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af501b3-fd4d-4fe3-a7da-5d10e19643aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:33.531577 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af501b3-fd4d-4fe3-a7da-5d10e19643aa None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:33.531855 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af501b3-fd4d-4fe3-a7da-5d10e19643aa None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:33.532128 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af501b3-fd4d-4fe3-a7da-5d10e19643aa None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:33.532863 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af501b3-fd4d-4fe3-a7da-5d10e19643aa None admin] RBAC: Adding query filter params (name=admin) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:29:33.533165 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af501b3-fd4d-4fe3-a7da-5d10e19643aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:33.534515 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af501b3-fd4d-4fe3-a7da-5d10e19643aa None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:33.542853 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 582/1157] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 2 21:29:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:29:33.548645 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b09d211-e9f0-499d-8a12-4eb8e9a94354 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:33.646644 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b09d211-e9f0-499d-8a12-4eb8e9a94354 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:33.679096 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d6b91e-ce3d-4528-8102-1c6bf5391b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:33.679719 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d6b91e-ce3d-4528-8102-1c6bf5391b7b None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:33.680002 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d6b91e-ce3d-4528-8102-1c6bf5391b7b None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:33.680301 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d6b91e-ce3d-4528-8102-1c6bf5391b7b None admin] PATH_INFO: `/v3/users/4ce4fde45a7e4ae386fa5025ff20a661` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:33.681985 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d6b91e-ce3d-4528-8102-1c6bf5391b7b None admin] RBAC: Authorizing `identity:get_user(user_id=4ce4fde45a7e4ae386fa5025ff20a661)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:33.684642 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d6b91e-ce3d-4528-8102-1c6bf5391b7b None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:33.688831 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 576/1158] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Aug 2 21:29:33 2022] GET /identity/v3/users/4ce4fde45a7e4ae386fa5025ff20a661 => generated 286 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:29:33.694658 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af501b3-fd4d-4fe3-a7da-5d10e19643aa None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:33.785504 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:29:33.792950 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af501b3-fd4d-4fe3-a7da-5d10e19643aa None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:33.825189 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dccc26-a8bd-48e4-b8c2-20d65bd46097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:33.825789 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dccc26-a8bd-48e4-b8c2-20d65bd46097 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:33.826065 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dccc26-a8bd-48e4-b8c2-20d65bd46097 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:33.826337 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dccc26-a8bd-48e4-b8c2-20d65bd46097 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:33.890988 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dccc26-a8bd-48e4-b8c2-20d65bd46097 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:33.892461 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dccc26-a8bd-48e4-b8c2-20d65bd46097 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:33.981429 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:29:33.988998 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 583/1159] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 2 21:29:33 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 21:29:33.994958 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d6b91e-ce3d-4528-8102-1c6bf5391b7b None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:34.054385 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:29:34.093097 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d6b91e-ce3d-4528-8102-1c6bf5391b7b None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:34.125631 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4786d4-7cee-498e-af24-4dcb37ad95e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:34.126254 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4786d4-7cee-498e-af24-4dcb37ad95e4 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:34.126533 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4786d4-7cee-498e-af24-4dcb37ad95e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:34.126807 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4786d4-7cee-498e-af24-4dcb37ad95e4 None admin] PATH_INFO: `/v3/projects/304767c6e2e040f08692fdeea1a0b3c9` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:34.127944 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4786d4-7cee-498e-af24-4dcb37ad95e4 None admin] RBAC: Authorizing `identity:get_project(project_id=304767c6e2e040f08692fdeea1a0b3c9)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:34.129390 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4786d4-7cee-498e-af24-4dcb37ad95e4 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:34.131017 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 577/1160] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Aug 2 21:29:33 2022] GET /identity/v3/projects/304767c6e2e040f08692fdeea1a0b3c9 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:29:34.141230 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dccc26-a8bd-48e4-b8c2-20d65bd46097 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:34.234751 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dccc26-a8bd-48e4-b8c2-20d65bd46097 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:34.267427 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47522418-7c6d-4c96-9b6e-768d98d1e5e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:34.268030 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47522418-7c6d-4c96-9b6e-768d98d1e5e6 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:34.268337 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47522418-7c6d-4c96-9b6e-768d98d1e5e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:34.268610 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47522418-7c6d-4c96-9b6e-768d98d1e5e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:34.269405 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47522418-7c6d-4c96-9b6e-768d98d1e5e6 None admin] RBAC: Adding query filter params (role.id=3e32dbf75f9b41f5adb9fe59851267bb, scope.project.id=304767c6e2e040f08692fdeea1a0b3c9, user.id=4ce4fde45a7e4ae386fa5025ff20a661) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:29:34.269715 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47522418-7c6d-4c96-9b6e-768d98d1e5e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:34.271122 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47522418-7c6d-4c96-9b6e-768d98d1e5e6 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:34.277371 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 584/1161] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Aug 2 21:29:34 2022] GET /identity/v3/role_assignments?user.id=4ce4fde45a7e4ae386fa5025ff20a661&scope.project.id=304767c6e2e040f08692fdeea1a0b3c9&role.id=3e32dbf75f9b41f5adb9fe59851267bb => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:29:36.278780 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4999a40-a211-42c7-a014-7a2a44d08a2d None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:36.279354 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4999a40-a211-42c7-a014-7a2a44d08a2d None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:36.279354 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4999a40-a211-42c7-a014-7a2a44d08a2d None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:36.280735 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 578/1162] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:29:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:29:36.286162 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acef70b9-bbfa-429b-8c2f-17e19c179145 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:36.286596 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acef70b9-bbfa-429b-8c2f-17e19c179145 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:36.286712 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acef70b9-bbfa-429b-8c2f-17e19c179145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:36.306253 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-acef70b9-bbfa-429b-8c2f-17e19c179145 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:29:36.307428 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-acef70b9-bbfa-429b-8c2f-17e19c179145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:29:36.359314 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:29:36.373809 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 585/1163] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:29:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 21:29:36.396013 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4999a40-a211-42c7-a014-7a2a44d08a2d None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:36.495603 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4999a40-a211-42c7-a014-7a2a44d08a2d None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:36.520538 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:29:36.528199 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c505f6-798c-4e35-b9b6-d7a70fbe1edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:36.528884 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c505f6-798c-4e35-b9b6-d7a70fbe1edc None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:36.529121 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c505f6-798c-4e35-b9b6-d7a70fbe1edc None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:36.529399 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c505f6-798c-4e35-b9b6-d7a70fbe1edc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:36.598115 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c505f6-798c-4e35-b9b6-d7a70fbe1edc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:36.599575 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c505f6-798c-4e35-b9b6-d7a70fbe1edc None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:36.695894 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 579/1164] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 2 21:29:36 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 21:29:36.702653 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acef70b9-bbfa-429b-8c2f-17e19c179145 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:36.798826 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acef70b9-bbfa-429b-8c2f-17e19c179145 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:36.831566 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9e802a-bf27-4d78-8536-7682e5c668fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:36.832190 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9e802a-bf27-4d78-8536-7682e5c668fe None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:36.832505 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9e802a-bf27-4d78-8536-7682e5c668fe None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:36.832779 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9e802a-bf27-4d78-8536-7682e5c668fe None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:36.839866 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9e802a-bf27-4d78-8536-7682e5c668fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:36.841333 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9e802a-bf27-4d78-8536-7682e5c668fe None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:36.852594 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-1a9e802a-bf27-4d78-8536-7682e5c668fe None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 02 21:29:36.852594 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:29:36.852594 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 02 21:29:36.852594 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 02 21:29:36.852594 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 21:29:36.852594 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 21:29:36.852594 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 21:29:36.852594 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 21:29:36.852594 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 02 21:29:36.852594 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:29:36.852594 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 21:29:36.852594 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:29:36.852594 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:29:36.852594 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:29:36.852594 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:29:36.852594 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:29:36.852594 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:29:36.854377 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:29:36.854377 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:29:36.854377 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:29:36.854377 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:29:36.854377 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:29:36.854377 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:29:36.854377 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:29:36.854377 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:29:36.854377 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:29:36.854377 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:29:36.854377 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:29:36.854377 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:29:36.854377 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:29:36.854377 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:29:36.854377 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:29:36.854377 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:29:36.855417 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:29:36.855417 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:29:36.855417 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:29:36.855417 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:29:36.855417 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:29:36.855417 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:29:36.855417 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:29:36.855417 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:29:36.855417 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:29:36.855417 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:29:36.855417 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 02 21:29:36.855417 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:29:36.855417 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 02 21:29:36.855417 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:29:36.855417 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 586/1165] 10.222.0.70 () {56 vars in 1117 bytes} [Tue Aug 2 21:29:36 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:29:36.860147 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c505f6-798c-4e35-b9b6-d7a70fbe1edc None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:36.894390 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:29:36.965934 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c505f6-798c-4e35-b9b6-d7a70fbe1edc None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:36.998904 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e84701-4d15-4d1d-b36a-e1b7a280a0a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:36.999510 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e84701-4d15-4d1d-b36a-e1b7a280a0a8 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:36.999794 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e84701-4d15-4d1d-b36a-e1b7a280a0a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:37.000067 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e84701-4d15-4d1d-b36a-e1b7a280a0a8 None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:37.000775 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e84701-4d15-4d1d-b36a-e1b7a280a0a8 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:29:37.001081 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e84701-4d15-4d1d-b36a-e1b7a280a0a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:37.002434 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e84701-4d15-4d1d-b36a-e1b7a280a0a8 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:37.009344 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 580/1166] 10.222.0.70 () {56 vars in 1115 bytes} [Tue Aug 2 21:29:36 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:29:38.978784 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4957112-2b93-42d9-a239-9c6f22c872ea None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:38.979338 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4957112-2b93-42d9-a239-9c6f22c872ea None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:38.979338 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4957112-2b93-42d9-a239-9c6f22c872ea None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:38.980716 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 587/1167] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:29:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:29:38.985852 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbe36b7-a187-4fd2-9db2-f087091d5f3e None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:38.986217 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbe36b7-a187-4fd2-9db2-f087091d5f3e None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:38.986399 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbe36b7-a187-4fd2-9db2-f087091d5f3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:39.004484 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-cfbe36b7-a187-4fd2-9db2-f087091d5f3e None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:29:39.005647 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-cfbe36b7-a187-4fd2-9db2-f087091d5f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:29:39.070322 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 581/1168] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:29:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 21:29:39.092594 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4957112-2b93-42d9-a239-9c6f22c872ea None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:39.142830 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:29:39.192201 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4957112-2b93-42d9-a239-9c6f22c872ea None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:39.225487 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85ccb9c-1df9-4a32-89fa-3d8665c34f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:39.226088 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85ccb9c-1df9-4a32-89fa-3d8665c34f0e None admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:39.226368 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85ccb9c-1df9-4a32-89fa-3d8665c34f0e None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:39.226640 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85ccb9c-1df9-4a32-89fa-3d8665c34f0e None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:39.227348 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85ccb9c-1df9-4a32-89fa-3d8665c34f0e None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:39.228771 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85ccb9c-1df9-4a32-89fa-3d8665c34f0e None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:39.244653 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 588/1169] 10.222.0.70 () {60 vars in 1138 bytes} [Tue Aug 2 21:29:39 2022] POST /identity/v3/domains => generated 267 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:29:41.253992 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b923de4b-fbc2-48dc-a23e-7102c8b60439 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:41.254580 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b923de4b-fbc2-48dc-a23e-7102c8b60439 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:41.254789 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b923de4b-fbc2-48dc-a23e-7102c8b60439 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:41.256173 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 582/1170] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:29:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:29:41.261380 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e45ccb-8781-4770-9cc4-9a880e2355f2 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:41.261788 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e45ccb-8781-4770-9cc4-9a880e2355f2 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:41.261938 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e45ccb-8781-4770-9cc4-9a880e2355f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:41.279708 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-55e45ccb-8781-4770-9cc4-9a880e2355f2 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:29:41.280919 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-55e45ccb-8781-4770-9cc4-9a880e2355f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:29:41.346081 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 589/1171] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:29:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 21:29:41.369757 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b923de4b-fbc2-48dc-a23e-7102c8b60439 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:41.394029 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:29:41.471395 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b923de4b-fbc2-48dc-a23e-7102c8b60439 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:41.504868 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a465aaf-1d6f-4e53-b134-aa402d61d98d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:41.505431 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a465aaf-1d6f-4e53-b134-aa402d61d98d None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:41.505718 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a465aaf-1d6f-4e53-b134-aa402d61d98d None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:41.505994 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a465aaf-1d6f-4e53-b134-aa402d61d98d None admin] PATH_INFO: `/v3/domains/5b9f68aeeb1c4a3fa5b67fa211708d58` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:41.516905 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a465aaf-1d6f-4e53-b134-aa402d61d98d None admin] RBAC: Authorizing `identity:get_domain(domain_id=5b9f68aeeb1c4a3fa5b67fa211708d58)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:41.518362 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a465aaf-1d6f-4e53-b134-aa402d61d98d None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:41.519987 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 583/1172] 10.222.0.70 () {56 vars in 1183 bytes} [Tue Aug 2 21:29:41 2022] GET /identity/v3/domains/5b9f68aeeb1c4a3fa5b67fa211708d58 => generated 267 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:29:41.525917 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e45ccb-8781-4770-9cc4-9a880e2355f2 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:41.563515 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:29:41.624049 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e45ccb-8781-4770-9cc4-9a880e2355f2 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:41.660390 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f675c70-3a79-4c81-af94-0d0ac02095ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:41.661216 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f675c70-3a79-4c81-af94-0d0ac02095ab None admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:41.661629 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f675c70-3a79-4c81-af94-0d0ac02095ab None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:41.662033 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f675c70-3a79-4c81-af94-0d0ac02095ab None admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:41.663033 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f675c70-3a79-4c81-af94-0d0ac02095ab None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:41.665878 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f675c70-3a79-4c81-af94-0d0ac02095ab None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:41.692821 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 590/1173] 10.222.0.70 () {60 vars in 1141 bytes} [Tue Aug 2 21:29:41 2022] POST /identity/v3/projects => generated 361 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:29:43.734804 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a402a6-98d4-4c26-8f6a-1fe9481f7ee3 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:43.735339 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a402a6-98d4-4c26-8f6a-1fe9481f7ee3 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:43.735339 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a402a6-98d4-4c26-8f6a-1fe9481f7ee3 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:43.736762 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 584/1174] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:29:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:29:43.742238 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4bd71f-6fa1-4654-8ee7-883c6bbcf01b None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:43.742610 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4bd71f-6fa1-4654-8ee7-883c6bbcf01b None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:43.742910 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4bd71f-6fa1-4654-8ee7-883c6bbcf01b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:43.761903 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-ad4bd71f-6fa1-4654-8ee7-883c6bbcf01b None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:29:43.763101 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-ad4bd71f-6fa1-4654-8ee7-883c6bbcf01b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:29:43.827623 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 591/1175] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:29:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 21:29:43.851286 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a402a6-98d4-4c26-8f6a-1fe9481f7ee3 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:43.932847 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:29:43.951469 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a402a6-98d4-4c26-8f6a-1fe9481f7ee3 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:43.983926 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22178a99-e597-4522-9524-0e8b7163e79e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:43.984572 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22178a99-e597-4522-9524-0e8b7163e79e None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:43.984905 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22178a99-e597-4522-9524-0e8b7163e79e None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:43.985129 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22178a99-e597-4522-9524-0e8b7163e79e None admin] PATH_INFO: `/v3/domains/5b9f68aeeb1c4a3fa5b67fa211708d58` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:43.986251 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22178a99-e597-4522-9524-0e8b7163e79e None admin] RBAC: Authorizing `identity:get_domain(domain_id=5b9f68aeeb1c4a3fa5b67fa211708d58)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:43.987667 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22178a99-e597-4522-9524-0e8b7163e79e None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:43.989526 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 585/1176] 10.222.0.70 () {56 vars in 1183 bytes} [Tue Aug 2 21:29:43 2022] GET /identity/v3/domains/5b9f68aeeb1c4a3fa5b67fa211708d58 => generated 267 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:29:43.995853 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4bd71f-6fa1-4654-8ee7-883c6bbcf01b None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:44.016285 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:29:44.091268 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4bd71f-6fa1-4654-8ee7-883c6bbcf01b None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:44.124705 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80101508-49b2-41b0-976d-6762e44b0ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:44.125310 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80101508-49b2-41b0-976d-6762e44b0ba3 None admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:44.125592 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80101508-49b2-41b0-976d-6762e44b0ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:44.125864 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80101508-49b2-41b0-976d-6762e44b0ba3 None admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:44.126538 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80101508-49b2-41b0-976d-6762e44b0ba3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:44.127960 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80101508-49b2-41b0-976d-6762e44b0ba3 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:44.149571 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 592/1177] 10.222.0.70 () {60 vars in 1132 bytes} [Tue Aug 2 21:29:43 2022] POST /identity/v3/users => generated 311 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:29:46.150692 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2163dc5-3005-4847-bcf1-73acd895534c None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:46.151315 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2163dc5-3005-4847-bcf1-73acd895534c None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:46.151315 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2163dc5-3005-4847-bcf1-73acd895534c None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:46.152647 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 586/1178] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:29:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:29:46.158065 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e24119-34b3-484a-a2bf-6cf2fcd3d914 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:46.158475 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e24119-34b3-484a-a2bf-6cf2fcd3d914 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:46.158636 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e24119-34b3-484a-a2bf-6cf2fcd3d914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:46.176956 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-c1e24119-34b3-484a-a2bf-6cf2fcd3d914 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:29:46.178145 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-c1e24119-34b3-484a-a2bf-6cf2fcd3d914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:29:46.243404 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 593/1179] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:29:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 21:29:46.266572 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2163dc5-3005-4847-bcf1-73acd895534c None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:46.368263 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2163dc5-3005-4847-bcf1-73acd895534c None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:46.406403 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f910259-d05c-4f62-b15d-dc2404bec923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:46.406961 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f910259-d05c-4f62-b15d-dc2404bec923 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:46.407245 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f910259-d05c-4f62-b15d-dc2404bec923 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:46.407518 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f910259-d05c-4f62-b15d-dc2404bec923 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:46.417381 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f910259-d05c-4f62-b15d-dc2404bec923 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:29:46.422181 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-7f910259-d05c-4f62-b15d-dc2404bec923 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 21:29:46.422181 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:29:46.422181 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:29:46.422181 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:29:46.422181 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:29:46.422181 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:29:46.422181 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:29:46.422181 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:29:46.422181 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:29:46.422181 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:29:46.422181 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:29:46.422181 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:29:46.422181 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:29:46.422181 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:29:46.422181 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:29:46.422181 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:29:46.423349 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:29:46.423349 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:29:46.423349 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:29:46.423349 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:29:46.423349 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:29:46.423349 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:29:46.423349 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:29:46.423349 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:29:46.423349 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:29:46.423349 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:29:46.423349 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:29:46.423349 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:29:46.423349 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:29:46.423349 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:29:46.423349 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:29:46.423349 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:29:46.424621 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:29:46.424621 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:29:46.424621 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:29:46.424621 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:29:46.424621 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:29:46.424621 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:29:46.424621 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:29:46.424621 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:29:46.424621 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:29:46.424621 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:29:46.424621 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 21:29:46.424621 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:29:46.424621 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 587/1180] 10.222.0.70 () {56 vars in 1096 bytes} [Tue Aug 2 21:29:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:29:46.429452 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e24119-34b3-484a-a2bf-6cf2fcd3d914 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:46.437463 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:29:46.528176 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e24119-34b3-484a-a2bf-6cf2fcd3d914 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:46.560828 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b26535-57c5-4b14-b7e6-dd2f1ce99de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:46.561430 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b26535-57c5-4b14-b7e6-dd2f1ce99de7 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:46.561712 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b26535-57c5-4b14-b7e6-dd2f1ce99de7 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:46.561985 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b26535-57c5-4b14-b7e6-dd2f1ce99de7 None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:46.562694 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b26535-57c5-4b14-b7e6-dd2f1ce99de7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:29:46.563000 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b26535-57c5-4b14-b7e6-dd2f1ce99de7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:46.564411 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b26535-57c5-4b14-b7e6-dd2f1ce99de7 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:46.572797 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 594/1181] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 2 21:29:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:29:46.578443 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f910259-d05c-4f62-b15d-dc2404bec923 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:46.590987 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:29:46.676217 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f910259-d05c-4f62-b15d-dc2404bec923 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:46.709514 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60f2ae8-340b-4c4d-9516-c27a908dfc88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:46.710145 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60f2ae8-340b-4c4d-9516-c27a908dfc88 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:46.710430 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60f2ae8-340b-4c4d-9516-c27a908dfc88 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:46.710706 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60f2ae8-340b-4c4d-9516-c27a908dfc88 None admin] PATH_INFO: `/v3/users/e71eab4491f843b5b8cb0571b1afe53a` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:46.723322 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60f2ae8-340b-4c4d-9516-c27a908dfc88 None admin] RBAC: Authorizing `identity:get_user(user_id=e71eab4491f843b5b8cb0571b1afe53a)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:46.724798 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60f2ae8-340b-4c4d-9516-c27a908dfc88 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:46.726410 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 588/1182] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Aug 2 21:29:46 2022] GET /identity/v3/users/e71eab4491f843b5b8cb0571b1afe53a => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:29:46.732243 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b26535-57c5-4b14-b7e6-dd2f1ce99de7 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:46.797320 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:29:46.830444 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b26535-57c5-4b14-b7e6-dd2f1ce99de7 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:46.862142 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98f4fec-ff04-4aa9-861f-64cc18790dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:46.862754 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f4fec-ff04-4aa9-861f-64cc18790dcf None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:46.863036 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f4fec-ff04-4aa9-861f-64cc18790dcf None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:46.863312 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98f4fec-ff04-4aa9-861f-64cc18790dcf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:46.929792 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98f4fec-ff04-4aa9-861f-64cc18790dcf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:46.931830 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98f4fec-ff04-4aa9-861f-64cc18790dcf None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:46.994410 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:29:47.027778 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 595/1183] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 2 21:29:46 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 21:29:47.033612 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60f2ae8-340b-4c4d-9516-c27a908dfc88 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:47.097479 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:29:47.130223 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60f2ae8-340b-4c4d-9516-c27a908dfc88 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:47.162795 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd01a73-cdff-4ef8-b52f-3040e2092166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:47.163424 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd01a73-cdff-4ef8-b52f-3040e2092166 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:47.163706 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd01a73-cdff-4ef8-b52f-3040e2092166 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:47.163983 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd01a73-cdff-4ef8-b52f-3040e2092166 None admin] PATH_INFO: `/v3/projects/a253c0e9269049128e947bc980c1b27f` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:47.165661 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd01a73-cdff-4ef8-b52f-3040e2092166 None admin] RBAC: Authorizing `identity:get_project(project_id=a253c0e9269049128e947bc980c1b27f)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:47.167086 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd01a73-cdff-4ef8-b52f-3040e2092166 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:47.168775 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 589/1184] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Aug 2 21:29:47 2022] GET /identity/v3/projects/a253c0e9269049128e947bc980c1b27f => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:29:47.174715 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98f4fec-ff04-4aa9-861f-64cc18790dcf None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:47.270803 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98f4fec-ff04-4aa9-861f-64cc18790dcf None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:47.304148 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b203d8bc-7032-41c2-8e19-405e077591b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:47.304771 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b203d8bc-7032-41c2-8e19-405e077591b1 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:47.305057 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b203d8bc-7032-41c2-8e19-405e077591b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:47.305340 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b203d8bc-7032-41c2-8e19-405e077591b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:47.306733 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b203d8bc-7032-41c2-8e19-405e077591b1 None admin] RBAC: Adding query filter params (role.id=3e32dbf75f9b41f5adb9fe59851267bb, scope.project.id=a253c0e9269049128e947bc980c1b27f, user.id=e71eab4491f843b5b8cb0571b1afe53a) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:29:47.307044 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b203d8bc-7032-41c2-8e19-405e077591b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:47.308504 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b203d8bc-7032-41c2-8e19-405e077591b1 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:47.313903 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 596/1185] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Aug 2 21:29:47 2022] GET /identity/v3/role_assignments?user.id=e71eab4491f843b5b8cb0571b1afe53a&scope.project.id=a253c0e9269049128e947bc980c1b27f&role.id=3e32dbf75f9b41f5adb9fe59851267bb => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:29:49.260978 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f71b0-32bd-42c5-af23-c8b0679c0cc0 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:49.261537 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f71b0-32bd-42c5-af23-c8b0679c0cc0 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:49.261537 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05f71b0-32bd-42c5-af23-c8b0679c0cc0 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:49.262881 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 590/1186] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:29:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:29:49.267915 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddabca2-2b09-4679-afd8-1f029286fc8c None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:49.268348 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddabca2-2b09-4679-afd8-1f029286fc8c None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:49.268507 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddabca2-2b09-4679-afd8-1f029286fc8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:49.286306 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-8ddabca2-2b09-4679-afd8-1f029286fc8c None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:29:49.287509 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-8ddabca2-2b09-4679-afd8-1f029286fc8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:29:49.313750 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:29:49.353621 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 597/1187] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:29:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 21:29:49.376380 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05f71b0-32bd-42c5-af23-c8b0679c0cc0 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:49.473944 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05f71b0-32bd-42c5-af23-c8b0679c0cc0 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:49.507611 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84db3b41-84a6-4484-9ab4-26a7e487b69e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:49.508259 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84db3b41-84a6-4484-9ab4-26a7e487b69e None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:49.508547 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84db3b41-84a6-4484-9ab4-26a7e487b69e None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:49.508854 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84db3b41-84a6-4484-9ab4-26a7e487b69e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:49.511509 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:29:49.519867 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84db3b41-84a6-4484-9ab4-26a7e487b69e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:29:49.525294 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-84db3b41-84a6-4484-9ab4-26a7e487b69e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 21:29:49.525294 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:29:49.525294 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:29:49.525294 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:29:49.525294 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:29:49.525294 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:29:49.525294 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:29:49.525294 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:29:49.525294 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:29:49.525294 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:29:49.525294 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:29:49.525294 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:29:49.525294 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:29:49.525294 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:29:49.525294 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:29:49.525294 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:29:49.526351 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:29:49.526351 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:29:49.526351 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:29:49.526351 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:29:49.526351 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:29:49.526351 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:29:49.526351 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:29:49.526351 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:29:49.526351 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:29:49.526351 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:29:49.526351 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:29:49.526351 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:29:49.526351 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:29:49.526351 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:29:49.526351 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:29:49.526351 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:29:49.527268 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:29:49.527268 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:29:49.527268 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:29:49.527268 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:29:49.527268 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:29:49.527268 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:29:49.527268 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:29:49.527268 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:29:49.527268 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:29:49.527268 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:29:49.527268 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 21:29:49.527268 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:29:49.527268 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 591/1188] 10.222.0.70 () {56 vars in 1096 bytes} [Tue Aug 2 21:29:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:29:49.531911 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddabca2-2b09-4679-afd8-1f029286fc8c None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:49.627880 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddabca2-2b09-4679-afd8-1f029286fc8c None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:49.661768 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f64bd8-9b5e-4341-9028-ea6c5830db2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:49.662381 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f64bd8-9b5e-4341-9028-ea6c5830db2e None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:49.662664 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f64bd8-9b5e-4341-9028-ea6c5830db2e None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:49.662941 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f64bd8-9b5e-4341-9028-ea6c5830db2e None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:49.663655 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f64bd8-9b5e-4341-9028-ea6c5830db2e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:29:49.663960 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f64bd8-9b5e-4341-9028-ea6c5830db2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:49.666056 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f64bd8-9b5e-4341-9028-ea6c5830db2e None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:49.673952 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 598/1189] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 2 21:29:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:29:49.679839 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84db3b41-84a6-4484-9ab4-26a7e487b69e None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:49.782037 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84db3b41-84a6-4484-9ab4-26a7e487b69e None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:49.814651 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9058f76d-77aa-4d3e-9fc8-012f090abd07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:49.815271 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9058f76d-77aa-4d3e-9fc8-012f090abd07 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:49.815551 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9058f76d-77aa-4d3e-9fc8-012f090abd07 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:49.815823 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9058f76d-77aa-4d3e-9fc8-012f090abd07 None admin] PATH_INFO: `/v3/users/e71eab4491f843b5b8cb0571b1afe53a` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:49.816975 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9058f76d-77aa-4d3e-9fc8-012f090abd07 None admin] RBAC: Authorizing `identity:get_user(user_id=e71eab4491f843b5b8cb0571b1afe53a)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:49.818391 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9058f76d-77aa-4d3e-9fc8-012f090abd07 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:49.820049 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 592/1190] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Aug 2 21:29:49 2022] GET /identity/v3/users/e71eab4491f843b5b8cb0571b1afe53a => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:29:49.825828 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f64bd8-9b5e-4341-9028-ea6c5830db2e None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:49.850997 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:29:49.925549 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f64bd8-9b5e-4341-9028-ea6c5830db2e None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:49.958076 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92847ebe-0871-467d-8a90-b39f0a15c440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:49.958706 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92847ebe-0871-467d-8a90-b39f0a15c440 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:49.958994 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92847ebe-0871-467d-8a90-b39f0a15c440 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:49.959268 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92847ebe-0871-467d-8a90-b39f0a15c440 None admin] PATH_INFO: `/v3/projects/a253c0e9269049128e947bc980c1b27f` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:49.960433 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92847ebe-0871-467d-8a90-b39f0a15c440 None admin] RBAC: Authorizing `identity:get_project(project_id=a253c0e9269049128e947bc980c1b27f)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:49.962438 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92847ebe-0871-467d-8a90-b39f0a15c440 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:49.964069 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 599/1191] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Aug 2 21:29:49 2022] GET /identity/v3/projects/a253c0e9269049128e947bc980c1b27f => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:29:49.969995 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9058f76d-77aa-4d3e-9fc8-012f090abd07 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:50.031158 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:29:50.072069 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9058f76d-77aa-4d3e-9fc8-012f090abd07 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:50.105484 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb1b899-a4d6-4842-a1fa-aa56af554151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:50.106143 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb1b899-a4d6-4842-a1fa-aa56af554151 None admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:50.106428 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb1b899-a4d6-4842-a1fa-aa56af554151 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:50.106702 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb1b899-a4d6-4842-a1fa-aa56af554151 None admin] PATH_INFO: `/v3/projects/a253c0e9269049128e947bc980c1b27f/users/e71eab4491f843b5b8cb0571b1afe53a/roles/3e32dbf75f9b41f5adb9fe59851267bb` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:50.108638 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb1b899-a4d6-4842-a1fa-aa56af554151 None admin] RBAC: Authorizing `identity:create_grant(project_id=a253c0e9269049128e947bc980c1b27f, user_id=e71eab4491f843b5b8cb0571b1afe53a, role_id=3e32dbf75f9b41f5adb9fe59851267bb)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:50.110065 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb1b899-a4d6-4842-a1fa-aa56af554151 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:50.123726 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 593/1192] 10.222.0.70 () {58 vars in 1439 bytes} [Tue Aug 2 21:29:49 2022] PUT /identity/v3/projects/a253c0e9269049128e947bc980c1b27f/users/e71eab4491f843b5b8cb0571b1afe53a/roles/3e32dbf75f9b41f5adb9fe59851267bb => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:29:52.093133 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ef37c7-05cc-4f00-af7c-87c848d87d0b None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:52.093684 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ef37c7-05cc-4f00-af7c-87c848d87d0b None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:52.093684 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ef37c7-05cc-4f00-af7c-87c848d87d0b None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:52.095031 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 600/1193] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:29:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:29:52.100245 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750fd6c8-aa8c-410c-a2c9-79fa56966d9b None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:52.100613 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750fd6c8-aa8c-410c-a2c9-79fa56966d9b None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:52.100812 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750fd6c8-aa8c-410c-a2c9-79fa56966d9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:52.119685 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-750fd6c8-aa8c-410c-a2c9-79fa56966d9b None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:29:52.120902 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-750fd6c8-aa8c-410c-a2c9-79fa56966d9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:29:52.185776 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 594/1194] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:29:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 21:29:52.209650 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ef37c7-05cc-4f00-af7c-87c848d87d0b None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:52.302054 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:29:52.317348 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ef37c7-05cc-4f00-af7c-87c848d87d0b None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:52.351547 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccc75bd-2e88-48af-9bf0-64c908dc8bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:52.352120 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccc75bd-2e88-48af-9bf0-64c908dc8bec None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:52.352431 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccc75bd-2e88-48af-9bf0-64c908dc8bec None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:52.352718 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccc75bd-2e88-48af-9bf0-64c908dc8bec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:52.362642 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccc75bd-2e88-48af-9bf0-64c908dc8bec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:29:52.367770 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-4ccc75bd-2e88-48af-9bf0-64c908dc8bec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 21:29:52.367770 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:29:52.367770 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:29:52.367770 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:29:52.367770 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:29:52.367770 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:29:52.367770 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:29:52.367770 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:29:52.367770 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:29:52.367770 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:29:52.367770 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:29:52.367770 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:29:52.367770 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:29:52.367770 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:29:52.367770 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:29:52.367770 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:29:52.368905 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:29:52.368905 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:29:52.368905 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:29:52.368905 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:29:52.368905 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:29:52.368905 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:29:52.368905 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:29:52.368905 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:29:52.368905 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:29:52.368905 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:29:52.368905 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:29:52.368905 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:29:52.368905 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:29:52.368905 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:29:52.368905 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:29:52.368905 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:29:52.370086 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:29:52.370086 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:29:52.370086 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:29:52.370086 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:29:52.370086 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:29:52.370086 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:29:52.370086 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:29:52.370086 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:29:52.370086 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:29:52.370086 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:29:52.370086 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 21:29:52.370086 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:29:52.370086 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 601/1195] 10.222.0.70 () {56 vars in 1096 bytes} [Tue Aug 2 21:29:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:29:52.375048 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750fd6c8-aa8c-410c-a2c9-79fa56966d9b None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:52.428967 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:29:52.473839 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750fd6c8-aa8c-410c-a2c9-79fa56966d9b None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:52.506231 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d09964-3dae-48bd-96d1-ea980033cc33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:52.506846 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d09964-3dae-48bd-96d1-ea980033cc33 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:52.507132 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d09964-3dae-48bd-96d1-ea980033cc33 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:52.507408 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d09964-3dae-48bd-96d1-ea980033cc33 None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:52.508118 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d09964-3dae-48bd-96d1-ea980033cc33 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:29:52.508459 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d09964-3dae-48bd-96d1-ea980033cc33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:52.510325 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d09964-3dae-48bd-96d1-ea980033cc33 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:52.518141 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 595/1196] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 2 21:29:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:29:52.523823 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccc75bd-2e88-48af-9bf0-64c908dc8bec None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:52.621895 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccc75bd-2e88-48af-9bf0-64c908dc8bec None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:52.655066 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed35159-55c9-4a90-9770-20ff1d0fc524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:52.655689 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed35159-55c9-4a90-9770-20ff1d0fc524 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:52.655973 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed35159-55c9-4a90-9770-20ff1d0fc524 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:52.656270 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed35159-55c9-4a90-9770-20ff1d0fc524 None admin] PATH_INFO: `/v3/users/e71eab4491f843b5b8cb0571b1afe53a` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:52.657434 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed35159-55c9-4a90-9770-20ff1d0fc524 None admin] RBAC: Authorizing `identity:get_user(user_id=e71eab4491f843b5b8cb0571b1afe53a)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:52.658856 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed35159-55c9-4a90-9770-20ff1d0fc524 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:52.660461 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 602/1197] 10.222.0.70 () {56 vars in 1177 bytes} [Tue Aug 2 21:29:52 2022] GET /identity/v3/users/e71eab4491f843b5b8cb0571b1afe53a => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:29:52.666116 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d09964-3dae-48bd-96d1-ea980033cc33 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:52.765048 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d09964-3dae-48bd-96d1-ea980033cc33 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:52.780355 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:29:52.797447 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de1613f-e5c0-4de6-a238-766507f67d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:52.798051 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de1613f-e5c0-4de6-a238-766507f67d27 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:52.798332 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de1613f-e5c0-4de6-a238-766507f67d27 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:52.798605 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de1613f-e5c0-4de6-a238-766507f67d27 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:52.862763 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de1613f-e5c0-4de6-a238-766507f67d27 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:52.864619 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de1613f-e5c0-4de6-a238-766507f67d27 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:52.958625 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 596/1198] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 2 21:29:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 21:29:52.964611 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed35159-55c9-4a90-9770-20ff1d0fc524 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:52.986104 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:29:53.061694 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed35159-55c9-4a90-9770-20ff1d0fc524 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:53.093791 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f0ac5c-9fb9-41d1-ad42-231c483857aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:53.094415 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f0ac5c-9fb9-41d1-ad42-231c483857aa None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:53.094697 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f0ac5c-9fb9-41d1-ad42-231c483857aa None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:53.094972 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f0ac5c-9fb9-41d1-ad42-231c483857aa None admin] PATH_INFO: `/v3/projects/a253c0e9269049128e947bc980c1b27f` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:53.096112 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f0ac5c-9fb9-41d1-ad42-231c483857aa None admin] RBAC: Authorizing `identity:get_project(project_id=a253c0e9269049128e947bc980c1b27f)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:53.097562 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f0ac5c-9fb9-41d1-ad42-231c483857aa None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:53.099180 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 603/1199] 10.222.0.70 () {56 vars in 1186 bytes} [Tue Aug 2 21:29:52 2022] GET /identity/v3/projects/a253c0e9269049128e947bc980c1b27f => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:29:53.105646 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de1613f-e5c0-4de6-a238-766507f67d27 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:29:53.123728 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:29:53.202275 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de1613f-e5c0-4de6-a238-766507f67d27 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:29:53.235138 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379d70e5-6e79-4f1d-af96-59f59f04cfed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:29:53.235673 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d70e5-6e79-4f1d-af96-59f59f04cfed None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:29:53.235951 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d70e5-6e79-4f1d-af96-59f59f04cfed None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:29:53.236221 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d70e5-6e79-4f1d-af96-59f59f04cfed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:29:53.237015 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379d70e5-6e79-4f1d-af96-59f59f04cfed None admin] RBAC: Adding query filter params (role.id=3e32dbf75f9b41f5adb9fe59851267bb, scope.project.id=a253c0e9269049128e947bc980c1b27f, user.id=e71eab4491f843b5b8cb0571b1afe53a) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:29:53.237318 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379d70e5-6e79-4f1d-af96-59f59f04cfed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:29:53.238712 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379d70e5-6e79-4f1d-af96-59f59f04cfed None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:29:53.244537 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 597/1200] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Aug 2 21:29:53 2022] GET /identity/v3/role_assignments?user.id=e71eab4491f843b5b8cb0571b1afe53a&scope.project.id=a253c0e9269049128e947bc980c1b27f&role.id=3e32dbf75f9b41f5adb9fe59851267bb => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:30:03.089797 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=56 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:30:03.242015 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=60 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:30:48.465521 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffff120-a4f7-4687-997c-0f5fef7a6b6c None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:30:48.466089 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffff120-a4f7-4687-997c-0f5fef7a6b6c None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:30:48.466089 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffff120-a4f7-4687-997c-0f5fef7a6b6c None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:30:48.467618 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 604/1201] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:30:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:30:48.472827 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fabc30f-fd21-4d9a-b017-2add7ac581bc None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:30:48.473574 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fabc30f-fd21-4d9a-b017-2add7ac581bc None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:30:48.473574 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fabc30f-fd21-4d9a-b017-2add7ac581bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:30:48.493125 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-4fabc30f-fd21-4d9a-b017-2add7ac581bc None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:30:48.494325 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-4fabc30f-fd21-4d9a-b017-2add7ac581bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:30:48.582969 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 598/1202] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:30:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 21:30:48.608363 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffff120-a4f7-4687-997c-0f5fef7a6b6c None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:30:48.753219 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffff120-a4f7-4687-997c-0f5fef7a6b6c None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:30:48.796895 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20ac755-f6ef-4633-a463-f00c365092ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:30:48.798072 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20ac755-f6ef-4633-a463-f00c365092ef None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:30:48.798721 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20ac755-f6ef-4633-a463-f00c365092ef None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:30:48.799270 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20ac755-f6ef-4633-a463-f00c365092ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:30:48.812106 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20ac755-f6ef-4633-a463-f00c365092ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:30:48.813718 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20ac755-f6ef-4633-a463-f00c365092ef None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:30:48.834747 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-c20ac755-f6ef-4633-a463-f00c365092ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:30:48.834747 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:30:48.834747 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:30:48.834747 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:30:48.834747 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:30:48.834747 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:30:48.834747 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:30:48.834747 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:30:48.834747 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:30:48.834747 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:30:48.834747 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:30:48.834747 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:30:48.834747 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:30:48.834747 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:30:48.834747 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:30:48.840826 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:30:48.840826 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:30:48.840826 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:30:48.840826 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:30:48.840826 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:30:48.840826 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:30:48.840826 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:30:48.840826 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:30:48.840826 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:30:48.840826 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:30:48.840826 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:30:48.840826 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:30:48.840826 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:30:48.840826 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:30:48.840826 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:30:48.840826 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:30:48.840826 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:30:48.842537 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:30:48.842537 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:30:48.842537 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:30:48.842537 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:30:48.842537 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 605/1203] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 2 21:30:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:30:48.843469 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fabc30f-fd21-4d9a-b017-2add7ac581bc None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:30:48.968670 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fabc30f-fd21-4d9a-b017-2add7ac581bc None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:30:49.013369 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:30:49.021845 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e2e68d-1fbb-4dd8-baea-a43f4b36acf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:30:49.022668 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e2e68d-1fbb-4dd8-baea-a43f4b36acf1 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:30:49.023043 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e2e68d-1fbb-4dd8-baea-a43f4b36acf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:30:49.023391 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e2e68d-1fbb-4dd8-baea-a43f4b36acf1 None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:30:49.024256 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e2e68d-1fbb-4dd8-baea-a43f4b36acf1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:30:49.024569 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e2e68d-1fbb-4dd8-baea-a43f4b36acf1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:30:49.026074 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e2e68d-1fbb-4dd8-baea-a43f4b36acf1 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:30:49.040632 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 599/1204] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 2 21:30:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:30:49.046628 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20ac755-f6ef-4633-a463-f00c365092ef None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:30:49.117021 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:30:49.182099 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20ac755-f6ef-4633-a463-f00c365092ef None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:30:49.222637 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50abf62f-b0e9-4b83-b720-c70c9a5bf774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:30:49.223247 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50abf62f-b0e9-4b83-b720-c70c9a5bf774 None admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:30:49.223533 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50abf62f-b0e9-4b83-b720-c70c9a5bf774 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:30:49.223812 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50abf62f-b0e9-4b83-b720-c70c9a5bf774 None admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:30:49.227943 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50abf62f-b0e9-4b83-b720-c70c9a5bf774 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:30:49.227943 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50abf62f-b0e9-4b83-b720-c70c9a5bf774 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:30:49.252470 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 606/1205] 10.222.0.70 () {60 vars in 1132 bytes} [Tue Aug 2 21:30:49 2022] POST /identity/v3/users => generated 251 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:30:51.604954 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82395e7b-d665-4d1a-8111-b45b251b9996 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:30:51.605456 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82395e7b-d665-4d1a-8111-b45b251b9996 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:30:51.605456 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82395e7b-d665-4d1a-8111-b45b251b9996 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:30:51.606966 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 600/1206] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:30:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:30:51.612580 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c066ed-66c6-44c3-a463-d96a3b6493c0 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:30:51.613178 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c066ed-66c6-44c3-a463-d96a3b6493c0 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:30:51.613178 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c066ed-66c6-44c3-a463-d96a3b6493c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:30:51.633668 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-04c066ed-66c6-44c3-a463-d96a3b6493c0 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:30:51.634946 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-04c066ed-66c6-44c3-a463-d96a3b6493c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:30:51.715488 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 607/1207] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:30:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 21:30:51.740985 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82395e7b-d665-4d1a-8111-b45b251b9996 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:30:51.866435 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82395e7b-d665-4d1a-8111-b45b251b9996 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:30:51.910093 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d261e253-e5d4-4040-8d23-7a30d85c1d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:30:51.910733 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d261e253-e5d4-4040-8d23-7a30d85c1d94 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:30:51.911019 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d261e253-e5d4-4040-8d23-7a30d85c1d94 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:30:51.911282 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d261e253-e5d4-4040-8d23-7a30d85c1d94 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:30:51.923033 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d261e253-e5d4-4040-8d23-7a30d85c1d94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:30:51.928030 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-d261e253-e5d4-4040-8d23-7a30d85c1d94 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 21:30:51.928030 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:30:51.928030 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:30:51.928030 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:30:51.928030 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:30:51.928030 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:30:51.928030 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:30:51.928030 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:30:51.928030 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:30:51.928030 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:30:51.928030 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:30:51.928030 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:30:51.928030 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:30:51.928030 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:30:51.928030 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:30:51.928030 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:30:51.929524 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:30:51.929524 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:30:51.929524 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:30:51.929524 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:30:51.929524 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:30:51.929524 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:30:51.929524 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:30:51.929524 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:30:51.929524 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:30:51.929524 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:30:51.929524 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:30:51.929524 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:30:51.929524 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:30:51.929524 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:30:51.929524 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:30:51.929524 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:30:51.930518 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:30:51.930518 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:30:51.930518 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:30:51.930518 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:30:51.930518 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:30:51.930518 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:30:51.930518 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:30:51.930518 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:30:51.930518 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:30:51.930518 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:30:51.930518 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 21:30:51.930518 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:30:51.932422 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 601/1208] 10.222.0.70 () {56 vars in 1102 bytes} [Tue Aug 2 21:30:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:30:51.936031 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c066ed-66c6-44c3-a463-d96a3b6493c0 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:30:51.982961 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:30:52.057581 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c066ed-66c6-44c3-a463-d96a3b6493c0 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:30:52.098793 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f9da17-2a42-42e7-b993-0d03f299e837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:30:52.099581 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f9da17-2a42-42e7-b993-0d03f299e837 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:30:52.100014 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f9da17-2a42-42e7-b993-0d03f299e837 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:30:52.100187 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f9da17-2a42-42e7-b993-0d03f299e837 None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:30:52.100887 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f9da17-2a42-42e7-b993-0d03f299e837 None admin] RBAC: Adding query filter params (name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:30:52.101198 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f9da17-2a42-42e7-b993-0d03f299e837 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:30:52.103154 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f9da17-2a42-42e7-b993-0d03f299e837 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:30:52.113441 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 608/1209] 10.222.0.70 () {56 vars in 1103 bytes} [Tue Aug 2 21:30:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:30:52.122285 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d261e253-e5d4-4040-8d23-7a30d85c1d94 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:30:52.189133 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:30:52.250057 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d261e253-e5d4-4040-8d23-7a30d85c1d94 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:30:52.309471 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d861fede-678e-461f-a6e6-46143ab1841a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:30:52.310213 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d861fede-678e-461f-a6e6-46143ab1841a None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:30:52.310533 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d861fede-678e-461f-a6e6-46143ab1841a None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:30:52.310858 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d861fede-678e-461f-a6e6-46143ab1841a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:30:52.325065 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d861fede-678e-461f-a6e6-46143ab1841a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:30:52.326583 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d861fede-678e-461f-a6e6-46143ab1841a None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:30:52.344947 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-d861fede-678e-461f-a6e6-46143ab1841a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:30:52.344947 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:30:52.344947 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:30:52.344947 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:30:52.344947 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:30:52.344947 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:30:52.344947 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:30:52.344947 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:30:52.344947 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:30:52.344947 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:30:52.344947 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:30:52.344947 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:30:52.344947 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:30:52.344947 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:30:52.344947 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:30:52.346074 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:30:52.346074 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:30:52.346074 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:30:52.346074 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:30:52.346074 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:30:52.346074 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:30:52.346074 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:30:52.346074 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:30:52.346074 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:30:52.346074 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:30:52.346074 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:30:52.346074 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:30:52.346074 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:30:52.346074 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:30:52.346074 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:30:52.346074 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:30:52.346074 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:30:52.347225 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:30:52.347225 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:30:52.347225 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:30:52.347225 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:30:52.347225 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 602/1210] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 2 21:30:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:30:52.353358 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f9da17-2a42-42e7-b993-0d03f299e837 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:30:52.458507 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:30:52.465143 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f9da17-2a42-42e7-b993-0d03f299e837 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:30:52.501345 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653a7945-a49f-40c7-82a7-80e6a90bcae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:30:52.502302 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653a7945-a49f-40c7-82a7-80e6a90bcae4 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:30:52.502302 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653a7945-a49f-40c7-82a7-80e6a90bcae4 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:30:52.502605 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653a7945-a49f-40c7-82a7-80e6a90bcae4 None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:30:52.503274 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653a7945-a49f-40c7-82a7-80e6a90bcae4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:30:52.503580 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653a7945-a49f-40c7-82a7-80e6a90bcae4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:30:52.504967 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653a7945-a49f-40c7-82a7-80e6a90bcae4 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:30:52.517783 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 609/1211] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 2 21:30:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:30:52.524052 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d861fede-678e-461f-a6e6-46143ab1841a None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:30:52.635104 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d861fede-678e-461f-a6e6-46143ab1841a None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:30:52.637672 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:30:52.673070 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f851000-9084-4834-b807-bba5015da3b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:30:52.673717 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f851000-9084-4834-b807-bba5015da3b2 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:30:52.674004 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f851000-9084-4834-b807-bba5015da3b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:30:52.674285 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f851000-9084-4834-b807-bba5015da3b2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:30:52.684668 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f851000-9084-4834-b807-bba5015da3b2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:30:52.686306 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f851000-9084-4834-b807-bba5015da3b2 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:30:52.698778 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-8f851000-9084-4834-b807-bba5015da3b2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 02 21:30:52.698778 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:30:52.698778 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:30:52.698778 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:30:52.698778 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:30:52.698778 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:30:52.698778 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:30:52.698778 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:30:52.698778 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:30:52.698778 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:30:52.698778 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:30:52.698778 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:30:52.698778 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 21:30:52.698778 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 21:30:52.698778 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 21:30:52.698778 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 21:30:52.699834 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:30:52.699834 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:30:52.699834 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 21:30:52.699834 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:30:52.699834 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 21:30:52.699834 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:30:52.699834 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:30:52.699834 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:30:52.699834 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:30:52.699834 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:30:52.699834 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:30:52.699834 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:30:52.699834 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:30:52.699834 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:30:52.699834 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:30:52.699834 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:30:52.699834 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:30:52.699834 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:30:52.701461 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:30:52.701461 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:30:52.701461 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 21:30:52.701461 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 21:30:52.701461 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 21:30:52.701461 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 21:30:52.701461 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 21:30:52.701461 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 21:30:52.701461 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 02 21:30:52.701461 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:30:52.704743 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 603/1212] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 2 21:30:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:30:52.705844 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653a7945-a49f-40c7-82a7-80e6a90bcae4 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:30:52.834452 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653a7945-a49f-40c7-82a7-80e6a90bcae4 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:30:52.871398 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaad97d-09a6-436b-b65c-7d5894a11821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:30:52.872066 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaad97d-09a6-436b-b65c-7d5894a11821 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:30:52.872387 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaad97d-09a6-436b-b65c-7d5894a11821 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:30:52.872673 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaad97d-09a6-436b-b65c-7d5894a11821 None admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:30:52.873450 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaad97d-09a6-436b-b65c-7d5894a11821 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:30:52.873850 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaad97d-09a6-436b-b65c-7d5894a11821 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:30:52.875346 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaad97d-09a6-436b-b65c-7d5894a11821 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:30:52.895216 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 610/1213] 10.222.0.70 () {56 vars in 1143 bytes} [Tue Aug 2 21:30:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:30:52.901525 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f851000-9084-4834-b807-bba5015da3b2 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:30:53.018861 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f851000-9084-4834-b807-bba5015da3b2 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:30:53.057869 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c40ee5-e64c-4214-8700-49bee1c99953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:30:53.058994 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c40ee5-e64c-4214-8700-49bee1c99953 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:30:53.059272 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c40ee5-e64c-4214-8700-49bee1c99953 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:30:53.059551 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c40ee5-e64c-4214-8700-49bee1c99953 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:30:53.093930 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:30:53.140061 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c40ee5-e64c-4214-8700-49bee1c99953 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:30:53.141564 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c40ee5-e64c-4214-8700-49bee1c99953 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:30:53.272853 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 604/1214] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 2 21:30:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 21:30:53.283632 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaad97d-09a6-436b-b65c-7d5894a11821 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:30:53.309668 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:30:53.408831 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaad97d-09a6-436b-b65c-7d5894a11821 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:30:53.450672 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f1b8f7-0858-4ad0-8ca1-3f73803d433b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:30:53.451408 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f1b8f7-0858-4ad0-8ca1-3f73803d433b None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:30:53.451760 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f1b8f7-0858-4ad0-8ca1-3f73803d433b None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:30:53.452012 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f1b8f7-0858-4ad0-8ca1-3f73803d433b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:30:53.465538 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f1b8f7-0858-4ad0-8ca1-3f73803d433b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:30:53.467166 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f1b8f7-0858-4ad0-8ca1-3f73803d433b None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:30:53.486221 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-b4f1b8f7-0858-4ad0-8ca1-3f73803d433b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:30:53.486221 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:30:53.486221 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:30:53.486221 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:30:53.486221 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:30:53.486221 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:30:53.486221 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:30:53.486221 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:30:53.486221 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:30:53.486221 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:30:53.486221 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:30:53.486221 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:30:53.486221 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:30:53.486221 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:30:53.486221 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:30:53.487240 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:30:53.487240 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:30:53.487240 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:30:53.487240 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:30:53.487240 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:30:53.487240 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:30:53.487240 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:30:53.487240 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:30:53.487240 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:30:53.487240 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:30:53.487240 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:30:53.487240 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:30:53.487240 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:30:53.487240 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:30:53.487240 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:30:53.487240 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:30:53.487240 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:30:53.488171 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:30:53.488171 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:30:53.488171 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:30:53.488171 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:30:53.488171 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 611/1215] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 2 21:30:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 21:30:53.495570 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c40ee5-e64c-4214-8700-49bee1c99953 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:30:53.573044 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:30:53.617060 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c40ee5-e64c-4214-8700-49bee1c99953 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:30:53.653504 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c772851-ff67-4247-a5fd-d8fd93d41741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:30:53.654198 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c772851-ff67-4247-a5fd-d8fd93d41741 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:30:53.654426 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c772851-ff67-4247-a5fd-d8fd93d41741 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:30:53.654755 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c772851-ff67-4247-a5fd-d8fd93d41741 None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:30:53.655358 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c772851-ff67-4247-a5fd-d8fd93d41741 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:30:53.655684 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c772851-ff67-4247-a5fd-d8fd93d41741 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:30:53.657070 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c772851-ff67-4247-a5fd-d8fd93d41741 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:30:53.673640 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 605/1216] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 2 21:30:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:30:53.675040 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f1b8f7-0858-4ad0-8ca1-3f73803d433b None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:30:53.748733 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:30:53.787132 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f1b8f7-0858-4ad0-8ca1-3f73803d433b None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:30:53.827272 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de175f6b-0dce-4956-93cb-45ad7f6fa99e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:30:53.827920 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de175f6b-0dce-4956-93cb-45ad7f6fa99e None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:30:53.828200 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de175f6b-0dce-4956-93cb-45ad7f6fa99e None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:30:53.828506 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de175f6b-0dce-4956-93cb-45ad7f6fa99e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:30:53.835347 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de175f6b-0dce-4956-93cb-45ad7f6fa99e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:30:53.837416 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de175f6b-0dce-4956-93cb-45ad7f6fa99e None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:30:53.857985 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-de175f6b-0dce-4956-93cb-45ad7f6fa99e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:30:53.857985 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:30:53.857985 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:30:53.857985 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:30:53.857985 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:30:53.857985 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:30:53.857985 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:30:53.857985 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:30:53.857985 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:30:53.857985 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:30:53.857985 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:30:53.857985 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:30:53.857985 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 21:30:53.857985 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 21:30:53.857985 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 21:30:53.859009 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 21:30:53.859009 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:30:53.859009 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:30:53.859009 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:30:53.859009 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:30:53.859009 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:30:53.859009 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:30:53.859009 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:30:53.859009 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:30:53.859009 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:30:53.859009 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:30:53.859009 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:30:53.859009 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:30:53.859009 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:30:53.859009 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:30:53.859009 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:30:53.859009 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:30:53.859956 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 21:30:53.859956 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 21:30:53.859956 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 21:30:53.859956 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 21:30:53.859956 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 21:30:53.859956 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 21:30:53.859956 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:30:53.859956 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:30:53.859956 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 612/1217] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Aug 2 21:30:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 21:30:53.867435 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c772851-ff67-4247-a5fd-d8fd93d41741 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:30:53.987750 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c772851-ff67-4247-a5fd-d8fd93d41741 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:30:54.013543 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:30:54.028562 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412eca95-9443-4c11-9afb-71c7917a11f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:30:54.029380 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412eca95-9443-4c11-9afb-71c7917a11f3 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:30:54.029791 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412eca95-9443-4c11-9afb-71c7917a11f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:30:54.030188 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412eca95-9443-4c11-9afb-71c7917a11f3 None admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:30:54.031161 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412eca95-9443-4c11-9afb-71c7917a11f3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:30:54.031617 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412eca95-9443-4c11-9afb-71c7917a11f3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:30:54.033264 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412eca95-9443-4c11-9afb-71c7917a11f3 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:30:54.047200 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 606/1218] 10.222.0.70 () {56 vars in 1148 bytes} [Tue Aug 2 21:30:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:30:54.053139 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de175f6b-0dce-4956-93cb-45ad7f6fa99e None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:30:54.168450 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de175f6b-0dce-4956-93cb-45ad7f6fa99e None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:30:54.203269 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:30:54.210213 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8722975e-815d-40be-b238-028d0e547cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:30:54.210938 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8722975e-815d-40be-b238-028d0e547cf2 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:30:54.211420 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8722975e-815d-40be-b238-028d0e547cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:30:54.211881 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8722975e-815d-40be-b238-028d0e547cf2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:30:54.213104 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8722975e-815d-40be-b238-028d0e547cf2 None admin] RBAC: Adding query filter params (role.id=59a4c9a6a22d4bdb966856a28c4aabaf, scope.project.id=42672e04d6ce4b0ab5f7eccfb0cc946c, user.id=83fcd951771e42959506b70b0137003f) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:30:54.213673 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8722975e-815d-40be-b238-028d0e547cf2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:30:54.215840 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8722975e-815d-40be-b238-028d0e547cf2 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:30:54.223140 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 613/1219] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Aug 2 21:30:54 2022] GET /identity/v3/role_assignments?user.id=83fcd951771e42959506b70b0137003f&scope.project.id=42672e04d6ce4b0ab5f7eccfb0cc946c&role.id=59a4c9a6a22d4bdb966856a28c4aabaf => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:30:56.329983 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6df31e-3b1d-42a9-8d19-da1e1a5a4d73 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:30:56.330504 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6df31e-3b1d-42a9-8d19-da1e1a5a4d73 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:30:56.330596 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6df31e-3b1d-42a9-8d19-da1e1a5a4d73 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:30:56.332103 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 607/1220] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:30:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:30:56.338171 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8067dc5a-0211-4850-b4bf-0f2843a32f77 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:30:56.338622 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8067dc5a-0211-4850-b4bf-0f2843a32f77 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:30:56.338948 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8067dc5a-0211-4850-b4bf-0f2843a32f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:30:56.358688 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-8067dc5a-0211-4850-b4bf-0f2843a32f77 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:30:56.359936 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-8067dc5a-0211-4850-b4bf-0f2843a32f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:30:56.435681 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 614/1221] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:30:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 21:30:56.458752 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6df31e-3b1d-42a9-8d19-da1e1a5a4d73 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:30:56.570192 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6df31e-3b1d-42a9-8d19-da1e1a5a4d73 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:30:56.610148 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2633c776-7096-4c1a-874f-b1930bd620d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:30:56.610785 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2633c776-7096-4c1a-874f-b1930bd620d9 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:30:56.611065 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2633c776-7096-4c1a-874f-b1930bd620d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:30:56.611337 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2633c776-7096-4c1a-874f-b1930bd620d9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:30:56.621656 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2633c776-7096-4c1a-874f-b1930bd620d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:30:56.626410 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-2633c776-7096-4c1a-874f-b1930bd620d9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 21:30:56.626410 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:30:56.626410 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:30:56.626410 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:30:56.626410 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:30:56.626410 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:30:56.626410 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:30:56.626410 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:30:56.626410 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:30:56.626410 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:30:56.626410 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:30:56.626410 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:30:56.626410 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:30:56.626410 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:30:56.626410 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:30:56.626410 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:30:56.627497 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:30:56.627497 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:30:56.627497 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:30:56.627497 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:30:56.627497 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:30:56.627497 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:30:56.627497 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:30:56.627497 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:30:56.627497 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:30:56.627497 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:30:56.627497 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:30:56.627497 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:30:56.627497 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:30:56.627497 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:30:56.627497 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:30:56.627497 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:30:56.628411 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:30:56.628411 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:30:56.628411 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:30:56.628411 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:30:56.628411 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:30:56.628411 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:30:56.628411 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:30:56.628411 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:30:56.628411 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:30:56.628411 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:30:56.628411 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 21:30:56.628411 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:30:56.628411 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 608/1222] 10.222.0.70 () {56 vars in 1102 bytes} [Tue Aug 2 21:30:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:30:56.633807 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8067dc5a-0211-4850-b4bf-0f2843a32f77 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:30:56.744554 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8067dc5a-0211-4850-b4bf-0f2843a32f77 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:30:56.770851 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:30:56.783290 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b2d5dc-8c8e-4b59-8a04-81789da9d0eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:30:56.783855 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b2d5dc-8c8e-4b59-8a04-81789da9d0eb None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:30:56.784130 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b2d5dc-8c8e-4b59-8a04-81789da9d0eb None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:30:56.784437 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b2d5dc-8c8e-4b59-8a04-81789da9d0eb None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:30:56.785153 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b2d5dc-8c8e-4b59-8a04-81789da9d0eb None admin] RBAC: Adding query filter params (name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:30:56.785443 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b2d5dc-8c8e-4b59-8a04-81789da9d0eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:30:56.786801 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b2d5dc-8c8e-4b59-8a04-81789da9d0eb None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:30:56.795876 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 615/1223] 10.222.0.70 () {56 vars in 1103 bytes} [Tue Aug 2 21:30:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:30:56.801703 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2633c776-7096-4c1a-874f-b1930bd620d9 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:30:56.850313 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:30:56.909614 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2633c776-7096-4c1a-874f-b1930bd620d9 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:30:56.955932 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f17c06-3876-472d-896d-83b3b79e71a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:30:56.956884 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f17c06-3876-472d-896d-83b3b79e71a8 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:30:56.957388 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f17c06-3876-472d-896d-83b3b79e71a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:30:56.957751 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f17c06-3876-472d-896d-83b3b79e71a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:30:56.971097 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f17c06-3876-472d-896d-83b3b79e71a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:30:56.972613 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f17c06-3876-472d-896d-83b3b79e71a8 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:30:56.988430 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-32f17c06-3876-472d-896d-83b3b79e71a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:30:56.988430 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:30:56.988430 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:30:56.988430 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:30:56.988430 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:30:56.988430 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:30:56.988430 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:30:56.988430 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:30:56.988430 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:30:56.988430 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:30:56.988430 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:30:56.988430 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:30:56.988430 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:30:56.988430 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:30:56.988430 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:30:56.989554 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:30:56.989554 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:30:56.989554 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:30:56.989554 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:30:56.989554 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:30:56.989554 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:30:56.989554 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:30:56.989554 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:30:56.989554 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:30:56.989554 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:30:56.989554 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:30:56.989554 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:30:56.989554 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:30:56.989554 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:30:56.989554 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:30:56.989554 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:30:56.989554 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:30:56.996758 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:30:56.996758 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:30:56.996758 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:30:56.996758 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:30:56.996758 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 609/1224] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 2 21:30:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:30:56.997093 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b2d5dc-8c8e-4b59-8a04-81789da9d0eb None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:30:57.106762 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b2d5dc-8c8e-4b59-8a04-81789da9d0eb None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:30:57.142154 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e81343-1acc-4374-a7e3-5e4d28ee23d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:30:57.142880 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e81343-1acc-4374-a7e3-5e4d28ee23d1 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:30:57.143237 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e81343-1acc-4374-a7e3-5e4d28ee23d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:30:57.143520 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e81343-1acc-4374-a7e3-5e4d28ee23d1 None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:30:57.144408 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e81343-1acc-4374-a7e3-5e4d28ee23d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:30:57.144763 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e81343-1acc-4374-a7e3-5e4d28ee23d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:30:57.146304 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e81343-1acc-4374-a7e3-5e4d28ee23d1 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:30:57.158632 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 616/1225] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 2 21:30:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:30:57.164702 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f17c06-3876-472d-896d-83b3b79e71a8 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:30:57.260529 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:30:57.267424 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f17c06-3876-472d-896d-83b3b79e71a8 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:30:57.302074 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6ef937-c8c9-4f6a-bb91-e8f11e49dce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:30:57.302715 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ef937-c8c9-4f6a-bb91-e8f11e49dce0 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:30:57.303156 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ef937-c8c9-4f6a-bb91-e8f11e49dce0 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:30:57.303429 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ef937-c8c9-4f6a-bb91-e8f11e49dce0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:30:57.311623 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6ef937-c8c9-4f6a-bb91-e8f11e49dce0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:30:57.313083 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6ef937-c8c9-4f6a-bb91-e8f11e49dce0 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:30:57.325107 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-ff6ef937-c8c9-4f6a-bb91-e8f11e49dce0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 02 21:30:57.325107 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:30:57.325107 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:30:57.325107 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:30:57.325107 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:30:57.325107 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:30:57.325107 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:30:57.325107 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:30:57.325107 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:30:57.325107 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:30:57.325107 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:30:57.325107 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:30:57.325107 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 21:30:57.325107 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 21:30:57.325107 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 21:30:57.325107 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 21:30:57.326340 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:30:57.326340 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:30:57.326340 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 21:30:57.326340 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:30:57.326340 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 21:30:57.326340 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:30:57.326340 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:30:57.326340 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:30:57.326340 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:30:57.326340 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:30:57.326340 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:30:57.326340 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:30:57.326340 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:30:57.326340 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:30:57.326340 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:30:57.326340 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:30:57.326340 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:30:57.326340 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:30:57.327488 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:30:57.327488 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:30:57.327488 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 21:30:57.327488 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 21:30:57.327488 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 21:30:57.327488 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 21:30:57.327488 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 21:30:57.327488 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 21:30:57.327488 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 02 21:30:57.327488 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:30:57.327488 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 610/1226] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 2 21:30:57 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 21:30:57.332437 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e81343-1acc-4374-a7e3-5e4d28ee23d1 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:30:57.381188 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:30:57.437115 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e81343-1acc-4374-a7e3-5e4d28ee23d1 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:30:57.476149 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa06dffc-455c-4eea-b417-b2bec76d5901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:30:57.478157 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa06dffc-455c-4eea-b417-b2bec76d5901 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:30:57.478157 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa06dffc-455c-4eea-b417-b2bec76d5901 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:30:57.478157 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa06dffc-455c-4eea-b417-b2bec76d5901 None admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:30:57.479025 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa06dffc-455c-4eea-b417-b2bec76d5901 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:30:57.479334 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa06dffc-455c-4eea-b417-b2bec76d5901 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:30:57.480797 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa06dffc-455c-4eea-b417-b2bec76d5901 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:30:57.501120 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 617/1227] 10.222.0.70 () {56 vars in 1143 bytes} [Tue Aug 2 21:30:57 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:30:57.507293 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6ef937-c8c9-4f6a-bb91-e8f11e49dce0 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:30:57.622784 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6ef937-c8c9-4f6a-bb91-e8f11e49dce0 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:30:57.670962 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d392b6-3373-4e30-a1c3-e6131533c835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:30:57.671594 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d392b6-3373-4e30-a1c3-e6131533c835 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:30:57.671884 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d392b6-3373-4e30-a1c3-e6131533c835 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:30:57.672169 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d392b6-3373-4e30-a1c3-e6131533c835 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:30:57.686902 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d392b6-3373-4e30-a1c3-e6131533c835 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:30:57.688632 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d392b6-3373-4e30-a1c3-e6131533c835 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:30:57.704781 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-06d392b6-3373-4e30-a1c3-e6131533c835 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:30:57.704781 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:30:57.704781 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:30:57.704781 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:30:57.704781 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:30:57.704781 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:30:57.704781 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:30:57.704781 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:30:57.704781 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:30:57.704781 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:30:57.704781 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:30:57.704781 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:30:57.704781 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:30:57.704781 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:30:57.704781 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:30:57.706094 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:30:57.706094 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:30:57.706094 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:30:57.706094 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:30:57.706094 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:30:57.706094 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:30:57.706094 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:30:57.706094 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:30:57.706094 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:30:57.706094 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:30:57.706094 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:30:57.706094 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:30:57.706094 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:30:57.706094 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:30:57.706094 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:30:57.706094 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:30:57.706094 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:30:57.707581 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:30:57.707581 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:30:57.707581 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:30:57.707581 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:30:57.707581 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 611/1228] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 2 21:30:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:30:57.712287 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa06dffc-455c-4eea-b417-b2bec76d5901 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:30:57.825387 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa06dffc-455c-4eea-b417-b2bec76d5901 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:30:57.827774 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:30:57.864713 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360ae335-d861-4ac4-99c8-cd91f5ecfe76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:30:57.865623 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360ae335-d861-4ac4-99c8-cd91f5ecfe76 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:30:57.865913 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360ae335-d861-4ac4-99c8-cd91f5ecfe76 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:30:57.866190 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360ae335-d861-4ac4-99c8-cd91f5ecfe76 None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:30:57.866882 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360ae335-d861-4ac4-99c8-cd91f5ecfe76 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:30:57.867235 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360ae335-d861-4ac4-99c8-cd91f5ecfe76 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:30:57.868631 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360ae335-d861-4ac4-99c8-cd91f5ecfe76 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:30:57.881451 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 618/1229] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 2 21:30:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:30:57.888209 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d392b6-3373-4e30-a1c3-e6131533c835 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:30:57.898873 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:30:58.007993 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d392b6-3373-4e30-a1c3-e6131533c835 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:30:58.050076 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71b0e86-aa91-49f9-88ec-f6dd89f2f562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:30:58.050676 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b0e86-aa91-49f9-88ec-f6dd89f2f562 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:30:58.050966 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b0e86-aa91-49f9-88ec-f6dd89f2f562 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:30:58.051229 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b0e86-aa91-49f9-88ec-f6dd89f2f562 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:30:58.058014 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71b0e86-aa91-49f9-88ec-f6dd89f2f562 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:30:58.059506 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71b0e86-aa91-49f9-88ec-f6dd89f2f562 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:30:58.071627 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-a71b0e86-aa91-49f9-88ec-f6dd89f2f562 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:30:58.071627 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:30:58.071627 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:30:58.071627 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:30:58.071627 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:30:58.071627 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:30:58.071627 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:30:58.071627 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:30:58.071627 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:30:58.071627 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:30:58.071627 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:30:58.071627 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:30:58.071627 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 21:30:58.071627 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 21:30:58.071627 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 21:30:58.072899 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 21:30:58.072899 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:30:58.072899 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:30:58.072899 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:30:58.072899 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:30:58.072899 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:30:58.072899 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:30:58.072899 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:30:58.072899 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:30:58.072899 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:30:58.072899 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:30:58.072899 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:30:58.072899 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:30:58.072899 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:30:58.072899 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:30:58.072899 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:30:58.072899 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:30:58.073962 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 21:30:58.073962 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 21:30:58.073962 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 21:30:58.073962 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 21:30:58.073962 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 21:30:58.073962 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 21:30:58.073962 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:30:58.073962 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:30:58.073962 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 612/1230] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Aug 2 21:30:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:30:58.079295 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360ae335-d861-4ac4-99c8-cd91f5ecfe76 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:30:58.191196 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360ae335-d861-4ac4-99c8-cd91f5ecfe76 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:30:58.226607 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d98098-161f-4543-b784-370bf632cbb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:30:58.227317 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d98098-161f-4543-b784-370bf632cbb2 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:30:58.227668 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d98098-161f-4543-b784-370bf632cbb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:30:58.228012 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d98098-161f-4543-b784-370bf632cbb2 None admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:30:58.228883 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d98098-161f-4543-b784-370bf632cbb2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:30:58.229196 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d98098-161f-4543-b784-370bf632cbb2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:30:58.230633 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d98098-161f-4543-b784-370bf632cbb2 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:30:58.244190 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 619/1231] 10.222.0.70 () {56 vars in 1148 bytes} [Tue Aug 2 21:30:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:30:58.250231 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71b0e86-aa91-49f9-88ec-f6dd89f2f562 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:30:58.326922 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:30:58.366760 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71b0e86-aa91-49f9-88ec-f6dd89f2f562 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:30:58.401855 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a863b4c1-48f7-4f11-9d2f-c641006744a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:30:58.402601 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a863b4c1-48f7-4f11-9d2f-c641006744a9 None admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:30:58.402875 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a863b4c1-48f7-4f11-9d2f-c641006744a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:30:58.403126 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a863b4c1-48f7-4f11-9d2f-c641006744a9 None admin] PATH_INFO: `/v3/projects/42672e04d6ce4b0ab5f7eccfb0cc946c/users/83fcd951771e42959506b70b0137003f/roles/59a4c9a6a22d4bdb966856a28c4aabaf` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:30:58.417894 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a863b4c1-48f7-4f11-9d2f-c641006744a9 None admin] RBAC: Authorizing `identity:create_grant(project_id=42672e04d6ce4b0ab5f7eccfb0cc946c, user_id=83fcd951771e42959506b70b0137003f, role_id=59a4c9a6a22d4bdb966856a28c4aabaf)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:30:58.419351 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a863b4c1-48f7-4f11-9d2f-c641006744a9 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:30:58.431500 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 613/1232] 10.222.0.70 () {58 vars in 1439 bytes} [Tue Aug 2 21:30:58 2022] PUT /identity/v3/projects/42672e04d6ce4b0ab5f7eccfb0cc946c/users/83fcd951771e42959506b70b0137003f/roles/59a4c9a6a22d4bdb966856a28c4aabaf => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:31:00.640366 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17628773-f6f3-4dde-be2a-107dbac11dc6 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:31:00.640875 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17628773-f6f3-4dde-be2a-107dbac11dc6 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:31:00.640875 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17628773-f6f3-4dde-be2a-107dbac11dc6 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:31:00.642355 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 620/1233] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:31:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:31:00.648254 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711fcee4-232c-47a1-8b1a-3ccabcb6d65b None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:31:00.648678 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711fcee4-232c-47a1-8b1a-3ccabcb6d65b None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:31:00.648817 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711fcee4-232c-47a1-8b1a-3ccabcb6d65b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:31:00.667667 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-711fcee4-232c-47a1-8b1a-3ccabcb6d65b None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:31:00.668890 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-711fcee4-232c-47a1-8b1a-3ccabcb6d65b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:31:00.737397 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 614/1234] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:31:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 21:31:00.761091 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17628773-f6f3-4dde-be2a-107dbac11dc6 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:31:00.789677 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:31:00.875519 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17628773-f6f3-4dde-be2a-107dbac11dc6 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:31:00.912527 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce822e4-62b4-4b51-8db8-9f25ee48eb03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:31:00.913457 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce822e4-62b4-4b51-8db8-9f25ee48eb03 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:31:00.913752 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce822e4-62b4-4b51-8db8-9f25ee48eb03 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:31:00.914598 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce822e4-62b4-4b51-8db8-9f25ee48eb03 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:31:00.927266 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce822e4-62b4-4b51-8db8-9f25ee48eb03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:31:00.932657 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-cce822e4-62b4-4b51-8db8-9f25ee48eb03 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 02 21:31:00.932657 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:31:00.932657 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:31:00.932657 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:31:00.932657 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:31:00.932657 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:31:00.932657 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:31:00.932657 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:31:00.932657 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:31:00.932657 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:31:00.932657 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:31:00.932657 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:31:00.932657 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:31:00.932657 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:31:00.932657 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:31:00.932657 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:31:00.933667 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:31:00.933667 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:31:00.933667 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:31:00.933667 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:31:00.933667 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:31:00.933667 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:31:00.933667 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:31:00.933667 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:31:00.933667 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:31:00.933667 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:31:00.933667 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:31:00.933667 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:31:00.933667 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:31:00.933667 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:31:00.933667 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:31:00.933667 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:31:00.934618 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:31:00.934618 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:31:00.934618 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:31:00.934618 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:31:00.934618 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:31:00.934618 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:31:00.934618 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:31:00.934618 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:31:00.934618 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:31:00.934618 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:31:00.934618 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 02 21:31:00.934618 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:31:00.934618 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 621/1235] 10.222.0.70 () {56 vars in 1102 bytes} [Tue Aug 2 21:31:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:31:00.939940 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711fcee4-232c-47a1-8b1a-3ccabcb6d65b None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:31:00.992647 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:31:01.057636 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711fcee4-232c-47a1-8b1a-3ccabcb6d65b None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:31:01.104002 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9085764a-313b-4484-9c31-b8fcdcbb68bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:31:01.104741 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9085764a-313b-4484-9c31-b8fcdcbb68bb None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:31:01.105034 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9085764a-313b-4484-9c31-b8fcdcbb68bb None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:31:01.105352 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9085764a-313b-4484-9c31-b8fcdcbb68bb None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:31:01.106135 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9085764a-313b-4484-9c31-b8fcdcbb68bb None admin] RBAC: Adding query filter params (name=service) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:31:01.106480 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9085764a-313b-4484-9c31-b8fcdcbb68bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:31:01.107924 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9085764a-313b-4484-9c31-b8fcdcbb68bb None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:31:01.117123 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 615/1236] 10.222.0.70 () {56 vars in 1103 bytes} [Tue Aug 2 21:31:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:31:01.122793 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce822e4-62b4-4b51-8db8-9f25ee48eb03 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:31:01.216762 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:31:01.234070 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce822e4-62b4-4b51-8db8-9f25ee48eb03 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:31:01.272044 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3efc7b-c831-42d0-98ce-138826518122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:31:01.272715 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3efc7b-c831-42d0-98ce-138826518122 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:31:01.273003 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3efc7b-c831-42d0-98ce-138826518122 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:31:01.273839 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3efc7b-c831-42d0-98ce-138826518122 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:31:01.288500 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3efc7b-c831-42d0-98ce-138826518122 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:31:01.290026 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3efc7b-c831-42d0-98ce-138826518122 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:31:01.306124 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-da3efc7b-c831-42d0-98ce-138826518122 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:31:01.306124 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:31:01.306124 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:31:01.306124 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:31:01.306124 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:31:01.306124 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:31:01.306124 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:31:01.306124 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:31:01.306124 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:31:01.306124 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:31:01.306124 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:31:01.306124 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:31:01.306124 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:31:01.306124 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:31:01.306124 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:31:01.307256 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:31:01.307256 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:31:01.307256 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:31:01.307256 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:31:01.307256 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:31:01.307256 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:31:01.307256 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:31:01.307256 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:31:01.307256 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:31:01.307256 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:31:01.307256 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:31:01.307256 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:31:01.307256 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:31:01.307256 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:31:01.307256 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:31:01.307256 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:31:01.307256 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:31:01.308262 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:31:01.308262 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:31:01.308262 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:31:01.308262 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:31:01.308262 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 622/1237] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 2 21:31:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:31:01.313068 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9085764a-313b-4484-9c31-b8fcdcbb68bb None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:31:01.422122 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9085764a-313b-4484-9c31-b8fcdcbb68bb None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:31:01.431930 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:31:01.465469 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e0efc4-eb44-451a-8db9-a98beecf322a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:31:01.466170 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e0efc4-eb44-451a-8db9-a98beecf322a None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:31:01.466532 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e0efc4-eb44-451a-8db9-a98beecf322a None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:31:01.467047 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e0efc4-eb44-451a-8db9-a98beecf322a None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:31:01.467610 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e0efc4-eb44-451a-8db9-a98beecf322a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:31:01.467930 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e0efc4-eb44-451a-8db9-a98beecf322a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:31:01.469366 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e0efc4-eb44-451a-8db9-a98beecf322a None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:31:01.486478 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 616/1238] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 2 21:31:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:31:01.493182 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3efc7b-c831-42d0-98ce-138826518122 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:31:01.604704 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3efc7b-c831-42d0-98ce-138826518122 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:31:01.646201 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0686ac83-f690-42df-bd67-f0db39a9785d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:31:01.646911 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0686ac83-f690-42df-bd67-f0db39a9785d None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:31:01.647120 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0686ac83-f690-42df-bd67-f0db39a9785d None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:31:01.647398 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0686ac83-f690-42df-bd67-f0db39a9785d None admin] PATH_INFO: `/v3/users/placement` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:31:01.650404 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:31:01.656187 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0686ac83-f690-42df-bd67-f0db39a9785d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:31:01.658362 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0686ac83-f690-42df-bd67-f0db39a9785d None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:31:01.670630 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-0686ac83-f690-42df-bd67-f0db39a9785d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 02 21:31:01.670630 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:31:01.670630 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:31:01.670630 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:31:01.670630 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:31:01.670630 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:31:01.670630 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:31:01.670630 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:31:01.670630 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:31:01.670630 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:31:01.670630 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:31:01.670630 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:31:01.670630 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 21:31:01.670630 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 21:31:01.670630 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 21:31:01.670630 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 21:31:01.671957 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:31:01.671957 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:31:01.671957 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 21:31:01.671957 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:31:01.671957 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 21:31:01.671957 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:31:01.671957 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:31:01.671957 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:31:01.671957 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:31:01.671957 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:31:01.671957 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:31:01.671957 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:31:01.671957 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:31:01.671957 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:31:01.671957 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:31:01.671957 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:31:01.671957 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:31:01.671957 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:31:01.673151 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:31:01.673151 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:31:01.673151 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 21:31:01.673151 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 21:31:01.673151 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 21:31:01.673151 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 21:31:01.673151 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 21:31:01.673151 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 21:31:01.673151 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 02 21:31:01.673151 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:31:01.673151 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 623/1239] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 2 21:31:01 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:31:01.678247 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e0efc4-eb44-451a-8db9-a98beecf322a None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:31:01.794810 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e0efc4-eb44-451a-8db9-a98beecf322a None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:31:01.831764 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6456e24-a0f8-4f07-95d5-0eebda72103e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:31:01.832477 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6456e24-a0f8-4f07-95d5-0eebda72103e None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:31:01.832763 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6456e24-a0f8-4f07-95d5-0eebda72103e None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:31:01.833034 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6456e24-a0f8-4f07-95d5-0eebda72103e None admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:31:01.833920 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6456e24-a0f8-4f07-95d5-0eebda72103e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:31:01.834259 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6456e24-a0f8-4f07-95d5-0eebda72103e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:31:01.835844 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6456e24-a0f8-4f07-95d5-0eebda72103e None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:31:01.854666 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 617/1240] 10.222.0.70 () {56 vars in 1143 bytes} [Tue Aug 2 21:31:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:31:01.860986 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0686ac83-f690-42df-bd67-f0db39a9785d None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:31:01.985108 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0686ac83-f690-42df-bd67-f0db39a9785d None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:31:02.020365 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66727f2-75cc-4c0c-ad1c-9699be6da80f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:31:02.020983 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66727f2-75cc-4c0c-ad1c-9699be6da80f None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:31:02.021269 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66727f2-75cc-4c0c-ad1c-9699be6da80f None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:31:02.021550 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66727f2-75cc-4c0c-ad1c-9699be6da80f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:31:02.094774 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:31:02.103942 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66727f2-75cc-4c0c-ad1c-9699be6da80f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:31:02.106242 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66727f2-75cc-4c0c-ad1c-9699be6da80f None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:31:02.226827 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 624/1241] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 2 21:31:01 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 21:31:02.232810 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6456e24-a0f8-4f07-95d5-0eebda72103e None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:31:02.262566 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:31:02.348717 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6456e24-a0f8-4f07-95d5-0eebda72103e None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:31:02.385169 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7fa7ce-eb8c-4a95-804c-483628a9efa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:31:02.385853 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7fa7ce-eb8c-4a95-804c-483628a9efa6 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:31:02.386136 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7fa7ce-eb8c-4a95-804c-483628a9efa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:31:02.386408 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7fa7ce-eb8c-4a95-804c-483628a9efa6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:31:02.397222 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7fa7ce-eb8c-4a95-804c-483628a9efa6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:31:02.398819 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7fa7ce-eb8c-4a95-804c-483628a9efa6 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:31:02.414680 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-be7fa7ce-eb8c-4a95-804c-483628a9efa6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:31:02.414680 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:31:02.414680 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:31:02.414680 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:31:02.414680 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:31:02.414680 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:31:02.414680 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:31:02.414680 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:31:02.414680 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:31:02.414680 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:31:02.414680 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:31:02.414680 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:31:02.414680 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:31:02.414680 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:31:02.414680 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:31:02.415809 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:31:02.415809 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:31:02.415809 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:31:02.415809 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:31:02.415809 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:31:02.415809 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:31:02.415809 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:31:02.415809 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:31:02.415809 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:31:02.415809 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:31:02.415809 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:31:02.415809 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:31:02.415809 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:31:02.415809 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:31:02.415809 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:31:02.415809 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:31:02.415809 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:31:02.416771 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:31:02.416771 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:31:02.416771 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:31:02.416771 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:31:02.416771 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 618/1242] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 2 21:31:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 21:31:02.421833 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66727f2-75cc-4c0c-ad1c-9699be6da80f None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:31:02.528597 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:31:02.532687 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66727f2-75cc-4c0c-ad1c-9699be6da80f None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:31:02.569792 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ed16b4-f30d-4bb2-bd6b-6712c2470bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:31:02.571001 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ed16b4-f30d-4bb2-bd6b-6712c2470bda None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:31:02.571285 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ed16b4-f30d-4bb2-bd6b-6712c2470bda None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:31:02.571566 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ed16b4-f30d-4bb2-bd6b-6712c2470bda None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:31:02.572343 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ed16b4-f30d-4bb2-bd6b-6712c2470bda None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:31:02.572586 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ed16b4-f30d-4bb2-bd6b-6712c2470bda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:31:02.573950 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ed16b4-f30d-4bb2-bd6b-6712c2470bda None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:31:02.587008 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 625/1243] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 2 21:31:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:31:02.592882 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7fa7ce-eb8c-4a95-804c-483628a9efa6 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:31:02.685946 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:31:02.710406 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7fa7ce-eb8c-4a95-804c-483628a9efa6 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:31:02.746350 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33174603-651b-4370-a58c-f909f4c56aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:31:02.746981 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33174603-651b-4370-a58c-f909f4c56aaf None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:31:02.747264 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33174603-651b-4370-a58c-f909f4c56aaf None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:31:02.747538 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33174603-651b-4370-a58c-f909f4c56aaf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:31:02.754539 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33174603-651b-4370-a58c-f909f4c56aaf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:31:02.756090 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33174603-651b-4370-a58c-f909f4c56aaf None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:31:02.768887 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-33174603-651b-4370-a58c-f909f4c56aaf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:31:02.768887 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:31:02.768887 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:31:02.768887 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:31:02.768887 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:31:02.768887 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:31:02.768887 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:31:02.768887 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:31:02.768887 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:31:02.768887 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:31:02.768887 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:31:02.768887 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:31:02.768887 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 21:31:02.768887 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 21:31:02.768887 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 21:31:02.769891 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 21:31:02.769891 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:31:02.769891 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:31:02.769891 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:31:02.769891 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:31:02.769891 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:31:02.769891 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:31:02.769891 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:31:02.769891 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:31:02.769891 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:31:02.769891 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:31:02.769891 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:31:02.769891 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:31:02.769891 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:31:02.769891 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:31:02.769891 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:31:02.769891 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:31:02.770807 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 21:31:02.770807 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 21:31:02.770807 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 21:31:02.770807 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 21:31:02.770807 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 21:31:02.770807 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 21:31:02.770807 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:31:02.770807 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:31:02.770807 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 619/1244] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Aug 2 21:31:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:31:02.776362 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ed16b4-f30d-4bb2-bd6b-6712c2470bda None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:31:02.882142 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ed16b4-f30d-4bb2-bd6b-6712c2470bda None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:31:02.920262 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a3cc41-6083-4f07-988b-0666523ba337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:31:02.920900 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a3cc41-6083-4f07-988b-0666523ba337 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:31:02.921164 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a3cc41-6083-4f07-988b-0666523ba337 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:31:02.921440 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a3cc41-6083-4f07-988b-0666523ba337 None admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:31:02.922238 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a3cc41-6083-4f07-988b-0666523ba337 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:31:02.922545 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a3cc41-6083-4f07-988b-0666523ba337 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:31:02.924071 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a3cc41-6083-4f07-988b-0666523ba337 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:31:02.938576 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 626/1245] 10.222.0.70 () {56 vars in 1148 bytes} [Tue Aug 2 21:31:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:31:02.944961 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33174603-651b-4370-a58c-f909f4c56aaf None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:31:03.063676 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33174603-651b-4370-a58c-f909f4c56aaf None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:31:03.102953 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272bfb03-fd3e-4acd-93b9-e1f86017d7b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:31:03.103611 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272bfb03-fd3e-4acd-93b9-e1f86017d7b7 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:31:03.103858 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272bfb03-fd3e-4acd-93b9-e1f86017d7b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:31:03.104136 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272bfb03-fd3e-4acd-93b9-e1f86017d7b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:31:03.104963 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272bfb03-fd3e-4acd-93b9-e1f86017d7b7 None admin] RBAC: Adding query filter params (role.id=59a4c9a6a22d4bdb966856a28c4aabaf, scope.project.id=42672e04d6ce4b0ab5f7eccfb0cc946c, user.id=83fcd951771e42959506b70b0137003f) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:31:03.105273 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272bfb03-fd3e-4acd-93b9-e1f86017d7b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:31:03.106700 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272bfb03-fd3e-4acd-93b9-e1f86017d7b7 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:31:03.112956 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 620/1246] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Aug 2 21:31:02 2022] GET /identity/v3/role_assignments?user.id=83fcd951771e42959506b70b0137003f&scope.project.id=42672e04d6ce4b0ab5f7eccfb0cc946c&role.id=59a4c9a6a22d4bdb966856a28c4aabaf => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:31:05.453948 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461d104d-0434-4c5a-b403-c31b6d19726b None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:31:05.454549 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461d104d-0434-4c5a-b403-c31b6d19726b None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:31:05.454682 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461d104d-0434-4c5a-b403-c31b6d19726b None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:31:05.456110 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 627/1247] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:31:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:31:05.462282 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc849cf-358b-4538-8906-f4dcddc4936a None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:31:05.462772 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc849cf-358b-4538-8906-f4dcddc4936a None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:31:05.462919 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc849cf-358b-4538-8906-f4dcddc4936a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:31:05.469944 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:31:05.484555 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-ebc849cf-358b-4538-8906-f4dcddc4936a None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:31:05.485970 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-ebc849cf-358b-4538-8906-f4dcddc4936a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:31:05.566737 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 621/1248] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:31:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 21:31:05.593290 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461d104d-0434-4c5a-b403-c31b6d19726b None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:31:05.612670 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:31:05.713075 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461d104d-0434-4c5a-b403-c31b6d19726b None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:31:05.751930 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149a6c9f-7c18-45fd-9c83-45f38bdcd22c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:31:05.752717 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149a6c9f-7c18-45fd-9c83-45f38bdcd22c None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:31:05.753059 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149a6c9f-7c18-45fd-9c83-45f38bdcd22c None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:31:05.753361 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149a6c9f-7c18-45fd-9c83-45f38bdcd22c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:31:05.764878 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149a6c9f-7c18-45fd-9c83-45f38bdcd22c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:31:05.769849 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-149a6c9f-7c18-45fd-9c83-45f38bdcd22c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 21:31:05.769849 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:31:05.769849 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:31:05.769849 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:31:05.769849 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:31:05.769849 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:31:05.769849 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:31:05.769849 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:31:05.769849 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:31:05.769849 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:31:05.769849 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:31:05.769849 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:31:05.769849 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:31:05.769849 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:31:05.769849 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:31:05.769849 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:31:05.770920 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:31:05.770920 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:31:05.770920 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:31:05.770920 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:31:05.770920 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:31:05.770920 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:31:05.770920 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:31:05.770920 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:31:05.770920 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:31:05.770920 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:31:05.770920 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:31:05.770920 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:31:05.770920 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:31:05.770920 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:31:05.770920 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:31:05.770920 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:31:05.771840 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:31:05.771840 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:31:05.771840 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:31:05.771840 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:31:05.771840 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:31:05.771840 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:31:05.771840 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:31:05.771840 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:31:05.771840 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:31:05.771840 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:31:05.771840 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 21:31:05.771840 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:31:05.771840 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 628/1249] 10.222.0.70 () {56 vars in 1096 bytes} [Tue Aug 2 21:31:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:31:05.777293 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc849cf-358b-4538-8906-f4dcddc4936a None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:31:05.883931 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc849cf-358b-4538-8906-f4dcddc4936a None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:31:05.918049 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:31:05.924532 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5181b97f-d1de-44d7-aa63-7cb8ad4ba40a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:31:05.925172 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5181b97f-d1de-44d7-aa63-7cb8ad4ba40a None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:31:05.925462 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5181b97f-d1de-44d7-aa63-7cb8ad4ba40a None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:31:05.925757 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5181b97f-d1de-44d7-aa63-7cb8ad4ba40a None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:31:05.926469 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5181b97f-d1de-44d7-aa63-7cb8ad4ba40a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:31:05.926783 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5181b97f-d1de-44d7-aa63-7cb8ad4ba40a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:31:05.928156 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5181b97f-d1de-44d7-aa63-7cb8ad4ba40a None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:31:05.937678 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 622/1250] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 2 21:31:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:31:05.943854 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149a6c9f-7c18-45fd-9c83-45f38bdcd22c None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:31:06.032063 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:31:06.062123 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149a6c9f-7c18-45fd-9c83-45f38bdcd22c None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:31:06.101095 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf6ff38-1d8e-4169-b968-dfc52b643481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:31:06.102396 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf6ff38-1d8e-4169-b968-dfc52b643481 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:31:06.102680 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf6ff38-1d8e-4169-b968-dfc52b643481 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:31:06.102996 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf6ff38-1d8e-4169-b968-dfc52b643481 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:31:06.114168 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf6ff38-1d8e-4169-b968-dfc52b643481 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:31:06.116191 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf6ff38-1d8e-4169-b968-dfc52b643481 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:31:06.133155 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-ccf6ff38-1d8e-4169-b968-dfc52b643481 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:31:06.133155 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:31:06.133155 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:31:06.133155 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:31:06.133155 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:31:06.133155 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:31:06.133155 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:31:06.133155 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:31:06.133155 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:31:06.133155 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:31:06.133155 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:31:06.133155 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:31:06.133155 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:31:06.133155 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:31:06.133155 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:31:06.134355 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:31:06.134355 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:31:06.134355 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:31:06.134355 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:31:06.134355 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:31:06.134355 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:31:06.134355 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:31:06.134355 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:31:06.134355 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:31:06.134355 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:31:06.134355 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:31:06.134355 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:31:06.134355 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:31:06.134355 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:31:06.134355 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:31:06.134355 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:31:06.134355 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:31:06.135470 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:31:06.135470 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:31:06.135470 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:31:06.135470 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:31:06.135470 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 629/1251] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 2 21:31:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:31:06.140418 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5181b97f-d1de-44d7-aa63-7cb8ad4ba40a None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:31:06.256599 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5181b97f-d1de-44d7-aa63-7cb8ad4ba40a None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:31:06.295484 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d034f3bb-4d51-436b-a7dc-e06ce96f05fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:31:06.296065 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d034f3bb-4d51-436b-a7dc-e06ce96f05fc None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:31:06.296380 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d034f3bb-4d51-436b-a7dc-e06ce96f05fc None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:31:06.296657 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d034f3bb-4d51-436b-a7dc-e06ce96f05fc None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:31:06.297345 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d034f3bb-4d51-436b-a7dc-e06ce96f05fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:31:06.297649 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d034f3bb-4d51-436b-a7dc-e06ce96f05fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:31:06.299039 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d034f3bb-4d51-436b-a7dc-e06ce96f05fc None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:31:06.312476 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 623/1252] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 2 21:31:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:31:06.318292 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf6ff38-1d8e-4169-b968-dfc52b643481 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:31:06.431095 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf6ff38-1d8e-4169-b968-dfc52b643481 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:31:06.460145 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:31:06.469599 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedbd934-7227-4829-89cb-925c18d8bb10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:31:06.470243 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedbd934-7227-4829-89cb-925c18d8bb10 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:31:06.470526 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedbd934-7227-4829-89cb-925c18d8bb10 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:31:06.470799 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedbd934-7227-4829-89cb-925c18d8bb10 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:31:06.479095 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedbd934-7227-4829-89cb-925c18d8bb10 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:31:06.480602 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedbd934-7227-4829-89cb-925c18d8bb10 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:31:06.492618 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-eedbd934-7227-4829-89cb-925c18d8bb10 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 02 21:31:06.492618 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:31:06.492618 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:31:06.492618 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:31:06.492618 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:31:06.492618 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:31:06.492618 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:31:06.492618 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:31:06.492618 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:31:06.492618 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:31:06.492618 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:31:06.492618 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:31:06.492618 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 21:31:06.492618 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 21:31:06.492618 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 21:31:06.492618 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 21:31:06.493807 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:31:06.493807 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:31:06.493807 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 21:31:06.493807 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:31:06.493807 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 21:31:06.493807 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:31:06.493807 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:31:06.493807 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:31:06.493807 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:31:06.493807 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:31:06.493807 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:31:06.493807 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:31:06.493807 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:31:06.493807 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:31:06.493807 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:31:06.493807 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:31:06.493807 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:31:06.493807 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:31:06.494852 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:31:06.494852 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:31:06.494852 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 21:31:06.494852 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 21:31:06.494852 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 21:31:06.494852 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 21:31:06.494852 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 21:31:06.494852 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 21:31:06.494852 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 02 21:31:06.494852 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:31:06.494852 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 630/1253] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 2 21:31:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 21:31:06.500047 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d034f3bb-4d51-436b-a7dc-e06ce96f05fc None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:31:06.559645 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:31:06.606278 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d034f3bb-4d51-436b-a7dc-e06ce96f05fc None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:31:06.641856 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887f2cd1-d640-4ec4-b12a-7b4c085dc47d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:31:06.642518 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887f2cd1-d640-4ec4-b12a-7b4c085dc47d None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:31:06.642834 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887f2cd1-d640-4ec4-b12a-7b4c085dc47d None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:31:06.643111 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887f2cd1-d640-4ec4-b12a-7b4c085dc47d None admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:31:06.643903 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887f2cd1-d640-4ec4-b12a-7b4c085dc47d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:31:06.644213 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887f2cd1-d640-4ec4-b12a-7b4c085dc47d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:31:06.645812 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887f2cd1-d640-4ec4-b12a-7b4c085dc47d None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:31:06.666702 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 624/1254] 10.222.0.70 () {56 vars in 1143 bytes} [Tue Aug 2 21:31:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:31:06.672532 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedbd934-7227-4829-89cb-925c18d8bb10 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:31:06.783420 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedbd934-7227-4829-89cb-925c18d8bb10 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:31:06.828700 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c2dc4c-d7c2-4706-a2f7-49d20925daf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:31:06.829421 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c2dc4c-d7c2-4706-a2f7-49d20925daf7 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:31:06.829694 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c2dc4c-d7c2-4706-a2f7-49d20925daf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:31:06.830005 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c2dc4c-d7c2-4706-a2f7-49d20925daf7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:31:06.889680 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:31:06.902839 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c2dc4c-d7c2-4706-a2f7-49d20925daf7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:31:06.904343 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c2dc4c-d7c2-4706-a2f7-49d20925daf7 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:31:07.014391 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 631/1255] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 2 21:31:06 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 21:31:07.020240 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887f2cd1-d640-4ec4-b12a-7b4c085dc47d None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:31:07.129609 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887f2cd1-d640-4ec4-b12a-7b4c085dc47d None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:31:07.144732 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:31:07.169530 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6d0183-7411-4b53-afe9-c1944f082cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:31:07.170261 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6d0183-7411-4b53-afe9-c1944f082cca None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:31:07.170595 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6d0183-7411-4b53-afe9-c1944f082cca None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:31:07.171016 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6d0183-7411-4b53-afe9-c1944f082cca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:31:07.182027 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6d0183-7411-4b53-afe9-c1944f082cca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:31:07.183582 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6d0183-7411-4b53-afe9-c1944f082cca None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:31:07.200176 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-ff6d0183-7411-4b53-afe9-c1944f082cca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:31:07.200176 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:31:07.200176 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:31:07.200176 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:31:07.200176 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:31:07.200176 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:31:07.200176 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:31:07.200176 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:31:07.200176 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:31:07.200176 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:31:07.200176 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:31:07.200176 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:31:07.200176 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:31:07.200176 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:31:07.200176 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:31:07.201397 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:31:07.201397 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:31:07.201397 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:31:07.201397 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:31:07.201397 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:31:07.201397 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:31:07.201397 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:31:07.201397 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:31:07.201397 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:31:07.201397 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:31:07.201397 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:31:07.201397 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:31:07.201397 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:31:07.201397 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:31:07.201397 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:31:07.201397 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:31:07.201397 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:31:07.202719 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:31:07.202719 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:31:07.202719 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:31:07.202719 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:31:07.202719 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 625/1256] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 2 21:31:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 02 21:31:07.207254 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c2dc4c-d7c2-4706-a2f7-49d20925daf7 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:31:07.308377 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:31:07.323950 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c2dc4c-d7c2-4706-a2f7-49d20925daf7 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:31:07.366471 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a928a6a-fc3c-46ec-ac89-2893cb316dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:31:07.366471 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a928a6a-fc3c-46ec-ac89-2893cb316dde None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:31:07.366471 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a928a6a-fc3c-46ec-ac89-2893cb316dde None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:31:07.366471 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a928a6a-fc3c-46ec-ac89-2893cb316dde None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:31:07.366985 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a928a6a-fc3c-46ec-ac89-2893cb316dde None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:31:07.366985 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a928a6a-fc3c-46ec-ac89-2893cb316dde None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:31:07.368397 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a928a6a-fc3c-46ec-ac89-2893cb316dde None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:31:07.387583 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 632/1257] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 2 21:31:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:31:07.393784 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6d0183-7411-4b53-afe9-c1944f082cca None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:31:07.506870 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6d0183-7411-4b53-afe9-c1944f082cca None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:31:07.547730 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d743c11-775e-4f34-b8de-b6c8c37e6213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:31:07.548539 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d743c11-775e-4f34-b8de-b6c8c37e6213 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:31:07.548802 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d743c11-775e-4f34-b8de-b6c8c37e6213 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:31:07.549201 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d743c11-775e-4f34-b8de-b6c8c37e6213 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:31:07.558441 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d743c11-775e-4f34-b8de-b6c8c37e6213 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:31:07.560209 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d743c11-775e-4f34-b8de-b6c8c37e6213 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:31:07.574618 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-4d743c11-775e-4f34-b8de-b6c8c37e6213 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:31:07.574618 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:31:07.574618 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:31:07.574618 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:31:07.574618 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:31:07.574618 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:31:07.574618 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:31:07.574618 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:31:07.574618 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:31:07.574618 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:31:07.574618 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:31:07.574618 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:31:07.574618 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 21:31:07.574618 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 21:31:07.574618 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 21:31:07.575716 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 21:31:07.575716 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:31:07.575716 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:31:07.575716 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:31:07.575716 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:31:07.575716 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:31:07.575716 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:31:07.575716 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:31:07.575716 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:31:07.575716 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:31:07.575716 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:31:07.575716 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:31:07.575716 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:31:07.575716 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:31:07.575716 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:31:07.575716 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:31:07.575716 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:31:07.576833 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 21:31:07.576833 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 21:31:07.576833 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 21:31:07.576833 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 21:31:07.576833 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 21:31:07.576833 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 21:31:07.576833 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:31:07.576833 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:31:07.576833 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 626/1258] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Aug 2 21:31:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:31:07.581834 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a928a6a-fc3c-46ec-ac89-2893cb316dde None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:31:07.692847 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a928a6a-fc3c-46ec-ac89-2893cb316dde None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:31:07.728848 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed2ec24-487b-440b-803c-c09807220e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:31:07.729569 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed2ec24-487b-440b-803c-c09807220e44 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:31:07.729845 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed2ec24-487b-440b-803c-c09807220e44 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:31:07.730141 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed2ec24-487b-440b-803c-c09807220e44 None admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:31:07.731002 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed2ec24-487b-440b-803c-c09807220e44 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:31:07.731319 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed2ec24-487b-440b-803c-c09807220e44 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:31:07.732838 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed2ec24-487b-440b-803c-c09807220e44 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:31:07.746634 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 633/1259] 10.222.0.70 () {56 vars in 1148 bytes} [Tue Aug 2 21:31:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:31:07.752775 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d743c11-775e-4f34-b8de-b6c8c37e6213 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:31:07.782459 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:31:07.865420 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d743c11-775e-4f34-b8de-b6c8c37e6213 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:31:07.900682 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf10242-b7ec-4d56-8024-6b4e86af64e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:31:07.901309 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf10242-b7ec-4d56-8024-6b4e86af64e0 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:31:07.901606 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf10242-b7ec-4d56-8024-6b4e86af64e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:31:07.901870 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf10242-b7ec-4d56-8024-6b4e86af64e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:31:07.902648 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf10242-b7ec-4d56-8024-6b4e86af64e0 None admin] RBAC: Adding query filter params (role.id=3e32dbf75f9b41f5adb9fe59851267bb, scope.project.id=42672e04d6ce4b0ab5f7eccfb0cc946c, user.id=83fcd951771e42959506b70b0137003f) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:31:07.902969 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf10242-b7ec-4d56-8024-6b4e86af64e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:31:07.904439 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf10242-b7ec-4d56-8024-6b4e86af64e0 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:31:07.910026 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 627/1260] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Aug 2 21:31:07 2022] GET /identity/v3/role_assignments?user.id=83fcd951771e42959506b70b0137003f&scope.project.id=42672e04d6ce4b0ab5f7eccfb0cc946c&role.id=3e32dbf75f9b41f5adb9fe59851267bb => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:31:09.884757 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc052bee-aaa7-4a9b-94b7-13fd33949a45 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:31:09.885290 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc052bee-aaa7-4a9b-94b7-13fd33949a45 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:31:09.885290 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc052bee-aaa7-4a9b-94b7-13fd33949a45 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:31:09.886641 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 634/1261] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:31:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:31:09.891649 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58806ae5-4f75-48f0-a9f7-328a510af752 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:31:09.892089 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58806ae5-4f75-48f0-a9f7-328a510af752 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:31:09.892208 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58806ae5-4f75-48f0-a9f7-328a510af752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:31:09.910484 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-58806ae5-4f75-48f0-a9f7-328a510af752 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:31:09.911753 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-58806ae5-4f75-48f0-a9f7-328a510af752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:31:09.982522 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 628/1262] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:31:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 21:31:10.004395 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc052bee-aaa7-4a9b-94b7-13fd33949a45 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:31:10.015154 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:31:10.105583 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc052bee-aaa7-4a9b-94b7-13fd33949a45 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:31:10.138187 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf36914-35f8-429f-a9a4-3c777d4361db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:31:10.138738 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf36914-35f8-429f-a9a4-3c777d4361db None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:31:10.139024 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf36914-35f8-429f-a9a4-3c777d4361db None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:31:10.139300 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf36914-35f8-429f-a9a4-3c777d4361db None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:31:10.149837 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf36914-35f8-429f-a9a4-3c777d4361db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:31:10.154721 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-7bf36914-35f8-429f-a9a4-3c777d4361db None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 21:31:10.154721 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:31:10.154721 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:31:10.154721 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:31:10.154721 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:31:10.154721 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:31:10.154721 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:31:10.154721 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:31:10.154721 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:31:10.154721 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:31:10.154721 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:31:10.154721 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:31:10.154721 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:31:10.154721 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:31:10.154721 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:31:10.154721 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:31:10.155831 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:31:10.155831 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:31:10.155831 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:31:10.155831 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:31:10.155831 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:31:10.155831 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:31:10.155831 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:31:10.155831 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:31:10.155831 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:31:10.155831 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:31:10.155831 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:31:10.155831 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:31:10.155831 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:31:10.155831 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:31:10.155831 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:31:10.155831 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:31:10.156718 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:31:10.156718 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:31:10.156718 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:31:10.156718 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:31:10.156718 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:31:10.156718 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:31:10.156718 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:31:10.156718 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:31:10.156718 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:31:10.156718 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:31:10.156718 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 21:31:10.156718 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:31:10.156718 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 635/1263] 10.222.0.70 () {56 vars in 1096 bytes} [Tue Aug 2 21:31:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:31:10.161779 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58806ae5-4f75-48f0-a9f7-328a510af752 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:31:10.180326 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:31:10.259680 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58806ae5-4f75-48f0-a9f7-328a510af752 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:31:10.297473 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f77fef-33d7-426c-adf8-7cbb7538eec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:31:10.298098 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f77fef-33d7-426c-adf8-7cbb7538eec9 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:31:10.298382 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f77fef-33d7-426c-adf8-7cbb7538eec9 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:31:10.298655 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f77fef-33d7-426c-adf8-7cbb7538eec9 None admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:31:10.299370 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f77fef-33d7-426c-adf8-7cbb7538eec9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:31:10.299676 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f77fef-33d7-426c-adf8-7cbb7538eec9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:31:10.301067 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f77fef-33d7-426c-adf8-7cbb7538eec9 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:31:10.309156 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 629/1264] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 2 21:31:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:31:10.314943 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf36914-35f8-429f-a9a4-3c777d4361db None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:31:10.380877 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:31:10.414454 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf36914-35f8-429f-a9a4-3c777d4361db None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:31:10.447614 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4d3727-b83c-49c9-81ef-0231a44f7c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:31:10.448261 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4d3727-b83c-49c9-81ef-0231a44f7c2f None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:31:10.448556 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4d3727-b83c-49c9-81ef-0231a44f7c2f None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:31:10.448836 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4d3727-b83c-49c9-81ef-0231a44f7c2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:31:10.458671 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4d3727-b83c-49c9-81ef-0231a44f7c2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:31:10.460150 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4d3727-b83c-49c9-81ef-0231a44f7c2f None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:31:10.475150 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-ea4d3727-b83c-49c9-81ef-0231a44f7c2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:31:10.475150 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:31:10.475150 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:31:10.475150 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:31:10.475150 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:31:10.475150 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:31:10.475150 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:31:10.475150 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:31:10.475150 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:31:10.475150 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:31:10.475150 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:31:10.475150 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:31:10.475150 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:31:10.475150 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:31:10.475150 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:31:10.476176 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:31:10.476176 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:31:10.476176 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:31:10.476176 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:31:10.476176 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:31:10.476176 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:31:10.476176 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:31:10.476176 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:31:10.476176 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:31:10.476176 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:31:10.476176 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:31:10.476176 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:31:10.476176 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:31:10.476176 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:31:10.476176 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:31:10.476176 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:31:10.476176 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:31:10.477317 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:31:10.477317 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:31:10.477317 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:31:10.477317 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:31:10.477317 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 636/1265] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 2 21:31:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:31:10.482083 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f77fef-33d7-426c-adf8-7cbb7538eec9 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:31:10.561750 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:31:10.580899 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f77fef-33d7-426c-adf8-7cbb7538eec9 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:31:10.614689 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19679321-bca7-4ca0-a622-6fdbdbedb9a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:31:10.615567 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19679321-bca7-4ca0-a622-6fdbdbedb9a2 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:31:10.615853 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19679321-bca7-4ca0-a622-6fdbdbedb9a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:31:10.616132 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19679321-bca7-4ca0-a622-6fdbdbedb9a2 None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:31:10.616853 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19679321-bca7-4ca0-a622-6fdbdbedb9a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:31:10.617163 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19679321-bca7-4ca0-a622-6fdbdbedb9a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:31:10.618539 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19679321-bca7-4ca0-a622-6fdbdbedb9a2 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:31:10.630206 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 630/1266] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 2 21:31:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:31:10.635788 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4d3727-b83c-49c9-81ef-0231a44f7c2f None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:31:10.733391 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4d3727-b83c-49c9-81ef-0231a44f7c2f None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:31:10.752996 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:31:10.768056 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97659d1-0351-40ab-8803-322ac8d30ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:31:10.768725 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97659d1-0351-40ab-8803-322ac8d30ea3 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:31:10.769013 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97659d1-0351-40ab-8803-322ac8d30ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:31:10.769293 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97659d1-0351-40ab-8803-322ac8d30ea3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:31:10.776696 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97659d1-0351-40ab-8803-322ac8d30ea3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:31:10.778134 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97659d1-0351-40ab-8803-322ac8d30ea3 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:31:10.789197 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-a97659d1-0351-40ab-8803-322ac8d30ea3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 02 21:31:10.789197 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:31:10.789197 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:31:10.789197 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:31:10.789197 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:31:10.789197 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:31:10.789197 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:31:10.789197 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:31:10.789197 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:31:10.789197 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:31:10.789197 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:31:10.789197 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:31:10.789197 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 21:31:10.789197 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 21:31:10.789197 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 21:31:10.789197 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 21:31:10.790391 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:31:10.790391 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:31:10.790391 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 21:31:10.790391 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:31:10.790391 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 21:31:10.790391 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:31:10.790391 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:31:10.790391 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:31:10.790391 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:31:10.790391 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:31:10.790391 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:31:10.790391 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:31:10.790391 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:31:10.790391 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:31:10.790391 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:31:10.790391 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:31:10.790391 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:31:10.790391 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:31:10.791569 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:31:10.791569 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:31:10.791569 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 21:31:10.791569 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 21:31:10.791569 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 21:31:10.791569 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 21:31:10.791569 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 21:31:10.791569 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 21:31:10.791569 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 02 21:31:10.791569 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:31:10.791569 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 637/1267] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 2 21:31:10 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:31:10.796009 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19679321-bca7-4ca0-a622-6fdbdbedb9a2 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:31:10.893701 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19679321-bca7-4ca0-a622-6fdbdbedb9a2 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:31:10.930590 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893a9719-79dc-4259-8422-292329ec9a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:31:10.931209 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a9719-79dc-4259-8422-292329ec9a90 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:31:10.931501 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a9719-79dc-4259-8422-292329ec9a90 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:31:10.931776 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893a9719-79dc-4259-8422-292329ec9a90 None admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:31:10.932606 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893a9719-79dc-4259-8422-292329ec9a90 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:31:10.932918 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893a9719-79dc-4259-8422-292329ec9a90 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:31:10.934356 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893a9719-79dc-4259-8422-292329ec9a90 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:31:10.943526 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:31:10.954805 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 631/1268] 10.222.0.70 () {56 vars in 1143 bytes} [Tue Aug 2 21:31:10 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:31:10.960662 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97659d1-0351-40ab-8803-322ac8d30ea3 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:31:11.058369 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97659d1-0351-40ab-8803-322ac8d30ea3 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:31:11.090991 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d1a896-473b-440c-8c42-719e8fe71f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:31:11.091608 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d1a896-473b-440c-8c42-719e8fe71f4e None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:31:11.091890 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d1a896-473b-440c-8c42-719e8fe71f4e None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:31:11.092167 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d1a896-473b-440c-8c42-719e8fe71f4e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:31:11.102326 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d1a896-473b-440c-8c42-719e8fe71f4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:31:11.103754 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d1a896-473b-440c-8c42-719e8fe71f4e None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:31:11.119027 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-28d1a896-473b-440c-8c42-719e8fe71f4e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:31:11.119027 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:31:11.119027 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:31:11.119027 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:31:11.119027 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:31:11.119027 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:31:11.119027 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:31:11.119027 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:31:11.119027 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:31:11.119027 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:31:11.119027 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:31:11.119027 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:31:11.119027 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:31:11.119027 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:31:11.119027 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:31:11.120144 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:31:11.120144 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:31:11.120144 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:31:11.120144 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:31:11.120144 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:31:11.120144 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:31:11.120144 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:31:11.120144 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:31:11.120144 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:31:11.120144 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:31:11.120144 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:31:11.120144 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:31:11.120144 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:31:11.120144 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:31:11.120144 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:31:11.120144 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:31:11.120144 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:31:11.121251 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:31:11.121251 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:31:11.121251 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:31:11.121251 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:31:11.121251 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 638/1269] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 2 21:31:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:31:11.125885 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893a9719-79dc-4259-8422-292329ec9a90 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:31:11.223315 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893a9719-79dc-4259-8422-292329ec9a90 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:31:11.256253 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7182c2e2-8744-4b6f-a7cc-a8254aaaf67d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:31:11.256873 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7182c2e2-8744-4b6f-a7cc-a8254aaaf67d None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:31:11.257160 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7182c2e2-8744-4b6f-a7cc-a8254aaaf67d None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:31:11.257438 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7182c2e2-8744-4b6f-a7cc-a8254aaaf67d None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:31:11.258650 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7182c2e2-8744-4b6f-a7cc-a8254aaaf67d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:31:11.258956 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7182c2e2-8744-4b6f-a7cc-a8254aaaf67d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:31:11.260335 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7182c2e2-8744-4b6f-a7cc-a8254aaaf67d None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:31:11.271216 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 632/1270] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 2 21:31:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:31:11.277388 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d1a896-473b-440c-8c42-719e8fe71f4e None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:31:11.308533 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:31:11.374965 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d1a896-473b-440c-8c42-719e8fe71f4e None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:31:11.407289 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c4b26a-0296-481e-adf9-512688d108fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:31:11.407917 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c4b26a-0296-481e-adf9-512688d108fc None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:31:11.408199 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c4b26a-0296-481e-adf9-512688d108fc None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:31:11.408507 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c4b26a-0296-481e-adf9-512688d108fc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:31:11.414940 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c4b26a-0296-481e-adf9-512688d108fc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:31:11.416411 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c4b26a-0296-481e-adf9-512688d108fc None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:31:11.427375 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-55c4b26a-0296-481e-adf9-512688d108fc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:31:11.427375 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:31:11.427375 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:31:11.427375 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:31:11.427375 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:31:11.427375 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:31:11.427375 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:31:11.427375 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:31:11.427375 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:31:11.427375 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:31:11.427375 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:31:11.427375 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:31:11.427375 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 21:31:11.427375 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 21:31:11.427375 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 21:31:11.428441 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 21:31:11.428441 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:31:11.428441 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:31:11.428441 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:31:11.428441 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:31:11.428441 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:31:11.428441 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:31:11.428441 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:31:11.428441 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:31:11.428441 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:31:11.428441 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:31:11.428441 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:31:11.428441 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:31:11.428441 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:31:11.428441 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:31:11.428441 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:31:11.428441 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:31:11.430120 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 21:31:11.430120 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 21:31:11.430120 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 21:31:11.430120 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 21:31:11.430120 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 21:31:11.430120 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 21:31:11.430120 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:31:11.430120 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:31:11.430120 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 639/1271] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Aug 2 21:31:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:31:11.434863 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7182c2e2-8744-4b6f-a7cc-a8254aaaf67d None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:31:11.492834 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:31:11.533931 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7182c2e2-8744-4b6f-a7cc-a8254aaaf67d None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:31:11.566470 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dea40ba-0c8b-4ebf-a413-56ca023fdf13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:31:11.567010 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dea40ba-0c8b-4ebf-a413-56ca023fdf13 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:31:11.567301 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dea40ba-0c8b-4ebf-a413-56ca023fdf13 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:31:11.567577 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dea40ba-0c8b-4ebf-a413-56ca023fdf13 None admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:31:11.568344 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dea40ba-0c8b-4ebf-a413-56ca023fdf13 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:31:11.568657 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dea40ba-0c8b-4ebf-a413-56ca023fdf13 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:31:11.570112 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dea40ba-0c8b-4ebf-a413-56ca023fdf13 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:31:11.582235 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 633/1272] 10.222.0.70 () {56 vars in 1148 bytes} [Tue Aug 2 21:31:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:31:11.588106 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c4b26a-0296-481e-adf9-512688d108fc None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:31:11.675847 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:31:11.685227 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c4b26a-0296-481e-adf9-512688d108fc None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:31:11.716851 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24dbbff-de64-4101-ad82-3a0efd27760f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:31:11.717495 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24dbbff-de64-4101-ad82-3a0efd27760f None admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:31:11.717773 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24dbbff-de64-4101-ad82-3a0efd27760f None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:31:11.718048 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24dbbff-de64-4101-ad82-3a0efd27760f None admin] PATH_INFO: `/v3/projects/42672e04d6ce4b0ab5f7eccfb0cc946c/users/83fcd951771e42959506b70b0137003f/roles/3e32dbf75f9b41f5adb9fe59851267bb` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:31:11.719918 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24dbbff-de64-4101-ad82-3a0efd27760f None admin] RBAC: Authorizing `identity:create_grant(project_id=42672e04d6ce4b0ab5f7eccfb0cc946c, user_id=83fcd951771e42959506b70b0137003f, role_id=3e32dbf75f9b41f5adb9fe59851267bb)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:31:11.721370 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24dbbff-de64-4101-ad82-3a0efd27760f None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:31:11.733749 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 640/1273] 10.222.0.70 () {58 vars in 1439 bytes} [Tue Aug 2 21:31:11 2022] PUT /identity/v3/projects/42672e04d6ce4b0ab5f7eccfb0cc946c/users/83fcd951771e42959506b70b0137003f/roles/3e32dbf75f9b41f5adb9fe59851267bb => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:31:13.695172 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8e5140-3fdd-4f47-81e8-e8a71299ae26 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:31:13.695669 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8e5140-3fdd-4f47-81e8-e8a71299ae26 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:31:13.695669 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8e5140-3fdd-4f47-81e8-e8a71299ae26 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:31:13.697031 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 634/1274] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:31:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:31:13.702655 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa2cd7c-922c-423c-bf23-091a9ce6f30b None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:31:13.703045 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa2cd7c-922c-423c-bf23-091a9ce6f30b None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:31:13.703217 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa2cd7c-922c-423c-bf23-091a9ce6f30b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:31:13.720977 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-0fa2cd7c-922c-423c-bf23-091a9ce6f30b None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:31:13.722169 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-0fa2cd7c-922c-423c-bf23-091a9ce6f30b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:31:13.791877 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 641/1275] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:31:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 21:31:13.815238 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8e5140-3fdd-4f47-81e8-e8a71299ae26 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:31:13.920931 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8e5140-3fdd-4f47-81e8-e8a71299ae26 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:31:13.945918 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:31:13.964567 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5ef680-ed76-4356-9aba-01d84e35c524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:31:13.965241 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5ef680-ed76-4356-9aba-01d84e35c524 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:31:13.965583 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5ef680-ed76-4356-9aba-01d84e35c524 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:31:13.965804 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5ef680-ed76-4356-9aba-01d84e35c524 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:31:13.975883 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5ef680-ed76-4356-9aba-01d84e35c524 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 02 21:31:13.980843 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-fb5ef680-ed76-4356-9aba-01d84e35c524 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 21:31:13.980843 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:31:13.980843 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:31:13.980843 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:31:13.980843 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:31:13.980843 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:31:13.980843 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:31:13.980843 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:31:13.980843 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:31:13.980843 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:31:13.980843 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:31:13.980843 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:31:13.980843 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 02 21:31:13.980843 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 02 21:31:13.980843 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 02 21:31:13.980843 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 02 21:31:13.981985 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 02 21:31:13.981985 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 02 21:31:13.981985 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 02 21:31:13.981985 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 02 21:31:13.981985 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:31:13.981985 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:31:13.981985 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:31:13.981985 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:31:13.981985 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:31:13.981985 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:31:13.981985 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:31:13.981985 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:31:13.981985 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:31:13.981985 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:31:13.981985 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:31:13.981985 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:31:13.982943 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:31:13.982943 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:31:13.982943 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:31:13.982943 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:31:13.982943 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 02 21:31:13.982943 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 02 21:31:13.982943 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 02 21:31:13.982943 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 02 21:31:13.982943 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 02 21:31:13.982943 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 02 21:31:13.982943 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 02 21:31:13.982943 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:31:13.982943 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 635/1276] 10.222.0.70 () {56 vars in 1096 bytes} [Tue Aug 2 21:31:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:31:13.988052 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa2cd7c-922c-423c-bf23-091a9ce6f30b None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:31:14.071204 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:31:14.091024 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa2cd7c-922c-423c-bf23-091a9ce6f30b None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:31:14.125159 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69b3eac-4043-496c-954a-025dd4b2b9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:31:14.125780 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b3eac-4043-496c-954a-025dd4b2b9b7 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:31:14.126068 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b3eac-4043-496c-954a-025dd4b2b9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:31:14.126341 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69b3eac-4043-496c-954a-025dd4b2b9b7 None admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:31:14.127058 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69b3eac-4043-496c-954a-025dd4b2b9b7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:31:14.127366 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69b3eac-4043-496c-954a-025dd4b2b9b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:31:14.129300 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69b3eac-4043-496c-954a-025dd4b2b9b7 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:31:14.139762 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 642/1277] 10.222.0.70 () {56 vars in 1099 bytes} [Tue Aug 2 21:31:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:31:14.145631 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5ef680-ed76-4356-9aba-01d84e35c524 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:31:14.259541 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5ef680-ed76-4356-9aba-01d84e35c524 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:31:14.300462 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba77363-e394-45c5-893c-12e3cc2f16c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:31:14.301133 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba77363-e394-45c5-893c-12e3cc2f16c2 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:31:14.301396 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba77363-e394-45c5-893c-12e3cc2f16c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:31:14.301671 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba77363-e394-45c5-893c-12e3cc2f16c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:31:14.317698 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba77363-e394-45c5-893c-12e3cc2f16c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:31:14.319151 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba77363-e394-45c5-893c-12e3cc2f16c2 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:31:14.336497 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-dba77363-e394-45c5-893c-12e3cc2f16c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:31:14.336497 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:31:14.336497 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:31:14.336497 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:31:14.336497 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:31:14.336497 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:31:14.336497 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:31:14.336497 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:31:14.336497 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:31:14.336497 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:31:14.336497 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:31:14.336497 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:31:14.336497 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:31:14.336497 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:31:14.336497 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:31:14.337543 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:31:14.337543 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:31:14.337543 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:31:14.337543 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:31:14.337543 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:31:14.337543 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:31:14.337543 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:31:14.337543 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:31:14.337543 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:31:14.337543 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:31:14.337543 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:31:14.337543 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:31:14.337543 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:31:14.337543 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:31:14.337543 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:31:14.337543 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:31:14.337543 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:31:14.343537 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:31:14.343537 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:31:14.343537 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:31:14.343537 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:31:14.343537 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 636/1278] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 2 21:31:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:31:14.344572 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69b3eac-4043-496c-954a-025dd4b2b9b7 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:31:14.444037 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69b3eac-4043-496c-954a-025dd4b2b9b7 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:31:14.477604 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaecb1a-81f5-42ae-a5a0-53679e5dfe16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:31:14.478217 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaecb1a-81f5-42ae-a5a0-53679e5dfe16 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:31:14.478499 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaecb1a-81f5-42ae-a5a0-53679e5dfe16 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:31:14.478773 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaecb1a-81f5-42ae-a5a0-53679e5dfe16 None admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:31:14.479459 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaecb1a-81f5-42ae-a5a0-53679e5dfe16 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:31:14.479763 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaecb1a-81f5-42ae-a5a0-53679e5dfe16 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:31:14.481160 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaecb1a-81f5-42ae-a5a0-53679e5dfe16 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:31:14.493036 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 643/1279] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 2 21:31:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:31:14.498837 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba77363-e394-45c5-893c-12e3cc2f16c2 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:31:14.529437 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:31:14.596942 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba77363-e394-45c5-893c-12e3cc2f16c2 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:31:14.629686 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4149cda7-f352-4071-b48a-387dd41a41d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:31:14.630418 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149cda7-f352-4071-b48a-387dd41a41d0 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:31:14.630704 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149cda7-f352-4071-b48a-387dd41a41d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:31:14.630975 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4149cda7-f352-4071-b48a-387dd41a41d0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:31:14.638210 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4149cda7-f352-4071-b48a-387dd41a41d0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:31:14.639635 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4149cda7-f352-4071-b48a-387dd41a41d0 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:31:14.650924 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-4149cda7-f352-4071-b48a-387dd41a41d0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 02 21:31:14.650924 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:31:14.650924 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:31:14.650924 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:31:14.650924 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:31:14.650924 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:31:14.650924 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:31:14.650924 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:31:14.650924 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:31:14.650924 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:31:14.650924 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:31:14.650924 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:31:14.650924 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 02 21:31:14.650924 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 02 21:31:14.650924 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 02 21:31:14.650924 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 02 21:31:14.652023 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:31:14.652023 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:31:14.652023 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 02 21:31:14.652023 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:31:14.652023 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 02 21:31:14.652023 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 02 21:31:14.652023 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:31:14.652023 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:31:14.652023 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:31:14.652023 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:31:14.652023 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:31:14.652023 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:31:14.652023 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:31:14.652023 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:31:14.652023 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:31:14.652023 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:31:14.652023 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:31:14.652023 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:31:14.653241 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:31:14.653241 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:31:14.653241 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 02 21:31:14.653241 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 02 21:31:14.653241 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 02 21:31:14.653241 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 02 21:31:14.653241 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 02 21:31:14.653241 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 02 21:31:14.653241 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 02 21:31:14.653241 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:31:14.653241 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 637/1280] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 2 21:31:14 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:31:14.657959 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaecb1a-81f5-42ae-a5a0-53679e5dfe16 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:31:14.661705 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:31:14.755278 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaecb1a-81f5-42ae-a5a0-53679e5dfe16 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:31:14.788602 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d378bb-29e3-416e-b260-ba081c9b3023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:31:14.789212 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d378bb-29e3-416e-b260-ba081c9b3023 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:31:14.789494 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d378bb-29e3-416e-b260-ba081c9b3023 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:31:14.789768 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d378bb-29e3-416e-b260-ba081c9b3023 None admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:31:14.790555 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d378bb-29e3-416e-b260-ba081c9b3023 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:31:14.790860 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d378bb-29e3-416e-b260-ba081c9b3023 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:31:14.792297 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d378bb-29e3-416e-b260-ba081c9b3023 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:31:14.808740 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 644/1281] 10.222.0.70 () {56 vars in 1143 bytes} [Tue Aug 2 21:31:14 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:31:14.814441 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4149cda7-f352-4071-b48a-387dd41a41d0 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:31:14.903875 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:31:14.914132 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4149cda7-f352-4071-b48a-387dd41a41d0 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:31:14.949576 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de7f636-2ed1-472b-b158-89241fd99502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:31:14.950198 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de7f636-2ed1-472b-b158-89241fd99502 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:31:14.950485 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de7f636-2ed1-472b-b158-89241fd99502 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:31:14.950761 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de7f636-2ed1-472b-b158-89241fd99502 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:31:15.018498 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de7f636-2ed1-472b-b158-89241fd99502 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:31:15.019943 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de7f636-2ed1-472b-b158-89241fd99502 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:31:15.112976 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:31:15.123543 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 638/1282] 10.222.0.70 () {58 vars in 1282 bytes} [Tue Aug 2 21:31:14 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 02 21:31:15.129312 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d378bb-29e3-416e-b260-ba081c9b3023 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:31:15.190922 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:31:15.229097 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d378bb-29e3-416e-b260-ba081c9b3023 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:31:15.261655 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b776f9-392b-4ed6-bed9-d5b09bd56b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:31:15.262289 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b776f9-392b-4ed6-bed9-d5b09bd56b9a None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:31:15.262570 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b776f9-392b-4ed6-bed9-d5b09bd56b9a None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:31:15.262856 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b776f9-392b-4ed6-bed9-d5b09bd56b9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:31:15.272737 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b776f9-392b-4ed6-bed9-d5b09bd56b9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:31:15.274660 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b776f9-392b-4ed6-bed9-d5b09bd56b9a None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:31:15.289502 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-90b776f9-392b-4ed6-bed9-d5b09bd56b9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:31:15.289502 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:31:15.289502 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:31:15.289502 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:31:15.289502 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:31:15.289502 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:31:15.289502 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:31:15.289502 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:31:15.289502 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:31:15.289502 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:31:15.289502 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:31:15.289502 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:31:15.289502 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 02 21:31:15.289502 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 02 21:31:15.289502 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 02 21:31:15.290588 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 02 21:31:15.290588 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:31:15.290588 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:31:15.290588 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:31:15.290588 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:31:15.290588 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:31:15.290588 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:31:15.290588 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:31:15.290588 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:31:15.290588 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:31:15.290588 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:31:15.290588 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:31:15.290588 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:31:15.290588 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:31:15.290588 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:31:15.290588 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:31:15.290588 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:31:15.291513 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 02 21:31:15.291513 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 02 21:31:15.291513 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 02 21:31:15.291513 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:31:15.291513 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 645/1283] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 2 21:31:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:31:15.296447 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de7f636-2ed1-472b-b158-89241fd99502 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:31:15.397056 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de7f636-2ed1-472b-b158-89241fd99502 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:31:15.431039 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fbaaec-f8c3-411a-8ffd-3af70d0e7b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:31:15.431639 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fbaaec-f8c3-411a-8ffd-3af70d0e7b61 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:31:15.431919 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fbaaec-f8c3-411a-8ffd-3af70d0e7b61 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:31:15.432193 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fbaaec-f8c3-411a-8ffd-3af70d0e7b61 None admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:31:15.432893 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fbaaec-f8c3-411a-8ffd-3af70d0e7b61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:31:15.433195 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fbaaec-f8c3-411a-8ffd-3af70d0e7b61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:31:15.434560 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fbaaec-f8c3-411a-8ffd-3af70d0e7b61 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:31:15.445948 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 639/1284] 10.222.0.70 () {56 vars in 1109 bytes} [Tue Aug 2 21:31:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:31:15.451557 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b776f9-392b-4ed6-bed9-d5b09bd56b9a None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:31:15.549310 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b776f9-392b-4ed6-bed9-d5b09bd56b9a None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:31:15.562442 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:31:15.583042 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d06db4d-2f3f-499f-9884-8ba1b8985666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:31:15.583675 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d06db4d-2f3f-499f-9884-8ba1b8985666 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:31:15.583957 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d06db4d-2f3f-499f-9884-8ba1b8985666 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:31:15.584264 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d06db4d-2f3f-499f-9884-8ba1b8985666 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:31:15.591392 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d06db4d-2f3f-499f-9884-8ba1b8985666 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:31:15.592867 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d06db4d-2f3f-499f-9884-8ba1b8985666 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:31:15.604558 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application [None req-6d06db4d-2f3f-499f-9884-8ba1b8985666 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:31:15.604558 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:31:15.604558 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:31:15.604558 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:31:15.604558 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:31:15.604558 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:31:15.604558 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:31:15.604558 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:31:15.604558 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:31:15.604558 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:31:15.604558 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:31:15.604558 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:31:15.604558 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 02 21:31:15.604558 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 02 21:31:15.604558 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 02 21:31:15.605579 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 02 21:31:15.605579 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:31:15.605579 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:31:15.605579 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:31:15.605579 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:31:15.605579 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:31:15.605579 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:31:15.605579 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:31:15.605579 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application with Lock( Aug 02 21:31:15.605579 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:31:15.605579 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:31:15.605579 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:31:15.605579 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:31:15.605579 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:31:15.605579 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:31:15.605579 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:31:15.605579 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:31:15.606755 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 02 21:31:15.606755 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 02 21:31:15.606755 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 02 21:31:15.606755 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 02 21:31:15.606755 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 02 21:31:15.606755 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 02 21:31:15.606755 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 02 21:31:15.606755 dv-cinder-851449-4-smb devstack@keystone.service[80419]: ERROR keystone.server.flask.application Aug 02 21:31:15.606755 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 646/1285] 10.222.0.70 () {56 vars in 1111 bytes} [Tue Aug 2 21:31:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:31:15.611574 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fbaaec-f8c3-411a-8ffd-3af70d0e7b61 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:31:15.660271 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:31:15.709665 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fbaaec-f8c3-411a-8ffd-3af70d0e7b61 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:31:15.742978 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a21c934-750c-4f07-9f28-13731f2598b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:31:15.743579 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a21c934-750c-4f07-9f28-13731f2598b9 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:31:15.743859 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a21c934-750c-4f07-9f28-13731f2598b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:31:15.744129 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a21c934-750c-4f07-9f28-13731f2598b9 None admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:31:15.744890 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a21c934-750c-4f07-9f28-13731f2598b9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:31:15.745193 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a21c934-750c-4f07-9f28-13731f2598b9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:31:15.746614 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a21c934-750c-4f07-9f28-13731f2598b9 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:31:15.758131 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 640/1286] 10.222.0.70 () {56 vars in 1148 bytes} [Tue Aug 2 21:31:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:31:15.764158 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d06db4d-2f3f-499f-9884-8ba1b8985666 None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:31:15.862907 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d06db4d-2f3f-499f-9884-8ba1b8985666 None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:31:15.895040 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa5d042-aa38-41c9-b0b2-831b204be38c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:31:15.895639 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa5d042-aa38-41c9-b0b2-831b204be38c None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:31:15.895923 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa5d042-aa38-41c9-b0b2-831b204be38c None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:31:15.896199 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa5d042-aa38-41c9-b0b2-831b204be38c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:31:15.897010 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa5d042-aa38-41c9-b0b2-831b204be38c None admin] RBAC: Adding query filter params (role.id=3e32dbf75f9b41f5adb9fe59851267bb, scope.project.id=42672e04d6ce4b0ab5f7eccfb0cc946c, user.id=83fcd951771e42959506b70b0137003f) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:31:15.897322 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa5d042-aa38-41c9-b0b2-831b204be38c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:31:15.899257 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa5d042-aa38-41c9-b0b2-831b204be38c None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:31:15.904920 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 647/1287] 10.222.0.70 () {56 vars in 1374 bytes} [Tue Aug 2 21:31:15 2022] GET /identity/v3/role_assignments?user.id=83fcd951771e42959506b70b0137003f&scope.project.id=42672e04d6ce4b0ab5f7eccfb0cc946c&role.id=3e32dbf75f9b41f5adb9fe59851267bb => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:31:17.899253 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35eb3b2-64af-4129-a8d5-f84aa3646866 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:31:17.899811 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35eb3b2-64af-4129-a8d5-f84aa3646866 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:31:17.899811 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35eb3b2-64af-4129-a8d5-f84aa3646866 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:31:17.901195 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 641/1288] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:31:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:31:17.906200 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bf8dee-4c13-4914-933f-1fbca3dd3e8c None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:31:17.906562 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bf8dee-4c13-4914-933f-1fbca3dd3e8c None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:31:17.906761 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bf8dee-4c13-4914-933f-1fbca3dd3e8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:31:17.925812 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-87bf8dee-4c13-4914-933f-1fbca3dd3e8c None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:31:17.926996 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-87bf8dee-4c13-4914-933f-1fbca3dd3e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:31:17.958483 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:31:17.996974 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 648/1289] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:31:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 21:31:18.018270 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35eb3b2-64af-4129-a8d5-f84aa3646866 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:31:18.116219 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35eb3b2-64af-4129-a8d5-f84aa3646866 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:31:18.126500 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:31:18.149948 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e12646-345b-46e1-9082-febe88744f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:31:18.150503 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e12646-345b-46e1-9082-febe88744f6d None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:31:18.150783 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e12646-345b-46e1-9082-febe88744f6d None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:31:18.151055 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e12646-345b-46e1-9082-febe88744f6d None admin] PATH_INFO: `/v3/services/placement` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:31:18.151666 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e12646-345b-46e1-9082-febe88744f6d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:31:18.153040 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e12646-345b-46e1-9082-febe88744f6d None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:31:18.161593 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-c1e12646-345b-46e1-9082-febe88744f6d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 02 21:31:18.161593 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:31:18.161593 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 21:31:18.161593 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 21:31:18.161593 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 21:31:18.161593 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 21:31:18.161593 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 21:31:18.161593 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 21:31:18.161593 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 02 21:31:18.161593 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:31:18.161593 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 21:31:18.161593 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:31:18.161593 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:31:18.161593 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:31:18.161593 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:31:18.161593 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:31:18.161593 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:31:18.163270 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:31:18.163270 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:31:18.163270 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:31:18.163270 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:31:18.163270 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:31:18.163270 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:31:18.163270 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 21:31:18.163270 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 21:31:18.163270 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 21:31:18.163270 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 21:31:18.163270 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:31:18.163270 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:31:18.163270 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:31:18.163270 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:31:18.163270 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:31:18.163270 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:31:18.165781 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:31:18.165781 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:31:18.165781 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:31:18.165781 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:31:18.165781 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:31:18.165781 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:31:18.165781 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:31:18.165781 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:31:18.165781 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:31:18.165781 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:31:18.165781 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 21:31:18.165781 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 21:31:18.165781 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 02 21:31:18.165781 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:31:18.165781 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 642/1290] 10.222.0.70 () {56 vars in 1117 bytes} [Tue Aug 2 21:31:18 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:31:18.169366 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bf8dee-4c13-4914-933f-1fbca3dd3e8c None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:31:18.268664 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bf8dee-4c13-4914-933f-1fbca3dd3e8c None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:31:18.302092 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88dc2c3-3e92-4ea1-89da-fb0827d7280d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:31:18.302715 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88dc2c3-3e92-4ea1-89da-fb0827d7280d None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:31:18.303005 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88dc2c3-3e92-4ea1-89da-fb0827d7280d None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:31:18.303281 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88dc2c3-3e92-4ea1-89da-fb0827d7280d None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:31:18.303957 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88dc2c3-3e92-4ea1-89da-fb0827d7280d None admin] RBAC: Adding query filter params (name=placement) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:31:18.304296 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88dc2c3-3e92-4ea1-89da-fb0827d7280d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:31:18.307011 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88dc2c3-3e92-4ea1-89da-fb0827d7280d None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:31:18.313379 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 649/1291] 10.222.0.70 () {56 vars in 1116 bytes} [Tue Aug 2 21:31:18 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:31:18.319310 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e12646-345b-46e1-9082-febe88744f6d None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:31:18.415914 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e12646-345b-46e1-9082-febe88744f6d None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:31:18.449352 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab980c5-4ead-4915-91dc-4e91e527c481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:31:18.449959 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab980c5-4ead-4915-91dc-4e91e527c481 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:31:18.450243 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab980c5-4ead-4915-91dc-4e91e527c481 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:31:18.450519 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab980c5-4ead-4915-91dc-4e91e527c481 None admin] PATH_INFO: `/v3/services` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:31:18.451192 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab980c5-4ead-4915-91dc-4e91e527c481 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:31:18.451500 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab980c5-4ead-4915-91dc-4e91e527c481 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:31:18.452894 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab980c5-4ead-4915-91dc-4e91e527c481 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:31:18.457270 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 643/1292] 10.222.0.70 () {56 vars in 1116 bytes} [Tue Aug 2 21:31:18 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:31:20.413589 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe202f9-0c1d-4612-835d-876f4097867d None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:31:20.414411 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe202f9-0c1d-4612-835d-876f4097867d None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:31:20.414411 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe202f9-0c1d-4612-835d-876f4097867d None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:31:20.415488 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 650/1293] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:31:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:31:20.420921 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85025fa5-4232-415f-92e7-3f6151cb11d9 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:31:20.421353 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85025fa5-4232-415f-92e7-3f6151cb11d9 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:31:20.421466 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85025fa5-4232-415f-92e7-3f6151cb11d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:31:20.439586 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-85025fa5-4232-415f-92e7-3f6151cb11d9 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:31:20.440787 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-85025fa5-4232-415f-92e7-3f6151cb11d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:31:20.470190 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:31:20.506800 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 644/1294] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:31:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 21:31:20.529195 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe202f9-0c1d-4612-835d-876f4097867d None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:31:20.560109 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:31:20.629941 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe202f9-0c1d-4612-835d-876f4097867d None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:31:20.663350 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739f89c0-c54a-44ef-a428-07e22a617f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:31:20.664648 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f89c0-c54a-44ef-a428-07e22a617f10 None admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:31:20.664924 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f89c0-c54a-44ef-a428-07e22a617f10 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:31:20.665194 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739f89c0-c54a-44ef-a428-07e22a617f10 None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:31:20.665878 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739f89c0-c54a-44ef-a428-07e22a617f10 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:31:20.667231 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739f89c0-c54a-44ef-a428-07e22a617f10 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:31:20.680789 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 651/1295] 10.222.0.70 () {60 vars in 1141 bytes} [Tue Aug 2 21:31:20 2022] POST /identity/v3/services => generated 246 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 21:31:22.684500 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b21115d-399c-4efd-836c-6fbdcaa935a1 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:31:22.685011 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b21115d-399c-4efd-836c-6fbdcaa935a1 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:31:22.685011 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b21115d-399c-4efd-836c-6fbdcaa935a1 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:31:22.686329 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 645/1296] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:31:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:31:22.691589 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88640160-2ad2-47cf-8806-4d01c9fa4058 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:31:22.691964 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88640160-2ad2-47cf-8806-4d01c9fa4058 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:31:22.692146 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88640160-2ad2-47cf-8806-4d01c9fa4058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:31:22.709854 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-88640160-2ad2-47cf-8806-4d01c9fa4058 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:31:22.711654 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-88640160-2ad2-47cf-8806-4d01c9fa4058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:31:22.787877 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 652/1297] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:31:22 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 02 21:31:22.810620 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b21115d-399c-4efd-836c-6fbdcaa935a1 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:31:22.909099 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b21115d-399c-4efd-836c-6fbdcaa935a1 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:31:22.947656 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d069bb-f2b6-4743-813c-a92082dd5042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:31:22.948177 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d069bb-f2b6-4743-813c-a92082dd5042 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:31:22.948478 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d069bb-f2b6-4743-813c-a92082dd5042 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:31:22.948753 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d069bb-f2b6-4743-813c-a92082dd5042 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:31:22.949411 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d069bb-f2b6-4743-813c-a92082dd5042 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:31:22.950759 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d069bb-f2b6-4743-813c-a92082dd5042 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:31:22.960088 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-b2d069bb-f2b6-4743-813c-a92082dd5042 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 02 21:31:22.960088 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:31:22.960088 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 21:31:22.960088 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 21:31:22.960088 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 21:31:22.960088 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 21:31:22.960088 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 21:31:22.960088 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 21:31:22.960088 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 02 21:31:22.960088 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:31:22.960088 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 21:31:22.960088 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:31:22.960088 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:31:22.960088 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:31:22.960088 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:31:22.960088 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:31:22.960088 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:31:22.961251 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:31:22.961251 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:31:22.961251 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:31:22.961251 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:31:22.961251 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:31:22.961251 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:31:22.961251 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 21:31:22.961251 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 21:31:22.961251 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 21:31:22.961251 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 21:31:22.961251 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:31:22.961251 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:31:22.961251 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:31:22.961251 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:31:22.961251 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:31:22.961251 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:31:22.962881 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:31:22.962881 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:31:22.962881 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:31:22.962881 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:31:22.962881 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:31:22.962881 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:31:22.962881 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:31:22.962881 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:31:22.962881 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:31:22.962881 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:31:22.962881 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 21:31:22.962881 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 21:31:22.962881 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 02 21:31:22.962881 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:31:22.962881 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 646/1298] 10.222.0.70 () {56 vars in 1117 bytes} [Tue Aug 2 21:31:22 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:31:22.968931 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88640160-2ad2-47cf-8806-4d01c9fa4058 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:31:22.992501 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:31:23.073368 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88640160-2ad2-47cf-8806-4d01c9fa4058 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:31:23.106577 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d51877-5f22-4561-8884-c3670cada0ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:31:23.107195 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d51877-5f22-4561-8884-c3670cada0ad None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:31:23.107481 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d51877-5f22-4561-8884-c3670cada0ad None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:31:23.107762 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d51877-5f22-4561-8884-c3670cada0ad None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:31:23.108470 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d51877-5f22-4561-8884-c3670cada0ad None admin] RBAC: Adding query filter params (name=placement) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:31:23.108782 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d51877-5f22-4561-8884-c3670cada0ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:31:23.110155 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d51877-5f22-4561-8884-c3670cada0ad None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:31:23.115192 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 653/1299] 10.222.0.70 () {56 vars in 1116 bytes} [Tue Aug 2 21:31:22 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:31:23.122046 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d069bb-f2b6-4743-813c-a92082dd5042 None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:31:23.153373 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:31:23.220645 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d069bb-f2b6-4743-813c-a92082dd5042 None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:31:23.254211 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b423c8eb-4fef-4cc0-8274-cc1ef527e9d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:31:23.254818 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b423c8eb-4fef-4cc0-8274-cc1ef527e9d9 None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:31:23.255105 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b423c8eb-4fef-4cc0-8274-cc1ef527e9d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:31:23.255383 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b423c8eb-4fef-4cc0-8274-cc1ef527e9d9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:31:23.256131 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b423c8eb-4fef-4cc0-8274-cc1ef527e9d9 None admin] RBAC: Adding query filter params (interface=public, service_id=45e6c07aa26648b19b19d3be6b10d71d, region_id=RegionOne) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:31:23.256472 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b423c8eb-4fef-4cc0-8274-cc1ef527e9d9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:31:23.257846 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b423c8eb-4fef-4cc0-8274-cc1ef527e9d9 None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:31:23.262833 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 647/1300] 10.222.0.70 () {56 vars in 1251 bytes} [Tue Aug 2 21:31:23 2022] GET /identity/v3/endpoints?service_id=45e6c07aa26648b19b19d3be6b10d71d&interface=public®ion_id=RegionOne => generated 194 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:31:23.268528 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d51877-5f22-4561-8884-c3670cada0ad None admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:31:23.349054 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:31:23.367740 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d51877-5f22-4561-8884-c3670cada0ad None admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:31:23.400538 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d336659-12a9-4b52-9e21-716fd54f52b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:31:23.401151 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d336659-12a9-4b52-9e21-716fd54f52b8 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:31:23.401436 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d336659-12a9-4b52-9e21-716fd54f52b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:31:23.401712 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d336659-12a9-4b52-9e21-716fd54f52b8 None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:31:23.402360 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d336659-12a9-4b52-9e21-716fd54f52b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:31:23.403722 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d336659-12a9-4b52-9e21-716fd54f52b8 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:31:23.410378 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 654/1301] 10.222.0.70 () {56 vars in 1087 bytes} [Tue Aug 2 21:31:23 2022] GET /identity/v3/services => generated 2191 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:31:25.417478 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c6b46-e964-445d-8091-f319a7856afb None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:31:25.417972 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c6b46-e964-445d-8091-f319a7856afb None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:31:25.418082 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c6b46-e964-445d-8091-f319a7856afb None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:31:25.419392 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 648/1302] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:31:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:31:25.424584 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fcbb30-9cee-4e3f-8763-18090ce020c6 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:31:25.424992 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fcbb30-9cee-4e3f-8763-18090ce020c6 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:31:25.425143 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fcbb30-9cee-4e3f-8763-18090ce020c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:31:25.443511 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-53fcbb30-9cee-4e3f-8763-18090ce020c6 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:31:25.444754 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-53fcbb30-9cee-4e3f-8763-18090ce020c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:31:25.510630 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 655/1303] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:31:25 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 02 21:31:25.533376 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7c6b46-e964-445d-8091-f319a7856afb None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:31:25.631969 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:31:25.638872 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7c6b46-e964-445d-8091-f319a7856afb None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:31:25.671359 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942e9e67-1b24-47b6-b3c0-0b0a7233fdcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:31:25.671988 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942e9e67-1b24-47b6-b3c0-0b0a7233fdcd None admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:31:25.672303 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942e9e67-1b24-47b6-b3c0-0b0a7233fdcd None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:31:25.672587 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942e9e67-1b24-47b6-b3c0-0b0a7233fdcd None admin] PATH_INFO: `/v3/services/placement` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:31:25.673207 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942e9e67-1b24-47b6-b3c0-0b0a7233fdcd None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:31:25.674566 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942e9e67-1b24-47b6-b3c0-0b0a7233fdcd None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:31:25.683720 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application [None req-942e9e67-1b24-47b6-b3c0-0b0a7233fdcd None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 02 21:31:25.683720 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:31:25.683720 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 02 21:31:25.683720 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 02 21:31:25.683720 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 02 21:31:25.683720 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 02 21:31:25.683720 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 02 21:31:25.683720 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 21:31:25.683720 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 02 21:31:25.683720 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:31:25.683720 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 02 21:31:25.683720 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:31:25.683720 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 02 21:31:25.683720 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 02 21:31:25.683720 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 02 21:31:25.683720 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 02 21:31:25.683720 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 02 21:31:25.684904 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 02 21:31:25.684904 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 02 21:31:25.684904 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 02 21:31:25.684904 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 02 21:31:25.684904 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 02 21:31:25.684904 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 02 21:31:25.684904 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 02 21:31:25.684904 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 02 21:31:25.684904 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 02 21:31:25.684904 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 02 21:31:25.684904 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 02 21:31:25.684904 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 02 21:31:25.684904 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 02 21:31:25.684904 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 02 21:31:25.684904 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 02 21:31:25.684904 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.get_or_create( Aug 02 21:31:25.685932 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 02 21:31:25.685932 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application with Lock( Aug 02 21:31:25.685932 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 02 21:31:25.685932 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self._enter() Aug 02 21:31:25.685932 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 02 21:31:25.685932 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 02 21:31:25.685932 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 02 21:31:25.685932 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application return self.creator() Aug 02 21:31:25.685932 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 02 21:31:25.685932 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application created_value = creator( Aug 02 21:31:25.685932 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 02 21:31:25.685932 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 02 21:31:25.685932 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 02 21:31:25.685932 dv-cinder-851449-4-smb devstack@keystone.service[80420]: ERROR keystone.server.flask.application Aug 02 21:31:25.685932 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 649/1304] 10.222.0.70 () {56 vars in 1117 bytes} [Tue Aug 2 21:31:25 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 02 21:31:25.693061 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fcbb30-9cee-4e3f-8763-18090ce020c6 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:31:25.767787 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:31:25.790906 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fcbb30-9cee-4e3f-8763-18090ce020c6 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:31:25.824459 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9738c7a3-6475-46f1-b914-34030273d9f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:31:25.825071 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9738c7a3-6475-46f1-b914-34030273d9f8 None admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:31:25.825356 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9738c7a3-6475-46f1-b914-34030273d9f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:31:25.825632 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9738c7a3-6475-46f1-b914-34030273d9f8 None admin] PATH_INFO: `/v3/services` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:31:25.826300 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9738c7a3-6475-46f1-b914-34030273d9f8 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:31:25.826606 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9738c7a3-6475-46f1-b914-34030273d9f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:31:25.827958 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9738c7a3-6475-46f1-b914-34030273d9f8 None admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:31:25.832967 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 656/1305] 10.222.0.70 () {56 vars in 1116 bytes} [Tue Aug 2 21:31:25 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:31:25.839346 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942e9e67-1b24-47b6-b3c0-0b0a7233fdcd None admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:31:25.939935 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942e9e67-1b24-47b6-b3c0-0b0a7233fdcd None admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:31:25.976432 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b626482-b32f-4d60-aa3a-4902c6c9161d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:31:25.976980 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b626482-b32f-4d60-aa3a-4902c6c9161d None admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:31:25.977327 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b626482-b32f-4d60-aa3a-4902c6c9161d None admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:31:25.977597 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b626482-b32f-4d60-aa3a-4902c6c9161d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:31:25.978315 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b626482-b32f-4d60-aa3a-4902c6c9161d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:31:25.979824 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b626482-b32f-4d60-aa3a-4902c6c9161d None admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:31:25.999944 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 650/1306] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 2 21:31:25 2022] POST /identity/v3/endpoints => generated 331 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:31:35.830017 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=30 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:31:35.995854 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:32:28.686390 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be52b5b-00b6-430b-931c-b31ce7910107 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:32:28.687425 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be52b5b-00b6-430b-931c-b31ce7910107 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:32:28.687936 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be52b5b-00b6-430b-931c-b31ce7910107 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:32:28.693469 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 657/1307] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:32:28 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:32:28.694853 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae824fa-c9ba-4cc1-b10e-e29e73508251 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:32:28.695289 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae824fa-c9ba-4cc1-b10e-e29e73508251 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:32:28.695459 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae824fa-c9ba-4cc1-b10e-e29e73508251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:32:28.771173 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-7ae824fa-c9ba-4cc1-b10e-e29e73508251 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:32:28.772454 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-7ae824fa-c9ba-4cc1-b10e-e29e73508251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:32:28.928257 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 651/1308] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:32:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:32:28.977587 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66df65de-3cbf-437f-b954-96299958bc0b None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:32:28.978374 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66df65de-3cbf-437f-b954-96299958bc0b None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:32:28.979083 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66df65de-3cbf-437f-b954-96299958bc0b None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:32:28.982839 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 658/1309] 10.222.0.70 () {54 vars in 965 bytes} [Tue Aug 2 21:32:28 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:32:28.990419 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406f895f-24e6-4687-bcf8-7260163bb4a0 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:32:28.990656 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406f895f-24e6-4687-bcf8-7260163bb4a0 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:32:28.990940 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406f895f-24e6-4687-bcf8-7260163bb4a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:32:29.145086 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-406f895f-24e6-4687-bcf8-7260163bb4a0 None None] MFA Rules not processed for user `723f5f43572a493dae0349070a2adb5e`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:32:29.146313 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-406f895f-24e6-4687-bcf8-7260163bb4a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:32:29.171277 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:32:29.232276 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 652/1310] 10.222.0.70 () {58 vars in 1062 bytes} [Tue Aug 2 21:32:28 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:32:29.241987 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66df65de-3cbf-437f-b954-96299958bc0b None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:32:29.243709 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-66df65de-3cbf-437f-b954-96299958bc0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:32:29.366461 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66df65de-3cbf-437f-b954-96299958bc0b None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:32:29.443027 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320fbfae-38b2-4abf-a8d1-c58dcd4b3cc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '723f5f43572a493dae0349070a2adb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:32:29.443655 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320fbfae-38b2-4abf-a8d1-c58dcd4b3cc5 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:32:29.443939 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320fbfae-38b2-4abf-a8d1-c58dcd4b3cc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:32:29.444729 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320fbfae-38b2-4abf-a8d1-c58dcd4b3cc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:32:29.446340 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-320fbfae-38b2-4abf-a8d1-c58dcd4b3cc5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:32:29.507369 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:32:29.566963 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320fbfae-38b2-4abf-a8d1-c58dcd4b3cc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:32:29.568997 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320fbfae-38b2-4abf-a8d1-c58dcd4b3cc5 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:32:29.593081 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 659/1311] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:32:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:32:31.869775 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42cf4bb-d8ed-4aed-92a3-899c31b1438d None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:32:31.870318 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42cf4bb-d8ed-4aed-92a3-899c31b1438d None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:32:31.870318 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42cf4bb-d8ed-4aed-92a3-899c31b1438d None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:32:31.871920 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 653/1312] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:32:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:32:31.877689 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0273eb45-7159-40db-8af4-21f00e3972ea None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:32:31.878213 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0273eb45-7159-40db-8af4-21f00e3972ea None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:32:31.878293 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0273eb45-7159-40db-8af4-21f00e3972ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:32:31.967689 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-0273eb45-7159-40db-8af4-21f00e3972ea None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:32:31.968981 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-0273eb45-7159-40db-8af4-21f00e3972ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:32:32.077532 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 660/1313] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:32:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:32:32.115731 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42cf4bb-d8ed-4aed-92a3-899c31b1438d None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:32:32.117610 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-c42cf4bb-d8ed-4aed-92a3-899c31b1438d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:32:32.231294 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42cf4bb-d8ed-4aed-92a3-899c31b1438d None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:32:32.320375 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:32:32.323597 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1090955-77e6-4828-a373-176cc4d9083c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '723f5f43572a493dae0349070a2adb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:32:32.324279 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1090955-77e6-4828-a373-176cc4d9083c service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:32:32.324932 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1090955-77e6-4828-a373-176cc4d9083c service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:32:32.325619 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1090955-77e6-4828-a373-176cc4d9083c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:32:32.327726 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-b1090955-77e6-4828-a373-176cc4d9083c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:32:32.443799 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1090955-77e6-4828-a373-176cc4d9083c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:32:32.445828 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1090955-77e6-4828-a373-176cc4d9083c service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:32:32.464751 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 654/1314] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:32:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:32:34.783721 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab22e143-df85-49fb-853b-6628751c06c9 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:32:34.784306 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab22e143-df85-49fb-853b-6628751c06c9 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:32:34.784306 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab22e143-df85-49fb-853b-6628751c06c9 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:32:34.785670 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 661/1315] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:32:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:32:34.790732 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed521af-2427-4367-99a0-1ffbcce6a8a2 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:32:34.791130 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed521af-2427-4367-99a0-1ffbcce6a8a2 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:32:34.791289 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed521af-2427-4367-99a0-1ffbcce6a8a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:32:34.858744 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-fed521af-2427-4367-99a0-1ffbcce6a8a2 None None] MFA Rules not processed for user `19d387c06a3e450fbcd87cab2ec693c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:32:34.859981 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-fed521af-2427-4367-99a0-1ffbcce6a8a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:32:34.911508 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:32:34.961303 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 655/1316] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:32:34 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:32:35.001780 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab22e143-df85-49fb-853b-6628751c06c9 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:32:35.003326 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-ab22e143-df85-49fb-853b-6628751c06c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:32:35.013834 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:32:35.106600 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab22e143-df85-49fb-853b-6628751c06c9 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:32:35.179404 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892eb100-7a7d-4ffe-bf5e-65f964b438fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '723f5f43572a493dae0349070a2adb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:32:35.180075 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892eb100-7a7d-4ffe-bf5e-65f964b438fa service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:32:35.180390 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892eb100-7a7d-4ffe-bf5e-65f964b438fa service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:32:35.180662 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892eb100-7a7d-4ffe-bf5e-65f964b438fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:32:35.182319 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-892eb100-7a7d-4ffe-bf5e-65f964b438fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:32:35.247531 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:32:35.295117 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892eb100-7a7d-4ffe-bf5e-65f964b438fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:32:35.296631 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892eb100-7a7d-4ffe-bf5e-65f964b438fa service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:32:35.315283 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 662/1317] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:32:35 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:32:37.851109 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb80c903-1251-4a98-8e22-a983338d0791 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:32:37.851638 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb80c903-1251-4a98-8e22-a983338d0791 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:32:37.851638 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb80c903-1251-4a98-8e22-a983338d0791 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:32:37.853064 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 656/1318] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:32:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:32:37.858282 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c27e2c-d3fc-45cb-995b-a4002063181a None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:32:37.858702 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c27e2c-d3fc-45cb-995b-a4002063181a None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:32:37.858843 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c27e2c-d3fc-45cb-995b-a4002063181a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:32:37.926483 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-89c27e2c-d3fc-45cb-995b-a4002063181a None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:32:37.927728 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-89c27e2c-d3fc-45cb-995b-a4002063181a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:32:38.022675 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 663/1319] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:32:37 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:32:38.061473 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb80c903-1251-4a98-8e22-a983338d0791 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:32:38.063000 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-fb80c903-1251-4a98-8e22-a983338d0791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:32:38.164022 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb80c903-1251-4a98-8e22-a983338d0791 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:32:38.236306 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27db7a06-8742-4d31-8ec4-8a2cb8213ccc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '723f5f43572a493dae0349070a2adb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:32:38.236926 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27db7a06-8742-4d31-8ec4-8a2cb8213ccc service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:32:38.237213 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27db7a06-8742-4d31-8ec4-8a2cb8213ccc service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:32:38.237490 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27db7a06-8742-4d31-8ec4-8a2cb8213ccc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:32:38.239119 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-27db7a06-8742-4d31-8ec4-8a2cb8213ccc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:32:38.246830 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:32:38.347783 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27db7a06-8742-4d31-8ec4-8a2cb8213ccc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:32:38.349261 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27db7a06-8742-4d31-8ec4-8a2cb8213ccc service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:32:38.367332 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 657/1320] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:32:38 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:32:41.003345 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b74a58-0379-4c46-b02b-32ab22162927 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:32:41.003884 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b74a58-0379-4c46-b02b-32ab22162927 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:32:41.004062 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b74a58-0379-4c46-b02b-32ab22162927 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:32:41.005448 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 664/1321] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:32:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:32:41.011210 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620a0b48-7f34-41ab-89e0-b636efe0df88 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:32:41.011652 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620a0b48-7f34-41ab-89e0-b636efe0df88 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:32:41.011800 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620a0b48-7f34-41ab-89e0-b636efe0df88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:32:41.078146 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-620a0b48-7f34-41ab-89e0-b636efe0df88 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:32:41.079353 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-620a0b48-7f34-41ab-89e0-b636efe0df88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:32:41.137492 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:32:41.183354 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 658/1322] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:32:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:32:41.220636 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b74a58-0379-4c46-b02b-32ab22162927 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:32:41.222208 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-d7b74a58-0379-4c46-b02b-32ab22162927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:32:41.243315 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:32:41.344221 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b74a58-0379-4c46-b02b-32ab22162927 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:32:41.419448 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4120ac27-c909-4458-896a-16e735edc02c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '723f5f43572a493dae0349070a2adb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:32:41.420069 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4120ac27-c909-4458-896a-16e735edc02c service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:32:41.420392 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4120ac27-c909-4458-896a-16e735edc02c service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:32:41.420661 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4120ac27-c909-4458-896a-16e735edc02c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:32:41.422282 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-4120ac27-c909-4458-896a-16e735edc02c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:32:41.495575 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:32:41.534150 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4120ac27-c909-4458-896a-16e735edc02c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:32:41.535607 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4120ac27-c909-4458-896a-16e735edc02c service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:32:41.555282 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 665/1323] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:32:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:32:43.606008 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8927c2-f8e1-4b04-879e-3bb82b44bdd8 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:32:43.606530 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8927c2-f8e1-4b04-879e-3bb82b44bdd8 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:32:43.606530 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8927c2-f8e1-4b04-879e-3bb82b44bdd8 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:32:43.607846 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 659/1324] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:32:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 21:32:43.612950 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5313158-63d8-4572-9155-248a58b58261 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:32:43.613334 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5313158-63d8-4572-9155-248a58b58261 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:32:43.613503 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5313158-63d8-4572-9155-248a58b58261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:32:43.679357 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-c5313158-63d8-4572-9155-248a58b58261 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:32:43.680520 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-c5313158-63d8-4572-9155-248a58b58261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:32:43.777955 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 666/1325] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:32:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:32:43.826184 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb5147a-0d6f-44f3-b2df-1fe550cd315f None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:32:43.826476 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb5147a-0d6f-44f3-b2df-1fe550cd315f None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:32:43.826750 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb5147a-0d6f-44f3-b2df-1fe550cd315f None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:32:43.828123 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 660/1326] 10.222.0.70 () {54 vars in 965 bytes} [Tue Aug 2 21:32:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:32:43.833984 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbac248d-10f5-497b-a91a-899e562a6cf0 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:32:43.834350 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbac248d-10f5-497b-a91a-899e562a6cf0 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:32:43.834728 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbac248d-10f5-497b-a91a-899e562a6cf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:32:43.866148 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:32:43.911782 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-dbac248d-10f5-497b-a91a-899e562a6cf0 None None] MFA Rules not processed for user `723f5f43572a493dae0349070a2adb5e`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:32:43.913072 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-dbac248d-10f5-497b-a91a-899e562a6cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:32:43.991485 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 667/1327] 10.222.0.70 () {58 vars in 1062 bytes} [Tue Aug 2 21:32:43 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:32:44.000394 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb5147a-0d6f-44f3-b2df-1fe550cd315f None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:32:44.001917 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-efb5147a-0d6f-44f3-b2df-1fe550cd315f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:32:44.110906 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb5147a-0d6f-44f3-b2df-1fe550cd315f None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:32:44.186871 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b2d290-ca97-4741-b48c-4121e20e6ca5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '723f5f43572a493dae0349070a2adb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:32:44.187412 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b2d290-ca97-4741-b48c-4121e20e6ca5 service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:32:44.187696 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b2d290-ca97-4741-b48c-4121e20e6ca5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:32:44.188086 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b2d290-ca97-4741-b48c-4121e20e6ca5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:32:44.189773 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-69b2d290-ca97-4741-b48c-4121e20e6ca5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:32:44.207357 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:32:44.310786 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b2d290-ca97-4741-b48c-4121e20e6ca5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:32:44.312245 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b2d290-ca97-4741-b48c-4121e20e6ca5 service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:32:44.331131 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 661/1328] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:32:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:32:46.619196 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5633a64b-f2cc-43f6-acb6-a07f26d01e18 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:32:46.619692 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5633a64b-f2cc-43f6-acb6-a07f26d01e18 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:32:46.619692 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5633a64b-f2cc-43f6-acb6-a07f26d01e18 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:32:46.621055 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 668/1329] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:32:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:32:46.626359 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debb3651-ff28-42a1-9159-d597a1b73f3b None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:32:46.626835 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debb3651-ff28-42a1-9159-d597a1b73f3b None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:32:46.626941 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debb3651-ff28-42a1-9159-d597a1b73f3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:32:46.694598 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-debb3651-ff28-42a1-9159-d597a1b73f3b None None] MFA Rules not processed for user `19d387c06a3e450fbcd87cab2ec693c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:32:46.695813 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-debb3651-ff28-42a1-9159-d597a1b73f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:32:46.763324 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:32:46.796382 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 662/1330] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:32:46 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:32:46.834441 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5633a64b-f2cc-43f6-acb6-a07f26d01e18 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:32:46.836572 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-5633a64b-f2cc-43f6-acb6-a07f26d01e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:32:46.951790 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5633a64b-f2cc-43f6-acb6-a07f26d01e18 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:32:46.972199 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:32:47.026676 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a61009c-ccd7-4b49-b202-955a0215bde3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '723f5f43572a493dae0349070a2adb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:32:47.027300 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a61009c-ccd7-4b49-b202-955a0215bde3 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:32:47.027587 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a61009c-ccd7-4b49-b202-955a0215bde3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:32:47.027866 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a61009c-ccd7-4b49-b202-955a0215bde3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:32:47.029520 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-0a61009c-ccd7-4b49-b202-955a0215bde3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:32:47.140681 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a61009c-ccd7-4b49-b202-955a0215bde3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:32:47.142039 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a61009c-ccd7-4b49-b202-955a0215bde3 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:32:47.159633 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 669/1331] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:32:46 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:32:49.591969 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5ec73b-6ca4-4681-92e2-952560104384 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:32:49.592500 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5ec73b-6ca4-4681-92e2-952560104384 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:32:49.592500 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5ec73b-6ca4-4681-92e2-952560104384 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:32:49.593825 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 663/1332] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:32:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:32:49.598907 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc867f0-77c1-491e-8bb0-a000cd32c10b None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:32:49.599298 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc867f0-77c1-491e-8bb0-a000cd32c10b None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:32:49.599467 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc867f0-77c1-491e-8bb0-a000cd32c10b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:32:49.663135 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:32:49.665807 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-3cc867f0-77c1-491e-8bb0-a000cd32c10b None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:32:49.667569 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-3cc867f0-77c1-491e-8bb0-a000cd32c10b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:32:49.762144 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 670/1333] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:32:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:32:49.798264 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5ec73b-6ca4-4681-92e2-952560104384 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:32:49.799801 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-df5ec73b-6ca4-4681-92e2-952560104384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:32:49.904555 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5ec73b-6ca4-4681-92e2-952560104384 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:32:49.977992 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2ae91f-c3e1-45f2-aac4-9655535cf636 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '723f5f43572a493dae0349070a2adb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:32:49.978608 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ae91f-c3e1-45f2-aac4-9655535cf636 service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:32:49.978890 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ae91f-c3e1-45f2-aac4-9655535cf636 service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:32:49.979162 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ae91f-c3e1-45f2-aac4-9655535cf636 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:32:49.980793 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-cb2ae91f-c3e1-45f2-aac4-9655535cf636 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:32:50.009132 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:32:50.089988 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2ae91f-c3e1-45f2-aac4-9655535cf636 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:32:50.091438 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2ae91f-c3e1-45f2-aac4-9655535cf636 service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:32:50.108954 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 664/1334] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:32:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:32:52.142764 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a48e958-380a-4771-8fbd-58001f39a562 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:32:52.143372 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a48e958-380a-4771-8fbd-58001f39a562 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:32:52.143372 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a48e958-380a-4771-8fbd-58001f39a562 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:32:52.144705 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 671/1335] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:32:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:32:52.150577 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ee6e31-5334-44ce-99ef-76887a377ebc None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:32:52.151009 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ee6e31-5334-44ce-99ef-76887a377ebc None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:32:52.151117 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ee6e31-5334-44ce-99ef-76887a377ebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:32:52.215402 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-c1ee6e31-5334-44ce-99ef-76887a377ebc None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:32:52.216624 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-c1ee6e31-5334-44ce-99ef-76887a377ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:32:52.289602 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:32:52.312363 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 665/1336] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:32:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:32:52.351871 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a48e958-380a-4771-8fbd-58001f39a562 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:32:52.353508 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-1a48e958-380a-4771-8fbd-58001f39a562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:32:52.457548 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a48e958-380a-4771-8fbd-58001f39a562 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:32:52.485661 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:32:52.531006 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fafa35-5ce3-48ff-ba12-adfa595f2da4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '723f5f43572a493dae0349070a2adb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:32:52.531625 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fafa35-5ce3-48ff-ba12-adfa595f2da4 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:32:52.531907 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fafa35-5ce3-48ff-ba12-adfa595f2da4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:32:52.532183 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fafa35-5ce3-48ff-ba12-adfa595f2da4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:32:52.533817 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-b1fafa35-5ce3-48ff-ba12-adfa595f2da4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:32:52.641929 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fafa35-5ce3-48ff-ba12-adfa595f2da4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:32:52.643356 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fafa35-5ce3-48ff-ba12-adfa595f2da4 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:32:52.660900 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 672/1337] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:32:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:32:55.133700 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8f9923-c675-4811-992e-bddf26fe8e63 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:32:55.134233 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8f9923-c675-4811-992e-bddf26fe8e63 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:32:55.134233 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8f9923-c675-4811-992e-bddf26fe8e63 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:32:55.135614 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 666/1338] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:32:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:32:55.140715 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b26b3a-3103-4f81-8116-ca80ecf91acb None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:32:55.141154 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b26b3a-3103-4f81-8116-ca80ecf91acb None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:32:55.141256 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b26b3a-3103-4f81-8116-ca80ecf91acb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:32:55.206168 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-b6b26b3a-3103-4f81-8116-ca80ecf91acb None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:32:55.207458 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-b6b26b3a-3103-4f81-8116-ca80ecf91acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:32:55.216173 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:32:55.304689 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 673/1339] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:32:55 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:32:55.340729 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8f9923-c675-4811-992e-bddf26fe8e63 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:32:55.342251 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-1c8f9923-c675-4811-992e-bddf26fe8e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:32:55.444174 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8f9923-c675-4811-992e-bddf26fe8e63 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:32:55.517534 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaade9d-b0ac-4590-a5c8-7e3e1b29af89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '723f5f43572a493dae0349070a2adb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:32:55.518149 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaade9d-b0ac-4590-a5c8-7e3e1b29af89 service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:32:55.518432 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaade9d-b0ac-4590-a5c8-7e3e1b29af89 service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:32:55.518705 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaade9d-b0ac-4590-a5c8-7e3e1b29af89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:32:55.520424 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-0eaade9d-b0ac-4590-a5c8-7e3e1b29af89 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:32:55.556994 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:32:55.629471 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaade9d-b0ac-4590-a5c8-7e3e1b29af89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:32:55.631435 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaade9d-b0ac-4590-a5c8-7e3e1b29af89 service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:32:55.649608 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 667/1340] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:32:55 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:32:59.676126 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93538288-74ca-4925-8e59-adf2f5ee5a5f None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:32:59.676697 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93538288-74ca-4925-8e59-adf2f5ee5a5f None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:32:59.676697 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93538288-74ca-4925-8e59-adf2f5ee5a5f None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:32:59.678746 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 674/1341] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:32:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:32:59.684126 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c863b981-ca5f-4bdf-8679-e015cb94f2f4 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:32:59.684602 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c863b981-ca5f-4bdf-8679-e015cb94f2f4 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:32:59.684691 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c863b981-ca5f-4bdf-8679-e015cb94f2f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:32:59.752340 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-c863b981-ca5f-4bdf-8679-e015cb94f2f4 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:32:59.753464 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-c863b981-ca5f-4bdf-8679-e015cb94f2f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:32:59.837892 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:32:59.849982 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 668/1342] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:32:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:32:59.887929 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93538288-74ca-4925-8e59-adf2f5ee5a5f None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:32:59.889491 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-93538288-74ca-4925-8e59-adf2f5ee5a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:32:59.994563 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93538288-74ca-4925-8e59-adf2f5ee5a5f None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:33:00.032923 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:33:00.077602 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6bb45e-dd85-4dcd-a945-6526382dd27c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '723f5f43572a493dae0349070a2adb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:33:00.078222 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6bb45e-dd85-4dcd-a945-6526382dd27c service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:00.078499 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6bb45e-dd85-4dcd-a945-6526382dd27c service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:00.078767 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6bb45e-dd85-4dcd-a945-6526382dd27c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:00.080415 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-7e6bb45e-dd85-4dcd-a945-6526382dd27c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:33:00.189682 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6bb45e-dd85-4dcd-a945-6526382dd27c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:33:00.191144 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6bb45e-dd85-4dcd-a945-6526382dd27c service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:33:00.210273 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 675/1343] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:32:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:33:02.853213 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9fd501-3be0-4a90-9496-966375fbdefc None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:02.853765 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9fd501-3be0-4a90-9496-966375fbdefc None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:02.853765 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9fd501-3be0-4a90-9496-966375fbdefc None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:02.855135 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 669/1344] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:33:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:33:02.860960 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de7b48f-6a2c-436f-85f1-6cce4b0e05ae None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:02.861493 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de7b48f-6a2c-436f-85f1-6cce4b0e05ae None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:02.861493 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de7b48f-6a2c-436f-85f1-6cce4b0e05ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:02.933682 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-4de7b48f-6a2c-436f-85f1-6cce4b0e05ae None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:33:02.934923 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-4de7b48f-6a2c-436f-85f1-6cce4b0e05ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:33:02.953914 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:33:03.034080 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 676/1345] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:33:02 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:33:03.074789 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9fd501-3be0-4a90-9496-966375fbdefc None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:33:03.076368 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-3a9fd501-3be0-4a90-9496-966375fbdefc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:33:03.185489 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9fd501-3be0-4a90-9496-966375fbdefc None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:33:03.260815 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9333febe-58f1-4db0-9074-b9f4c82a2481 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '723f5f43572a493dae0349070a2adb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:33:03.261434 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9333febe-58f1-4db0-9074-b9f4c82a2481 service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:03.261717 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9333febe-58f1-4db0-9074-b9f4c82a2481 service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:03.261992 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9333febe-58f1-4db0-9074-b9f4c82a2481 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:03.263595 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-9333febe-58f1-4db0-9074-b9f4c82a2481 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:33:03.312606 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:33:03.380936 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9333febe-58f1-4db0-9074-b9f4c82a2481 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:33:03.382892 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9333febe-58f1-4db0-9074-b9f4c82a2481 service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:33:03.402167 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 670/1346] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:33:03 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:33:07.394342 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438576a6-7ac2-4b83-a17c-8adad187c009 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:07.394855 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438576a6-7ac2-4b83-a17c-8adad187c009 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:07.394855 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438576a6-7ac2-4b83-a17c-8adad187c009 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:07.396766 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 677/1347] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:33:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:33:07.402016 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ba4b02-fb70-4521-b44c-924b5bb7cf3d None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:07.402460 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ba4b02-fb70-4521-b44c-924b5bb7cf3d None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:07.402583 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ba4b02-fb70-4521-b44c-924b5bb7cf3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:07.469029 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-22ba4b02-fb70-4521-b44c-924b5bb7cf3d None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:33:07.470258 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-22ba4b02-fb70-4521-b44c-924b5bb7cf3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:33:07.567846 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:33:07.570498 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 671/1348] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:33:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:33:07.609391 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438576a6-7ac2-4b83-a17c-8adad187c009 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:33:07.611111 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-438576a6-7ac2-4b83-a17c-8adad187c009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:33:07.747772 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438576a6-7ac2-4b83-a17c-8adad187c009 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:33:07.802057 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:33:07.829576 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3185c410-354a-418f-aa9a-287a4226804e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '723f5f43572a493dae0349070a2adb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:33:07.830202 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3185c410-354a-418f-aa9a-287a4226804e service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:07.830488 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3185c410-354a-418f-aa9a-287a4226804e service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:07.830764 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3185c410-354a-418f-aa9a-287a4226804e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:07.832437 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-3185c410-354a-418f-aa9a-287a4226804e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:33:07.949212 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3185c410-354a-418f-aa9a-287a4226804e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:33:07.950679 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3185c410-354a-418f-aa9a-287a4226804e service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:33:07.970130 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 678/1349] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:33:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 21:33:12.887573 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e4f7a2-742f-4745-858e-7b5d9697cd69 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:12.888000 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e4f7a2-742f-4745-858e-7b5d9697cd69 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:12.888186 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e4f7a2-742f-4745-858e-7b5d9697cd69 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:12.889513 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 672/1350] 10.222.0.70 () {54 vars in 921 bytes} [Tue Aug 2 21:33:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:33:12.894544 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86750896-c97b-4f00-a672-fecfebe4131e None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:12.895001 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86750896-c97b-4f00-a672-fecfebe4131e None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:12.895190 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86750896-c97b-4f00-a672-fecfebe4131e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:12.979555 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-86750896-c97b-4f00-a672-fecfebe4131e None None] MFA Rules not processed for user `83fcd951771e42959506b70b0137003f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:33:12.980790 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-86750896-c97b-4f00-a672-fecfebe4131e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:33:13.001114 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:33:13.143023 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 679/1351] 10.222.0.70 () {58 vars in 1018 bytes} [Tue Aug 2 21:33:12 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:33:17.231486 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2626c5d4-9598-42c3-83c1-6b49d363dbc1 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:17.233079 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2626c5d4-9598-42c3-83c1-6b49d363dbc1 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:17.233487 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2626c5d4-9598-42c3-83c1-6b49d363dbc1 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:17.235192 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 673/1352] 10.222.0.70 () {54 vars in 921 bytes} [Tue Aug 2 21:33:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:33:17.241098 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7e0353-0908-4265-a5f5-d2a2ba1e826c None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:17.241542 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7e0353-0908-4265-a5f5-d2a2ba1e826c None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:17.241845 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7e0353-0908-4265-a5f5-d2a2ba1e826c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:17.330265 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-7e7e0353-0908-4265-a5f5-d2a2ba1e826c None None] MFA Rules not processed for user `83fcd951771e42959506b70b0137003f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:33:17.331757 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-7e7e0353-0908-4265-a5f5-d2a2ba1e826c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:33:17.418464 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:33:17.459895 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 680/1353] 10.222.0.70 () {58 vars in 1018 bytes} [Tue Aug 2 21:33:17 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:33:18.901514 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c866ffd-4e92-428f-a0b0-781df45c0d13 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:18.902062 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c866ffd-4e92-428f-a0b0-781df45c0d13 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:18.902062 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c866ffd-4e92-428f-a0b0-781df45c0d13 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:18.903417 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 674/1354] 10.222.0.70 () {54 vars in 921 bytes} [Tue Aug 2 21:33:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:33:18.908650 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7308027a-720f-4dd9-92c6-0bf5bb132a1c None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:18.909143 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7308027a-720f-4dd9-92c6-0bf5bb132a1c None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:18.909300 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7308027a-720f-4dd9-92c6-0bf5bb132a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:18.989321 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-7308027a-720f-4dd9-92c6-0bf5bb132a1c None None] MFA Rules not processed for user `83fcd951771e42959506b70b0137003f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:33:18.990773 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-7308027a-720f-4dd9-92c6-0bf5bb132a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:33:19.097106 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 681/1355] 10.222.0.70 () {58 vars in 1018 bytes} [Tue Aug 2 21:33:18 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:33:22.604056 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f7044-87de-4379-9de7-83633e59bf76 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:22.604671 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f7044-87de-4379-9de7-83633e59bf76 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:22.604757 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362f7044-87de-4379-9de7-83633e59bf76 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:22.610374 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 675/1356] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:33:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:33:22.612538 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f330ee9-fbb6-4d16-b5d8-76bd668b7a74 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:22.613554 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f330ee9-fbb6-4d16-b5d8-76bd668b7a74 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:22.613736 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f330ee9-fbb6-4d16-b5d8-76bd668b7a74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:22.667299 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:33:22.699603 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-9f330ee9-fbb6-4d16-b5d8-76bd668b7a74 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:33:22.700827 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-9f330ee9-fbb6-4d16-b5d8-76bd668b7a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:33:22.806750 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 682/1357] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:33:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:33:22.858367 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a488141-41af-440d-a78c-f3d7df880709 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:22.859036 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a488141-41af-440d-a78c-f3d7df880709 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:22.859525 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a488141-41af-440d-a78c-f3d7df880709 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:22.862094 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 676/1358] 10.222.0.70 () {54 vars in 962 bytes} [Tue Aug 2 21:33:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:33:22.872438 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f7f9a2-0846-4f37-ba36-bef1191717f5 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:22.873028 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f7f9a2-0846-4f37-ba36-bef1191717f5 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:22.873526 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f7f9a2-0846-4f37-ba36-bef1191717f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:22.958682 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-06f7f9a2-0846-4f37-ba36-bef1191717f5 None None] MFA Rules not processed for user `87dd5c1c5e854d4b96e0b7dad6aa3719`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:33:22.959922 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-06f7f9a2-0846-4f37-ba36-bef1191717f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:33:23.011648 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:33:23.101295 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 683/1359] 10.222.0.70 () {58 vars in 1059 bytes} [Tue Aug 2 21:33:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:33:23.110102 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a488141-41af-440d-a78c-f3d7df880709 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:33:23.111674 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-3a488141-41af-440d-a78c-f3d7df880709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:33:23.261511 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a488141-41af-440d-a78c-f3d7df880709 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:33:23.349823 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:33:23.396483 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52853315-552b-4027-bbfb-35cc9e91fc61 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87dd5c1c5e854d4b96e0b7dad6aa3719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:33:23.397218 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52853315-552b-4027-bbfb-35cc9e91fc61 service nova] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:23.397576 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52853315-552b-4027-bbfb-35cc9e91fc61 service nova] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:23.397914 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52853315-552b-4027-bbfb-35cc9e91fc61 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:23.399584 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-52853315-552b-4027-bbfb-35cc9e91fc61 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:33:23.493893 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52853315-552b-4027-bbfb-35cc9e91fc61 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:33:23.495620 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52853315-552b-4027-bbfb-35cc9e91fc61 service nova] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:33:23.515100 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 677/1360] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:33:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 21:33:25.744734 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668af767-7136-4c64-954a-60734c5ec232 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:25.745307 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668af767-7136-4c64-954a-60734c5ec232 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:25.745307 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668af767-7136-4c64-954a-60734c5ec232 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:25.746885 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 684/1361] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:33:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:33:25.752411 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bb328e-5d30-4213-9583-056e939a11dd None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:25.752937 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bb328e-5d30-4213-9583-056e939a11dd None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:25.753585 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bb328e-5d30-4213-9583-056e939a11dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:25.824135 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-77bb328e-5d30-4213-9583-056e939a11dd None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:33:25.825398 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-77bb328e-5d30-4213-9583-056e939a11dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:33:25.865375 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:33:25.931969 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 678/1362] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:33:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:33:25.980150 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668af767-7136-4c64-954a-60734c5ec232 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:33:25.981937 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-668af767-7136-4c64-954a-60734c5ec232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:33:26.156570 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668af767-7136-4c64-954a-60734c5ec232 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:33:26.166537 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:33:26.291451 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edd6289-20e5-4c8b-8fa0-af398e44f692 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87dd5c1c5e854d4b96e0b7dad6aa3719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:33:26.291933 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edd6289-20e5-4c8b-8fa0-af398e44f692 service nova] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:26.292216 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edd6289-20e5-4c8b-8fa0-af398e44f692 service nova] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:26.292520 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edd6289-20e5-4c8b-8fa0-af398e44f692 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:26.294137 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-0edd6289-20e5-4c8b-8fa0-af398e44f692 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:33:26.396785 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edd6289-20e5-4c8b-8fa0-af398e44f692 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:33:26.399056 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edd6289-20e5-4c8b-8fa0-af398e44f692 service nova] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:33:26.419177 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 685/1363] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:33:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:33:28.746375 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e181b56a-683b-48f7-b4de-263cfebaf549 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:28.746901 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e181b56a-683b-48f7-b4de-263cfebaf549 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:28.747020 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e181b56a-683b-48f7-b4de-263cfebaf549 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:28.748303 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 679/1364] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:33:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:33:28.754559 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228b7b8e-349e-43ca-b724-7108266b47d2 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:28.755013 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228b7b8e-349e-43ca-b724-7108266b47d2 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:28.755119 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228b7b8e-349e-43ca-b724-7108266b47d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:28.775628 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:33:28.831568 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-228b7b8e-349e-43ca-b724-7108266b47d2 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:33:28.832658 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-228b7b8e-349e-43ca-b724-7108266b47d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:33:28.946587 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 686/1365] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:33:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:33:28.992949 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faef640-1159-430d-b3a7-be7e72b1f1b6 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:28.993547 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faef640-1159-430d-b3a7-be7e72b1f1b6 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:28.994069 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faef640-1159-430d-b3a7-be7e72b1f1b6 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:28.995867 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 680/1366] 10.222.0.70 () {54 vars in 962 bytes} [Tue Aug 2 21:33:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:33:29.001825 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612150fe-3f93-4ceb-ba19-44b1fec5a66d None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:29.002069 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612150fe-3f93-4ceb-ba19-44b1fec5a66d None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:29.002471 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612150fe-3f93-4ceb-ba19-44b1fec5a66d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:29.085470 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-612150fe-3f93-4ceb-ba19-44b1fec5a66d None None] MFA Rules not processed for user `87dd5c1c5e854d4b96e0b7dad6aa3719`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:33:29.086972 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-612150fe-3f93-4ceb-ba19-44b1fec5a66d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:33:29.133950 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:33:29.223813 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 687/1367] 10.222.0.70 () {58 vars in 1059 bytes} [Tue Aug 2 21:33:28 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:33:29.231495 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faef640-1159-430d-b3a7-be7e72b1f1b6 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:33:29.233014 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-5faef640-1159-430d-b3a7-be7e72b1f1b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:33:29.396649 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faef640-1159-430d-b3a7-be7e72b1f1b6 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:33:29.418545 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:33:29.518662 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb7e82b-07fa-4825-8b7f-bcd23067f65e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87dd5c1c5e854d4b96e0b7dad6aa3719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:33:29.519282 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb7e82b-07fa-4825-8b7f-bcd23067f65e service nova] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:29.519563 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb7e82b-07fa-4825-8b7f-bcd23067f65e service nova] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:29.519838 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb7e82b-07fa-4825-8b7f-bcd23067f65e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:29.521462 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-8bb7e82b-07fa-4825-8b7f-bcd23067f65e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:33:29.615366 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb7e82b-07fa-4825-8b7f-bcd23067f65e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:33:29.616961 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb7e82b-07fa-4825-8b7f-bcd23067f65e service nova] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:33:29.635853 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 681/1368] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:33:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:33:30.757405 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a616ef3a-90de-48af-a885-fa5a72a26891 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:30.757950 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a616ef3a-90de-48af-a885-fa5a72a26891 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:30.758112 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a616ef3a-90de-48af-a885-fa5a72a26891 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:30.759636 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 688/1369] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:33:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:33:30.764657 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb2030-7dc5-4209-b58f-a110e9f33fef None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:30.765087 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb2030-7dc5-4209-b58f-a110e9f33fef None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:30.765200 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fb2030-7dc5-4209-b58f-a110e9f33fef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:30.802159 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:33:30.842785 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-c4fb2030-7dc5-4209-b58f-a110e9f33fef None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:33:30.844008 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-c4fb2030-7dc5-4209-b58f-a110e9f33fef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:33:30.952362 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 682/1370] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:33:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:33:31.326279 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c620e784-2d6b-4904-be7d-7c34c8654653 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:31.326569 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c620e784-2d6b-4904-be7d-7c34c8654653 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:31.326850 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c620e784-2d6b-4904-be7d-7c34c8654653 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:31.328179 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 689/1371] 10.222.0.70 () {54 vars in 964 bytes} [Tue Aug 2 21:33:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:33:31.333777 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd1a9b9-0b7e-4951-b26b-93c029aa687a None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:31.334145 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd1a9b9-0b7e-4951-b26b-93c029aa687a None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:31.334505 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd1a9b9-0b7e-4951-b26b-93c029aa687a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:31.417087 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-0bd1a9b9-0b7e-4951-b26b-93c029aa687a None None] MFA Rules not processed for user `123eb76f95ee4e39905944da701c712d`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:33:31.418398 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-0bd1a9b9-0b7e-4951-b26b-93c029aa687a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:33:31.467536 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:33:31.501051 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 683/1372] 10.222.0.70 () {58 vars in 1061 bytes} [Tue Aug 2 21:33:31 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:33:31.508902 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c620e784-2d6b-4904-be7d-7c34c8654653 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:33:31.510654 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-c620e784-2d6b-4904-be7d-7c34c8654653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:33:31.631248 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c620e784-2d6b-4904-be7d-7c34c8654653 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:33:31.673987 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:33:31.687833 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418e112a-fb2f-4b53-875f-fafa9bc81d3e None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:31.688124 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418e112a-fb2f-4b53-875f-fafa9bc81d3e None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:31.688433 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418e112a-fb2f-4b53-875f-fafa9bc81d3e None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:31.689941 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 684/1373] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:33:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 21:33:31.695699 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d417173-9a3b-4856-98be-3c1a4ce11df8 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:31.696106 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d417173-9a3b-4856-98be-3c1a4ce11df8 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:31.696525 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d417173-9a3b-4856-98be-3c1a4ce11df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:31.714589 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9704013a-57ae-41d6-a0eb-5e574ffbe5b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '123eb76f95ee4e39905944da701c712d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:33:31.715214 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9704013a-57ae-41d6-a0eb-5e574ffbe5b1 service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:31.715495 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9704013a-57ae-41d6-a0eb-5e574ffbe5b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:31.715772 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9704013a-57ae-41d6-a0eb-5e574ffbe5b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:31.717489 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-9704013a-57ae-41d6-a0eb-5e574ffbe5b1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:33:31.772932 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-9d417173-9a3b-4856-98be-3c1a4ce11df8 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:33:31.774167 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-9d417173-9a3b-4856-98be-3c1a4ce11df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:33:31.839226 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9704013a-57ae-41d6-a0eb-5e574ffbe5b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:33:31.841994 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9704013a-57ae-41d6-a0eb-5e574ffbe5b1 service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:33:31.862043 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 690/1374] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:33:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:33:31.894082 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 685/1375] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:33:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:33:31.938445 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9704013a-57ae-41d6-a0eb-5e574ffbe5b1 service cinder] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:33:31.939663 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-9704013a-57ae-41d6-a0eb-5e574ffbe5b1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:33:32.027919 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:33:32.068619 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9704013a-57ae-41d6-a0eb-5e574ffbe5b1 service cinder] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:33:32.208053 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b625ffaa-b0da-4d9b-9a3b-dfd0ad6b3720 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87dd5c1c5e854d4b96e0b7dad6aa3719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:33:32.208902 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b625ffaa-b0da-4d9b-9a3b-dfd0ad6b3720 service nova] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:32.209263 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b625ffaa-b0da-4d9b-9a3b-dfd0ad6b3720 service nova] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:32.209616 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b625ffaa-b0da-4d9b-9a3b-dfd0ad6b3720 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:32.211319 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-b625ffaa-b0da-4d9b-9a3b-dfd0ad6b3720 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:33:32.294708 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:33:32.306347 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b625ffaa-b0da-4d9b-9a3b-dfd0ad6b3720 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:33:32.307903 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b625ffaa-b0da-4d9b-9a3b-dfd0ad6b3720 service nova] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:33:32.326147 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 691/1376] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:33:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:33:34.373487 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967f3def-1c22-46d7-af1c-afc4814e4920 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:34.373994 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967f3def-1c22-46d7-af1c-afc4814e4920 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:34.374092 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967f3def-1c22-46d7-af1c-afc4814e4920 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:34.375401 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 686/1377] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:33:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:33:34.382077 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e34c589-0c87-47bb-b2cb-3af0ce6af303 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:34.382077 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e34c589-0c87-47bb-b2cb-3af0ce6af303 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:34.382077 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e34c589-0c87-47bb-b2cb-3af0ce6af303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:34.479370 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-8e34c589-0c87-47bb-b2cb-3af0ce6af303 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:33:34.480801 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-8e34c589-0c87-47bb-b2cb-3af0ce6af303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:33:34.580080 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 692/1378] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:33:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:33:34.625551 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967f3def-1c22-46d7-af1c-afc4814e4920 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:33:34.627145 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-967f3def-1c22-46d7-af1c-afc4814e4920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:33:34.685700 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:33:34.791416 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967f3def-1c22-46d7-af1c-afc4814e4920 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:33:34.921978 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d957481b-67ef-4414-bde3-3f49657ad3b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87dd5c1c5e854d4b96e0b7dad6aa3719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:33:34.922514 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d957481b-67ef-4414-bde3-3f49657ad3b4 service nova] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:34.922798 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d957481b-67ef-4414-bde3-3f49657ad3b4 service nova] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:34.923077 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d957481b-67ef-4414-bde3-3f49657ad3b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:34.925284 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-d957481b-67ef-4414-bde3-3f49657ad3b4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:33:34.937725 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:33:35.015729 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d957481b-67ef-4414-bde3-3f49657ad3b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:33:35.017439 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d957481b-67ef-4414-bde3-3f49657ad3b4 service nova] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:33:35.036751 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 687/1379] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:33:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:33:37.087981 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d880222-3862-4924-bae8-6af58b302fb1 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:37.088543 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d880222-3862-4924-bae8-6af58b302fb1 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:37.088543 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d880222-3862-4924-bae8-6af58b302fb1 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:37.090058 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 693/1380] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:33:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:33:37.095226 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eba764-ba04-405e-bc26-ea01d0ff6dc5 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:37.095678 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eba764-ba04-405e-bc26-ea01d0ff6dc5 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:37.096360 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eba764-ba04-405e-bc26-ea01d0ff6dc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:37.167917 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-f1eba764-ba04-405e-bc26-ea01d0ff6dc5 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:33:37.169148 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-f1eba764-ba04-405e-bc26-ea01d0ff6dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:33:37.265457 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:33:37.280168 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 688/1381] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:33:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:33:37.324941 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d880222-3862-4924-bae8-6af58b302fb1 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:33:37.326639 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-2d880222-3862-4924-bae8-6af58b302fb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:33:37.399480 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:33:37.497204 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d880222-3862-4924-bae8-6af58b302fb1 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:33:37.617368 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7d92f4-760f-4cd6-a930-ffab1b1f830f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87dd5c1c5e854d4b96e0b7dad6aa3719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:33:37.617996 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7d92f4-760f-4cd6-a930-ffab1b1f830f service nova] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:37.618284 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7d92f4-760f-4cd6-a930-ffab1b1f830f service nova] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:37.618567 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7d92f4-760f-4cd6-a930-ffab1b1f830f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:37.620366 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-6a7d92f4-760f-4cd6-a930-ffab1b1f830f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:33:37.644604 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:33:37.721191 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7d92f4-760f-4cd6-a930-ffab1b1f830f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:33:37.722847 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7d92f4-760f-4cd6-a930-ffab1b1f830f service nova] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:33:37.743051 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 694/1382] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:33:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:33:39.816110 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af88ea5-d4f2-488b-8fad-93109785e41a None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:39.816826 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af88ea5-d4f2-488b-8fad-93109785e41a None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:39.816826 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af88ea5-d4f2-488b-8fad-93109785e41a None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:39.818060 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 689/1383] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:33:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:33:39.823841 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e213ad-a61e-4aa0-aaa6-36212ddafa1a None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:39.824279 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e213ad-a61e-4aa0-aaa6-36212ddafa1a None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:39.824587 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e213ad-a61e-4aa0-aaa6-36212ddafa1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:39.908909 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-f1e213ad-a61e-4aa0-aaa6-36212ddafa1a None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:33:39.910526 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-f1e213ad-a61e-4aa0-aaa6-36212ddafa1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:33:40.022645 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:33:40.027101 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 695/1384] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:33:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:33:40.070787 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af88ea5-d4f2-488b-8fad-93109785e41a None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:33:40.072271 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-8af88ea5-d4f2-488b-8fad-93109785e41a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:33:40.232567 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af88ea5-d4f2-488b-8fad-93109785e41a None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:33:40.310583 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:33:40.373391 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be7dbf8-20fd-4c15-80f6-28041d13b5a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87dd5c1c5e854d4b96e0b7dad6aa3719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:33:40.374106 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be7dbf8-20fd-4c15-80f6-28041d13b5a1 service nova] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:40.374439 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be7dbf8-20fd-4c15-80f6-28041d13b5a1 service nova] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:40.374747 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be7dbf8-20fd-4c15-80f6-28041d13b5a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:40.376883 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-4be7dbf8-20fd-4c15-80f6-28041d13b5a1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:33:40.475227 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be7dbf8-20fd-4c15-80f6-28041d13b5a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:33:40.477149 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be7dbf8-20fd-4c15-80f6-28041d13b5a1 service nova] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:33:40.497922 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 690/1385] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:33:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:33:42.540931 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be4f5d6-04c1-4b92-94e0-083aa5360824 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:42.541528 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be4f5d6-04c1-4b92-94e0-083aa5360824 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:42.541528 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be4f5d6-04c1-4b92-94e0-083aa5360824 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:42.542940 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 696/1386] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:33:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 21:33:42.550004 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378a6bdf-a1bb-4459-adaf-19556eecd2a6 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:42.550004 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378a6bdf-a1bb-4459-adaf-19556eecd2a6 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:42.550586 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378a6bdf-a1bb-4459-adaf-19556eecd2a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:42.632042 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-378a6bdf-a1bb-4459-adaf-19556eecd2a6 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:33:42.633580 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-378a6bdf-a1bb-4459-adaf-19556eecd2a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:33:42.665630 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:33:42.746049 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 691/1387] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:33:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:33:42.790858 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be4f5d6-04c1-4b92-94e0-083aa5360824 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:33:42.792538 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-1be4f5d6-04c1-4b92-94e0-083aa5360824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:33:42.955249 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be4f5d6-04c1-4b92-94e0-083aa5360824 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:33:43.035696 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:33:43.099144 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4abe62-18d1-415a-8aa8-fa979dbe61af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87dd5c1c5e854d4b96e0b7dad6aa3719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:33:43.099871 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4abe62-18d1-415a-8aa8-fa979dbe61af service nova] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:43.100261 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4abe62-18d1-415a-8aa8-fa979dbe61af service nova] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:43.100732 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4abe62-18d1-415a-8aa8-fa979dbe61af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:43.103515 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-8c4abe62-18d1-415a-8aa8-fa979dbe61af service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:33:43.199116 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4abe62-18d1-415a-8aa8-fa979dbe61af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:33:43.200814 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4abe62-18d1-415a-8aa8-fa979dbe61af service nova] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:33:43.220841 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 697/1388] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:33:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:33:45.283632 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79e3fc2-65a9-4bba-939b-82eddf423460 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:45.284166 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79e3fc2-65a9-4bba-939b-82eddf423460 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:45.284166 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79e3fc2-65a9-4bba-939b-82eddf423460 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:45.288952 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 692/1389] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:33:45 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:33:45.294968 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edda946-fa1d-44e1-b3e5-82c084995425 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:45.295413 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edda946-fa1d-44e1-b3e5-82c084995425 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:45.295530 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edda946-fa1d-44e1-b3e5-82c084995425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:45.366333 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-5edda946-fa1d-44e1-b3e5-82c084995425 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:33:45.367543 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-5edda946-fa1d-44e1-b3e5-82c084995425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:33:45.402336 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:33:45.466785 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 698/1390] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:33:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:33:45.511221 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79e3fc2-65a9-4bba-939b-82eddf423460 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:33:45.512792 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-d79e3fc2-65a9-4bba-939b-82eddf423460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:33:45.661199 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79e3fc2-65a9-4bba-939b-82eddf423460 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:33:45.670339 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:33:45.773963 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487e3580-4612-425b-9236-b450a5faf5d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87dd5c1c5e854d4b96e0b7dad6aa3719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:33:45.774585 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e3580-4612-425b-9236-b450a5faf5d3 service nova] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:45.774886 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e3580-4612-425b-9236-b450a5faf5d3 service nova] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:45.775150 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e3580-4612-425b-9236-b450a5faf5d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:45.776814 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-487e3580-4612-425b-9236-b450a5faf5d3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:33:45.864720 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487e3580-4612-425b-9236-b450a5faf5d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:33:45.866336 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487e3580-4612-425b-9236-b450a5faf5d3 service nova] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:33:45.885195 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 693/1391] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:33:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:33:46.934145 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8d6e07-b2b4-4c9a-a912-7296fc325b23 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:46.934801 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8d6e07-b2b4-4c9a-a912-7296fc325b23 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:46.934801 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8d6e07-b2b4-4c9a-a912-7296fc325b23 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:46.936429 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 699/1392] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:33:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:33:46.941981 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c43b89-bddf-48de-90d4-92f14b13922f None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:46.942439 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c43b89-bddf-48de-90d4-92f14b13922f None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:46.942543 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c43b89-bddf-48de-90d4-92f14b13922f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:46.958553 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:33:47.010528 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-53c43b89-bddf-48de-90d4-92f14b13922f None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:33:47.011743 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-53c43b89-bddf-48de-90d4-92f14b13922f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:33:47.113177 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 694/1393] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:33:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:33:47.169912 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96a70e8-2311-421f-8404-760368fde54c None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:47.170201 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96a70e8-2311-421f-8404-760368fde54c None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:47.170480 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96a70e8-2311-421f-8404-760368fde54c None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:47.171816 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 700/1394] 10.222.0.70 () {54 vars in 966 bytes} [Tue Aug 2 21:33:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:33:47.176848 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12773fe9-6a11-4dd5-af57-bb7eda654e69 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:47.177146 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12773fe9-6a11-4dd5-af57-bb7eda654e69 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:47.177453 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12773fe9-6a11-4dd5-af57-bb7eda654e69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:47.261917 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-12773fe9-6a11-4dd5-af57-bb7eda654e69 None None] MFA Rules not processed for user `accb7ab8b4f447389ed394a48fc27619`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:33:47.263163 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-12773fe9-6a11-4dd5-af57-bb7eda654e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:33:47.300132 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:33:47.347240 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 695/1395] 10.222.0.70 () {58 vars in 1063 bytes} [Tue Aug 2 21:33:47 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:33:47.354706 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96a70e8-2311-421f-8404-760368fde54c None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:33:47.356291 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-b96a70e8-2311-421f-8404-760368fde54c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:33:47.461950 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96a70e8-2311-421f-8404-760368fde54c None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:33:47.525454 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:33:47.538006 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb085ff-a16c-4a7c-aa47-03e40e518feb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'accb7ab8b4f447389ed394a48fc27619', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:33:47.538632 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb085ff-a16c-4a7c-aa47-03e40e518feb service glance] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:47.538916 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb085ff-a16c-4a7c-aa47-03e40e518feb service glance] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:47.539196 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb085ff-a16c-4a7c-aa47-03e40e518feb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:47.540838 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-5cb085ff-a16c-4a7c-aa47-03e40e518feb service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:33:47.650998 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb085ff-a16c-4a7c-aa47-03e40e518feb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:33:47.652484 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb085ff-a16c-4a7c-aa47-03e40e518feb service glance] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:33:47.670700 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 701/1396] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:33:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:33:47.939651 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3723f82e-1882-4d13-90ec-1dd5159bc602 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:47.939945 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3723f82e-1882-4d13-90ec-1dd5159bc602 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:47.940284 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3723f82e-1882-4d13-90ec-1dd5159bc602 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:47.941773 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 696/1397] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:33:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:33:47.947840 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83592a2-31bb-433e-a334-ffa082ef14dc None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:47.948409 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83592a2-31bb-433e-a334-ffa082ef14dc None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:47.948521 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83592a2-31bb-433e-a334-ffa082ef14dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:48.020358 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-d83592a2-31bb-433e-a334-ffa082ef14dc None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:33:48.021587 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-d83592a2-31bb-433e-a334-ffa082ef14dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:33:48.074969 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:33:48.140319 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 702/1398] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:33:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:33:48.184995 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3723f82e-1882-4d13-90ec-1dd5159bc602 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:33:48.186512 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-3723f82e-1882-4d13-90ec-1dd5159bc602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:33:48.349780 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3723f82e-1882-4d13-90ec-1dd5159bc602 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:33:48.391426 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:33:48.412991 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd1c8ab-e692-4314-9fcb-515bbdf16bbe None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:48.413282 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd1c8ab-e692-4314-9fcb-515bbdf16bbe None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:48.413560 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd1c8ab-e692-4314-9fcb-515bbdf16bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:48.465793 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28bdff6-4001-4974-a75d-4548a95f8ee7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87dd5c1c5e854d4b96e0b7dad6aa3719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:33:48.466409 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28bdff6-4001-4974-a75d-4548a95f8ee7 service nova] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:48.466689 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28bdff6-4001-4974-a75d-4548a95f8ee7 service nova] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:48.466966 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28bdff6-4001-4974-a75d-4548a95f8ee7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:48.468684 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-c28bdff6-4001-4974-a75d-4548a95f8ee7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:33:48.481111 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-5dd1c8ab-e692-4314-9fcb-515bbdf16bbe None None] MFA Rules not processed for user `6be7b2bcfebd45389ca289c34fbabc3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:33:48.482307 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-5dd1c8ab-e692-4314-9fcb-515bbdf16bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:33:48.560268 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28bdff6-4001-4974-a75d-4548a95f8ee7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:33:48.561933 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28bdff6-4001-4974-a75d-4548a95f8ee7 service nova] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:33:48.570621 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 703/1399] 10.222.0.70 () {58 vars in 1009 bytes} [Tue Aug 2 21:33:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:33:48.581847 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 697/1400] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:33:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:33:48.617296 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b997eebb-e27d-4521-a2c7-4c280c857de2 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:48.617590 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b997eebb-e27d-4521-a2c7-4c280c857de2 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:48.617863 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b997eebb-e27d-4521-a2c7-4c280c857de2 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:48.619206 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 704/1401] 10.222.0.70 () {54 vars in 943 bytes} [Tue Aug 2 21:33:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:33:48.625455 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c6fb9c-c5b8-4a95-b48b-10775c4b427c None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:48.625746 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c6fb9c-c5b8-4a95-b48b-10775c4b427c None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:48.626064 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c6fb9c-c5b8-4a95-b48b-10775c4b427c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:48.689943 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:33:48.715619 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-31c6fb9c-c5b8-4a95-b48b-10775c4b427c None None] MFA Rules not processed for user `2ee7ebf40212465aac997b461a2d10fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:33:48.717942 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-31c6fb9c-c5b8-4a95-b48b-10775c4b427c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:33:48.837959 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 698/1402] 10.222.0.70 () {58 vars in 1040 bytes} [Tue Aug 2 21:33:48 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:33:48.847276 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b997eebb-e27d-4521-a2c7-4c280c857de2 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:33:48.848814 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-b997eebb-e27d-4521-a2c7-4c280c857de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:33:48.889633 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:33:48.988644 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b997eebb-e27d-4521-a2c7-4c280c857de2 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:33:49.092854 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d558d666-624c-42cd-8610-cc9183ff693d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee7ebf40212465aac997b461a2d10fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:33:49.093477 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d558d666-624c-42cd-8610-cc9183ff693d service swift] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:49.093759 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d558d666-624c-42cd-8610-cc9183ff693d service swift] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:49.094036 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d558d666-624c-42cd-8610-cc9183ff693d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:49.095708 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-d558d666-624c-42cd-8610-cc9183ff693d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:33:49.117425 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:33:49.180899 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d558d666-624c-42cd-8610-cc9183ff693d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:33:49.182420 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d558d666-624c-42cd-8610-cc9183ff693d service swift] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:33:49.190845 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 705/1403] 10.222.0.70 () {60 vars in 1384 bytes} [Tue Aug 2 21:33:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 02 21:33:50.643760 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2358ab74-2dcf-4042-93b8-d2b98b864058 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:50.644344 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2358ab74-2dcf-4042-93b8-d2b98b864058 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:50.644344 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2358ab74-2dcf-4042-93b8-d2b98b864058 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:50.645593 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 699/1404] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:33:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:33:50.652071 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b42a264-2967-4597-be75-f638dee68bc3 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:50.652610 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b42a264-2967-4597-be75-f638dee68bc3 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:50.652709 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b42a264-2967-4597-be75-f638dee68bc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:50.727582 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-2b42a264-2967-4597-be75-f638dee68bc3 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:33:50.728851 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-2b42a264-2967-4597-be75-f638dee68bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:33:50.837508 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 706/1405] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:33:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:33:50.882106 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2358ab74-2dcf-4042-93b8-d2b98b864058 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:33:50.883910 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-2358ab74-2dcf-4042-93b8-d2b98b864058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:33:50.996602 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:33:51.052202 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2358ab74-2dcf-4042-93b8-d2b98b864058 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:33:51.180857 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d8278a-dc7a-4f97-9d75-c8c5b063f507 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87dd5c1c5e854d4b96e0b7dad6aa3719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:33:51.181487 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d8278a-dc7a-4f97-9d75-c8c5b063f507 service nova] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:51.181883 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d8278a-dc7a-4f97-9d75-c8c5b063f507 service nova] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:51.182170 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d8278a-dc7a-4f97-9d75-c8c5b063f507 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:51.183819 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-d0d8278a-dc7a-4f97-9d75-c8c5b063f507 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:33:51.261258 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:33:51.293217 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d8278a-dc7a-4f97-9d75-c8c5b063f507 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:33:51.294921 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d8278a-dc7a-4f97-9d75-c8c5b063f507 service nova] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:33:51.316516 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 700/1406] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:33:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 21:33:53.442646 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135a5a96-1354-483d-b405-b882c41503b3 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:53.443173 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135a5a96-1354-483d-b405-b882c41503b3 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:53.443173 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135a5a96-1354-483d-b405-b882c41503b3 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:53.447533 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 707/1407] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:33:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:33:53.449840 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e314b71d-0866-4219-bba2-231ef6a63041 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:53.450263 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e314b71d-0866-4219-bba2-231ef6a63041 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:53.450454 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e314b71d-0866-4219-bba2-231ef6a63041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:53.525135 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-e314b71d-0866-4219-bba2-231ef6a63041 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:33:53.526355 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-e314b71d-0866-4219-bba2-231ef6a63041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:33:53.636924 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 701/1408] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:33:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:33:53.681702 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135a5a96-1354-483d-b405-b882c41503b3 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:33:53.683216 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-135a5a96-1354-483d-b405-b882c41503b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:33:53.697972 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:33:53.843163 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135a5a96-1354-483d-b405-b882c41503b3 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:33:53.943755 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:33:53.975421 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3b0c75-d6ae-449b-bd9b-2c4f3ed698bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87dd5c1c5e854d4b96e0b7dad6aa3719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:33:53.976170 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3b0c75-d6ae-449b-bd9b-2c4f3ed698bd service nova] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:33:53.976490 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3b0c75-d6ae-449b-bd9b-2c4f3ed698bd service nova] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:33:53.976775 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3b0c75-d6ae-449b-bd9b-2c4f3ed698bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:33:53.978488 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-7e3b0c75-d6ae-449b-bd9b-2c4f3ed698bd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:33:54.083269 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3b0c75-d6ae-449b-bd9b-2c4f3ed698bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:33:54.084950 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3b0c75-d6ae-449b-bd9b-2c4f3ed698bd service nova] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:33:54.103613 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 708/1409] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:33:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:34:03.635224 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=81 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:34:04.101086 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=56 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:34:11.631412 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa9abb4-e09f-42f8-8b26-74dd21ac2328 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:34:11.631936 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa9abb4-e09f-42f8-8b26-74dd21ac2328 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:34:11.631936 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa9abb4-e09f-42f8-8b26-74dd21ac2328 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:34:11.633267 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 702/1410] 10.222.0.70 () {54 vars in 918 bytes} [Tue Aug 2 21:34:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:34:11.638291 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee88ec22-8004-4954-bbc7-f1a1ebd56eb8 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:34:11.638685 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee88ec22-8004-4954-bbc7-f1a1ebd56eb8 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:34:11.638885 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee88ec22-8004-4954-bbc7-f1a1ebd56eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:34:11.715443 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-ee88ec22-8004-4954-bbc7-f1a1ebd56eb8 None None] MFA Rules not processed for user `83fcd951771e42959506b70b0137003f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:34:11.716739 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-ee88ec22-8004-4954-bbc7-f1a1ebd56eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:34:11.822837 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 709/1411] 10.222.0.70 () {58 vars in 1015 bytes} [Tue Aug 2 21:34:11 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:34:11.836949 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7009d6e-0906-4859-8514-b8cb498582cc None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:34:11.837239 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7009d6e-0906-4859-8514-b8cb498582cc None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:34:11.837519 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7009d6e-0906-4859-8514-b8cb498582cc None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:34:11.838865 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 703/1412] 10.222.0.70 () {54 vars in 918 bytes} [Tue Aug 2 21:34:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:34:11.843616 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ee40b8-8e07-4a38-83de-db720bd17596 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:34:11.843905 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ee40b8-8e07-4a38-83de-db720bd17596 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:34:11.844185 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ee40b8-8e07-4a38-83de-db720bd17596 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:34:11.916742 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:34:11.919678 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-45ee40b8-8e07-4a38-83de-db720bd17596 None None] MFA Rules not processed for user `87dd5c1c5e854d4b96e0b7dad6aa3719`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:34:11.922057 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-45ee40b8-8e07-4a38-83de-db720bd17596 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:34:12.037262 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 710/1413] 10.222.0.70 () {58 vars in 1015 bytes} [Tue Aug 2 21:34:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:34:14.503713 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe2089b-eb32-4678-b9a6-48843ee7298f None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:34:14.504293 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe2089b-eb32-4678-b9a6-48843ee7298f None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:34:14.504393 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe2089b-eb32-4678-b9a6-48843ee7298f None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:34:14.505693 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 704/1414] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 2 21:34:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:34:14.510823 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fa79f7-0648-49fe-9ccf-705e39f95189 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:34:14.511395 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fa79f7-0648-49fe-9ccf-705e39f95189 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:34:14.511682 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fa79f7-0648-49fe-9ccf-705e39f95189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:34:14.582073 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-b8fa79f7-0648-49fe-9ccf-705e39f95189 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:34:14.583294 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-b8fa79f7-0648-49fe-9ccf-705e39f95189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:34:14.639246 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:34:14.802205 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 711/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 2 21:34:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:34:14.847786 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe2089b-eb32-4678-b9a6-48843ee7298f None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:34:14.849340 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-4fe2089b-eb32-4678-b9a6-48843ee7298f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:34:14.993097 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe2089b-eb32-4678-b9a6-48843ee7298f None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:34:15.064731 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:34:15.104809 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956fa60b-989e-4026-9276-bcd1b863ce11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87dd5c1c5e854d4b96e0b7dad6aa3719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:34:15.105426 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956fa60b-989e-4026-9276-bcd1b863ce11 service nova] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:34:15.105709 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956fa60b-989e-4026-9276-bcd1b863ce11 service nova] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:34:15.105983 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956fa60b-989e-4026-9276-bcd1b863ce11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:34:15.107599 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-956fa60b-989e-4026-9276-bcd1b863ce11 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:34:15.196213 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956fa60b-989e-4026-9276-bcd1b863ce11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:34:15.197875 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956fa60b-989e-4026-9276-bcd1b863ce11 service nova] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:34:15.216575 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 705/1416] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:34:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:34:16.106481 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f44eb7f-c57d-48cd-8ccd-07f67b00b8c8 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:34:16.107044 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f44eb7f-c57d-48cd-8ccd-07f67b00b8c8 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:34:16.107044 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f44eb7f-c57d-48cd-8ccd-07f67b00b8c8 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:34:16.108958 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 712/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 2 21:34:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:34:16.114074 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3669a108-84f8-4ae2-92d4-20c4f6a53ae1 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:34:16.114500 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3669a108-84f8-4ae2-92d4-20c4f6a53ae1 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:34:16.114616 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3669a108-84f8-4ae2-92d4-20c4f6a53ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:34:16.190128 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-3669a108-84f8-4ae2-92d4-20c4f6a53ae1 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:34:16.191335 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-3669a108-84f8-4ae2-92d4-20c4f6a53ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:34:16.219433 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:34:16.290327 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 706/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 2 21:34:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:34:16.450641 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f44eb7f-c57d-48cd-8ccd-07f67b00b8c8 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:34:16.452720 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-9f44eb7f-c57d-48cd-8ccd-07f67b00b8c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:34:16.596046 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f44eb7f-c57d-48cd-8ccd-07f67b00b8c8 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:34:16.635687 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:34:16.708021 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253967f2-0c71-43f4-8a92-0a02713dfd31 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87dd5c1c5e854d4b96e0b7dad6aa3719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:34:16.708675 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253967f2-0c71-43f4-8a92-0a02713dfd31 service nova] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:34:16.708953 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253967f2-0c71-43f4-8a92-0a02713dfd31 service nova] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:34:16.709226 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253967f2-0c71-43f4-8a92-0a02713dfd31 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:34:16.710826 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-253967f2-0c71-43f4-8a92-0a02713dfd31 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:34:16.799574 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253967f2-0c71-43f4-8a92-0a02713dfd31 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:34:16.801199 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253967f2-0c71-43f4-8a92-0a02713dfd31 service nova] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:34:16.819639 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 713/1419] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:34:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:34:17.713595 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f8b306-2775-49a9-997b-84a99d138882 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:34:17.714214 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f8b306-2775-49a9-997b-84a99d138882 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:34:17.714214 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f8b306-2775-49a9-997b-84a99d138882 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:34:17.715552 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 707/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 2 21:34:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:34:17.721122 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91404c35-8b54-4e48-a6fa-53f1a283e66b None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:34:17.721552 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91404c35-8b54-4e48-a6fa-53f1a283e66b None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:34:17.721679 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91404c35-8b54-4e48-a6fa-53f1a283e66b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:34:17.776136 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:34:17.799493 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-91404c35-8b54-4e48-a6fa-53f1a283e66b None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:34:17.800738 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-91404c35-8b54-4e48-a6fa-53f1a283e66b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:34:17.896295 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 714/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 2 21:34:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:34:18.063024 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f8b306-2775-49a9-997b-84a99d138882 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:34:18.064583 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-05f8b306-2775-49a9-997b-84a99d138882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:34:18.213296 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f8b306-2775-49a9-997b-84a99d138882 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:34:18.225577 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:34:18.333964 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51efd88-70c8-4baf-95dc-896e966ba4b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87dd5c1c5e854d4b96e0b7dad6aa3719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:34:18.334502 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51efd88-70c8-4baf-95dc-896e966ba4b4 service nova] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:34:18.334788 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51efd88-70c8-4baf-95dc-896e966ba4b4 service nova] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:34:18.335067 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51efd88-70c8-4baf-95dc-896e966ba4b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:34:18.336726 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-e51efd88-70c8-4baf-95dc-896e966ba4b4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:34:18.429573 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51efd88-70c8-4baf-95dc-896e966ba4b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:34:18.431251 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51efd88-70c8-4baf-95dc-896e966ba4b4 service nova] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:34:18.449897 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 708/1422] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:34:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:34:19.336205 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747f23ce-29ff-45c2-943f-8dc5e69eacb9 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:34:19.336736 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747f23ce-29ff-45c2-943f-8dc5e69eacb9 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:34:19.336856 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747f23ce-29ff-45c2-943f-8dc5e69eacb9 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:34:19.338108 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 715/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 2 21:34:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:34:19.343669 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78edca2e-29ba-4761-bd65-cc198fb786f3 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:34:19.344097 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78edca2e-29ba-4761-bd65-cc198fb786f3 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:34:19.344253 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78edca2e-29ba-4761-bd65-cc198fb786f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:34:19.364128 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:34:19.420777 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-78edca2e-29ba-4761-bd65-cc198fb786f3 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:34:19.422013 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-78edca2e-29ba-4761-bd65-cc198fb786f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:34:19.517711 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 709/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 2 21:34:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:34:19.670363 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747f23ce-29ff-45c2-943f-8dc5e69eacb9 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:34:19.671821 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-747f23ce-29ff-45c2-943f-8dc5e69eacb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:34:19.780695 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:34:19.818804 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747f23ce-29ff-45c2-943f-8dc5e69eacb9 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:34:19.929570 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baff1001-4ed1-4f85-ac19-7b61263af092 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87dd5c1c5e854d4b96e0b7dad6aa3719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:34:19.930115 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baff1001-4ed1-4f85-ac19-7b61263af092 service nova] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:34:19.930398 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baff1001-4ed1-4f85-ac19-7b61263af092 service nova] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:34:19.930673 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baff1001-4ed1-4f85-ac19-7b61263af092 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:34:19.932321 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-baff1001-4ed1-4f85-ac19-7b61263af092 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:34:20.009128 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:34:20.022901 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baff1001-4ed1-4f85-ac19-7b61263af092 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:34:20.024537 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baff1001-4ed1-4f85-ac19-7b61263af092 service nova] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:34:20.042273 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 716/1425] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:34:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:34:20.904412 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e924680-92ca-48c8-b4ff-f96f576358d8 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:34:20.905634 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e924680-92ca-48c8-b4ff-f96f576358d8 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:34:20.905634 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e924680-92ca-48c8-b4ff-f96f576358d8 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:34:20.906969 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 710/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 2 21:34:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:34:20.911960 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0df23f9-38b4-4632-aab9-d54cb9fa7f6e None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:34:20.912389 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0df23f9-38b4-4632-aab9-d54cb9fa7f6e None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:34:20.912553 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0df23f9-38b4-4632-aab9-d54cb9fa7f6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:34:20.988554 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-a0df23f9-38b4-4632-aab9-d54cb9fa7f6e None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:34:20.989747 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-a0df23f9-38b4-4632-aab9-d54cb9fa7f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:34:21.085334 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 717/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 2 21:34:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:34:21.233766 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e924680-92ca-48c8-b4ff-f96f576358d8 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:34:21.235348 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-2e924680-92ca-48c8-b4ff-f96f576358d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:34:21.319673 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:34:21.381612 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e924680-92ca-48c8-b4ff-f96f576358d8 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:34:21.493894 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54312682-17b6-4b83-ba2f-b476cdc7ad4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87dd5c1c5e854d4b96e0b7dad6aa3719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:34:21.494438 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54312682-17b6-4b83-ba2f-b476cdc7ad4d service nova] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:34:21.494720 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54312682-17b6-4b83-ba2f-b476cdc7ad4d service nova] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:34:21.494998 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54312682-17b6-4b83-ba2f-b476cdc7ad4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:34:21.496659 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-54312682-17b6-4b83-ba2f-b476cdc7ad4d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:34:21.543705 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:34:21.585964 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54312682-17b6-4b83-ba2f-b476cdc7ad4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:34:21.587575 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54312682-17b6-4b83-ba2f-b476cdc7ad4d service nova] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:34:21.606132 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 711/1428] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:34:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:34:22.403422 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b802b72a-8481-4134-9a3f-afa486a29319 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:34:22.403866 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b802b72a-8481-4134-9a3f-afa486a29319 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:34:22.403974 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b802b72a-8481-4134-9a3f-afa486a29319 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:34:22.405422 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 718/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 2 21:34:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:34:22.410293 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0da8e6-7725-44a0-bba1-05b258dacf85 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:34:22.410687 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0da8e6-7725-44a0-bba1-05b258dacf85 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:34:22.410845 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0da8e6-7725-44a0-bba1-05b258dacf85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:34:22.485469 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-5f0da8e6-7725-44a0-bba1-05b258dacf85 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:34:22.486912 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-5f0da8e6-7725-44a0-bba1-05b258dacf85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:34:22.581955 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 712/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 2 21:34:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:34:22.733552 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b802b72a-8481-4134-9a3f-afa486a29319 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:34:22.735042 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-b802b72a-8481-4134-9a3f-afa486a29319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:34:22.782507 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:34:22.877409 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b802b72a-8481-4134-9a3f-afa486a29319 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:34:22.996125 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bc74d1-7899-4631-9ba2-ebe2bc03bbad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87dd5c1c5e854d4b96e0b7dad6aa3719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:34:22.996800 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bc74d1-7899-4631-9ba2-ebe2bc03bbad service nova] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:34:22.997085 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bc74d1-7899-4631-9ba2-ebe2bc03bbad service nova] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:34:22.997361 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bc74d1-7899-4631-9ba2-ebe2bc03bbad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:34:22.999030 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-74bc74d1-7899-4631-9ba2-ebe2bc03bbad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:34:23.006063 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:34:23.090405 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bc74d1-7899-4631-9ba2-ebe2bc03bbad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:34:23.092660 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bc74d1-7899-4631-9ba2-ebe2bc03bbad service nova] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:34:23.110351 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 719/1431] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:34:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:34:23.932470 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b6389-8fbe-402c-93d6-97118a85e6e8 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:34:23.933032 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b6389-8fbe-402c-93d6-97118a85e6e8 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:34:23.933032 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b6389-8fbe-402c-93d6-97118a85e6e8 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:34:23.934400 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 713/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 2 21:34:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:34:23.940623 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711f7918-00bb-467d-b10e-34e6cbcdd182 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:34:23.941081 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711f7918-00bb-467d-b10e-34e6cbcdd182 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:34:23.941188 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711f7918-00bb-467d-b10e-34e6cbcdd182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:34:24.016901 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-711f7918-00bb-467d-b10e-34e6cbcdd182 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:34:24.018117 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-711f7918-00bb-467d-b10e-34e6cbcdd182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:34:24.085117 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:34:24.114887 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 720/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 2 21:34:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:34:24.265281 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83b6389-8fbe-402c-93d6-97118a85e6e8 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:34:24.266796 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-a83b6389-8fbe-402c-93d6-97118a85e6e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:34:24.284710 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:34:24.415381 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83b6389-8fbe-402c-93d6-97118a85e6e8 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:34:24.505549 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:34:24.533230 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62727f4-2ffd-4e62-aa4a-4a4515cdc16e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87dd5c1c5e854d4b96e0b7dad6aa3719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:34:24.533794 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62727f4-2ffd-4e62-aa4a-4a4515cdc16e service nova] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:34:24.534077 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62727f4-2ffd-4e62-aa4a-4a4515cdc16e service nova] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:34:24.534353 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62727f4-2ffd-4e62-aa4a-4a4515cdc16e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:34:24.535977 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-d62727f4-2ffd-4e62-aa4a-4a4515cdc16e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:34:24.623862 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62727f4-2ffd-4e62-aa4a-4a4515cdc16e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:34:24.625496 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62727f4-2ffd-4e62-aa4a-4a4515cdc16e service nova] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:34:24.643759 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 714/1434] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:34:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:34:25.447455 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ecd0de-d5da-4ccf-9fc4-15be271979f3 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:34:25.448036 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ecd0de-d5da-4ccf-9fc4-15be271979f3 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:34:25.448036 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ecd0de-d5da-4ccf-9fc4-15be271979f3 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:34:25.449441 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 721/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 2 21:34:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:34:25.454265 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111d7d60-95c6-40e9-a586-01f3559bc1aa None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:34:25.454687 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111d7d60-95c6-40e9-a586-01f3559bc1aa None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:34:25.454817 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111d7d60-95c6-40e9-a586-01f3559bc1aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:34:25.530634 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-111d7d60-95c6-40e9-a586-01f3559bc1aa None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:34:25.531829 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-111d7d60-95c6-40e9-a586-01f3559bc1aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:34:25.573057 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:34:25.630150 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 715/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 2 21:34:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:34:25.788891 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ecd0de-d5da-4ccf-9fc4-15be271979f3 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:34:25.791110 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-74ecd0de-d5da-4ccf-9fc4-15be271979f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:34:25.938063 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ecd0de-d5da-4ccf-9fc4-15be271979f3 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:34:25.991686 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:34:26.049654 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31307de0-e745-48f6-bfcb-74527dd2e6ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87dd5c1c5e854d4b96e0b7dad6aa3719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:34:26.050268 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31307de0-e745-48f6-bfcb-74527dd2e6ee service nova] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:34:26.050544 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31307de0-e745-48f6-bfcb-74527dd2e6ee service nova] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:34:26.050814 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31307de0-e745-48f6-bfcb-74527dd2e6ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:34:26.052434 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-31307de0-e745-48f6-bfcb-74527dd2e6ee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:34:26.142365 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31307de0-e745-48f6-bfcb-74527dd2e6ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:34:26.143978 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31307de0-e745-48f6-bfcb-74527dd2e6ee service nova] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:34:26.162525 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 722/1437] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:34:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:34:26.961708 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5775f5e-68a5-4c78-81eb-a4c262ff3c12 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:34:26.962246 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5775f5e-68a5-4c78-81eb-a4c262ff3c12 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:34:26.962246 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5775f5e-68a5-4c78-81eb-a4c262ff3c12 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:34:26.963662 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 716/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 2 21:34:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:34:26.968752 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b4d56-09cb-4165-ab68-5bc335556d84 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:34:26.969165 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b4d56-09cb-4165-ab68-5bc335556d84 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:34:26.969300 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b4d56-09cb-4165-ab68-5bc335556d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:34:27.046662 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-e84b4d56-09cb-4165-ab68-5bc335556d84 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:34:27.047851 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-e84b4d56-09cb-4165-ab68-5bc335556d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:34:27.049899 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:34:27.143679 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 723/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 2 21:34:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:34:27.294538 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5775f5e-68a5-4c78-81eb-a4c262ff3c12 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:34:27.296728 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-a5775f5e-68a5-4c78-81eb-a4c262ff3c12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:34:27.556601 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5775f5e-68a5-4c78-81eb-a4c262ff3c12 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:34:27.582749 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:34:27.668631 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3093e1-31dd-4c2e-ac1f-57ff18c791ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87dd5c1c5e854d4b96e0b7dad6aa3719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:34:27.669252 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3093e1-31dd-4c2e-ac1f-57ff18c791ce service nova] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:34:27.669536 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3093e1-31dd-4c2e-ac1f-57ff18c791ce service nova] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:34:27.669814 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3093e1-31dd-4c2e-ac1f-57ff18c791ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:34:27.671419 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-5a3093e1-31dd-4c2e-ac1f-57ff18c791ce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:34:27.758690 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3093e1-31dd-4c2e-ac1f-57ff18c791ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:34:27.760319 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3093e1-31dd-4c2e-ac1f-57ff18c791ce service nova] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:34:27.778289 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 717/1440] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:34:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 21:34:29.682362 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115faa9a-d832-41f5-b7f0-c23d2d92831d None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:34:29.682935 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115faa9a-d832-41f5-b7f0-c23d2d92831d None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:34:29.682935 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115faa9a-d832-41f5-b7f0-c23d2d92831d None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:34:29.684278 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 724/1441] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 2 21:34:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:34:29.690140 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359c473b-67c7-4ec3-b9f4-6408e8977740 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:34:29.690587 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359c473b-67c7-4ec3-b9f4-6408e8977740 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:34:29.690697 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359c473b-67c7-4ec3-b9f4-6408e8977740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:34:29.731592 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:34:29.756734 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-359c473b-67c7-4ec3-b9f4-6408e8977740 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:34:29.757927 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-359c473b-67c7-4ec3-b9f4-6408e8977740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:34:29.857857 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 718/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 2 21:34:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:34:29.897160 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115faa9a-d832-41f5-b7f0-c23d2d92831d None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:34:29.898692 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-115faa9a-d832-41f5-b7f0-c23d2d92831d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:34:30.006665 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115faa9a-d832-41f5-b7f0-c23d2d92831d None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:34:30.039091 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:34:30.088306 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d07eacb-0a55-4909-8bc2-ab35ac9888da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '723f5f43572a493dae0349070a2adb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:34:30.089006 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d07eacb-0a55-4909-8bc2-ab35ac9888da service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:34:30.089335 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d07eacb-0a55-4909-8bc2-ab35ac9888da service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:34:30.089653 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d07eacb-0a55-4909-8bc2-ab35ac9888da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:34:30.091333 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-8d07eacb-0a55-4909-8bc2-ab35ac9888da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:34:30.199374 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d07eacb-0a55-4909-8bc2-ab35ac9888da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:34:30.201444 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d07eacb-0a55-4909-8bc2-ab35ac9888da service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:34:30.219453 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 725/1443] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:34:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:34:32.389393 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967cbc44-6912-42fc-928e-e5d0d01d6269 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:34:32.389844 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967cbc44-6912-42fc-928e-e5d0d01d6269 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:34:32.389948 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967cbc44-6912-42fc-928e-e5d0d01d6269 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:34:32.391303 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 719/1444] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 2 21:34:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:34:32.396718 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6901e199-c20c-41b8-80eb-a985015ff709 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:34:32.397117 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6901e199-c20c-41b8-80eb-a985015ff709 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:34:32.397282 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6901e199-c20c-41b8-80eb-a985015ff709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:34:32.464468 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-6901e199-c20c-41b8-80eb-a985015ff709 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:34:32.465689 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-6901e199-c20c-41b8-80eb-a985015ff709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:34:32.478370 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:34:32.564216 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 726/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 2 21:34:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:34:32.603229 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967cbc44-6912-42fc-928e-e5d0d01d6269 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:34:32.604818 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-967cbc44-6912-42fc-928e-e5d0d01d6269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:34:32.707637 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967cbc44-6912-42fc-928e-e5d0d01d6269 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:34:32.720177 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:34:32.786969 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc468dd-c54e-439d-b8f5-33288e316d8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '723f5f43572a493dae0349070a2adb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:34:32.787580 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc468dd-c54e-439d-b8f5-33288e316d8f service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:34:32.787862 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc468dd-c54e-439d-b8f5-33288e316d8f service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:34:32.788134 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc468dd-c54e-439d-b8f5-33288e316d8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:34:32.789776 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-1bc468dd-c54e-439d-b8f5-33288e316d8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:34:32.897037 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc468dd-c54e-439d-b8f5-33288e316d8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:34:32.898423 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc468dd-c54e-439d-b8f5-33288e316d8f service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:34:32.917903 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 720/1446] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:34:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:34:35.235429 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d644b1a-84ae-4206-97e1-42838f76bf98 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:34:35.236254 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d644b1a-84ae-4206-97e1-42838f76bf98 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:34:35.236382 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d644b1a-84ae-4206-97e1-42838f76bf98 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:34:35.237812 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 727/1447] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 2 21:34:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 21:34:35.243370 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52267690-27da-4a0c-a811-6ea3ad15dd66 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:34:35.243813 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52267690-27da-4a0c-a811-6ea3ad15dd66 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:34:35.243909 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52267690-27da-4a0c-a811-6ea3ad15dd66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:34:35.293282 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:34:35.311868 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-52267690-27da-4a0c-a811-6ea3ad15dd66 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:34:35.313119 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-52267690-27da-4a0c-a811-6ea3ad15dd66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:34:35.407991 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 721/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 2 21:34:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:34:35.446187 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d644b1a-84ae-4206-97e1-42838f76bf98 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:34:35.447730 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-3d644b1a-84ae-4206-97e1-42838f76bf98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:34:35.550573 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d644b1a-84ae-4206-97e1-42838f76bf98 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:34:35.590745 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:34:35.624871 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eccf2eb-5baa-4d65-843c-08204dd9e825 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '723f5f43572a493dae0349070a2adb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:34:35.625495 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eccf2eb-5baa-4d65-843c-08204dd9e825 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:34:35.625776 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eccf2eb-5baa-4d65-843c-08204dd9e825 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:34:35.626051 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eccf2eb-5baa-4d65-843c-08204dd9e825 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:34:35.627666 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-9eccf2eb-5baa-4d65-843c-08204dd9e825 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:34:35.736931 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eccf2eb-5baa-4d65-843c-08204dd9e825 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:34:35.738369 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eccf2eb-5baa-4d65-843c-08204dd9e825 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:34:35.757086 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 728/1449] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:34:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:34:37.885392 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece1e341-f682-404c-ba11-fb397b084eb2 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:34:37.886014 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece1e341-f682-404c-ba11-fb397b084eb2 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:34:37.886014 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece1e341-f682-404c-ba11-fb397b084eb2 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:34:37.887319 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 722/1450] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 2 21:34:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:34:37.893037 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c01bc4b-adae-4939-814a-c908fc361d95 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:34:37.893433 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c01bc4b-adae-4939-814a-c908fc361d95 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:34:37.893601 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c01bc4b-adae-4939-814a-c908fc361d95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:34:37.962942 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-0c01bc4b-adae-4939-814a-c908fc361d95 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:34:37.964256 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-0c01bc4b-adae-4939-814a-c908fc361d95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:34:37.985340 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:34:38.061893 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 729/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 2 21:34:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:34:38.100592 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece1e341-f682-404c-ba11-fb397b084eb2 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:34:38.102123 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-ece1e341-f682-404c-ba11-fb397b084eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:34:38.204280 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece1e341-f682-404c-ba11-fb397b084eb2 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:34:38.223397 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:34:38.276721 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7904816-3483-44b1-85d3-18e276d46cd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '723f5f43572a493dae0349070a2adb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:34:38.277336 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7904816-3483-44b1-85d3-18e276d46cd9 service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:34:38.277620 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7904816-3483-44b1-85d3-18e276d46cd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:34:38.277893 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7904816-3483-44b1-85d3-18e276d46cd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:34:38.279527 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-d7904816-3483-44b1-85d3-18e276d46cd9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:34:38.394370 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7904816-3483-44b1-85d3-18e276d46cd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:34:38.395829 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7904816-3483-44b1-85d3-18e276d46cd9 service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:34:38.414607 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 723/1452] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:34:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:34:40.547716 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e083fd4c-2554-4ea6-98e8-537407261b1d None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:34:40.548303 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e083fd4c-2554-4ea6-98e8-537407261b1d None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:34:40.548303 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e083fd4c-2554-4ea6-98e8-537407261b1d None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:34:40.549573 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 730/1453] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 2 21:34:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 02 21:34:40.554749 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa94eb-16e8-4aa7-8054-771cc3ff736a None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:34:40.555120 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa94eb-16e8-4aa7-8054-771cc3ff736a None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:34:40.555313 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa94eb-16e8-4aa7-8054-771cc3ff736a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:34:40.619152 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:34:40.621939 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-35aa94eb-16e8-4aa7-8054-771cc3ff736a None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:34:40.623682 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-35aa94eb-16e8-4aa7-8054-771cc3ff736a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:34:40.718299 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 724/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 2 21:34:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:34:40.756447 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e083fd4c-2554-4ea6-98e8-537407261b1d None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:34:40.758000 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-e083fd4c-2554-4ea6-98e8-537407261b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:34:40.861513 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e083fd4c-2554-4ea6-98e8-537407261b1d None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:34:40.909240 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:34:40.933803 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81b3e9c-dbae-44bf-908d-84143741a1d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '723f5f43572a493dae0349070a2adb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:34:40.934437 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b3e9c-dbae-44bf-908d-84143741a1d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:34:40.934711 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b3e9c-dbae-44bf-908d-84143741a1d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:34:40.934981 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81b3e9c-dbae-44bf-908d-84143741a1d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:34:40.936597 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-c81b3e9c-dbae-44bf-908d-84143741a1d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:34:41.045422 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81b3e9c-dbae-44bf-908d-84143741a1d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:34:41.046879 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81b3e9c-dbae-44bf-908d-84143741a1d7 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:34:41.064864 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 731/1455] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:34:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:34:43.116454 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0c4e9b-539f-4849-9492-5bdb58f149fc None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:34:43.116991 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0c4e9b-539f-4849-9492-5bdb58f149fc None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:34:43.117087 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0c4e9b-539f-4849-9492-5bdb58f149fc None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:34:43.118403 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 725/1456] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 2 21:34:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:34:43.123685 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668bf029-be01-4444-a386-57c07eafcb7c None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:34:43.124134 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668bf029-be01-4444-a386-57c07eafcb7c None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:34:43.124269 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668bf029-be01-4444-a386-57c07eafcb7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:34:43.189994 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-668bf029-be01-4444-a386-57c07eafcb7c None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:34:43.191203 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-668bf029-be01-4444-a386-57c07eafcb7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:34:43.220433 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:34:43.287864 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 732/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 2 21:34:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:34:43.326155 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0c4e9b-539f-4849-9492-5bdb58f149fc None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:34:43.327684 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-4a0c4e9b-539f-4849-9492-5bdb58f149fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:34:43.428769 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0c4e9b-539f-4849-9492-5bdb58f149fc None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:34:43.456638 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:34:43.501767 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71249e0e-f847-4492-9342-1bd77667667f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '723f5f43572a493dae0349070a2adb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:34:43.502386 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71249e0e-f847-4492-9342-1bd77667667f service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:34:43.502686 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71249e0e-f847-4492-9342-1bd77667667f service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:34:43.502966 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71249e0e-f847-4492-9342-1bd77667667f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:34:43.504632 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-71249e0e-f847-4492-9342-1bd77667667f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:34:43.613990 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71249e0e-f847-4492-9342-1bd77667667f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:34:43.616487 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71249e0e-f847-4492-9342-1bd77667667f service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:34:43.634997 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 726/1458] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:34:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:34:45.743992 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa793f-3b9e-4963-9999-42aee8ba630c None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:34:45.744592 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa793f-3b9e-4963-9999-42aee8ba630c None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:34:45.744592 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aa793f-3b9e-4963-9999-42aee8ba630c None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:34:45.745947 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 733/1459] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 2 21:34:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:34:45.751241 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fed026-81b6-428f-94c5-abf70a1b8f74 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:34:45.755328 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fed026-81b6-428f-94c5-abf70a1b8f74 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:34:45.755328 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10fed026-81b6-428f-94c5-abf70a1b8f74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:34:45.818779 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-10fed026-81b6-428f-94c5-abf70a1b8f74 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:34:45.820035 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-10fed026-81b6-428f-94c5-abf70a1b8f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:34:45.828965 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:34:45.916524 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 727/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 2 21:34:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:34:45.954772 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aa793f-3b9e-4963-9999-42aee8ba630c None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:34:45.956375 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-a5aa793f-3b9e-4963-9999-42aee8ba630c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:34:46.060132 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aa793f-3b9e-4963-9999-42aee8ba630c None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:34:46.116372 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:34:46.134915 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a846f15a-efc7-4dab-8d4f-369dd3221fe6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '723f5f43572a493dae0349070a2adb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:34:46.135531 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a846f15a-efc7-4dab-8d4f-369dd3221fe6 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:34:46.135811 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a846f15a-efc7-4dab-8d4f-369dd3221fe6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:34:46.136086 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a846f15a-efc7-4dab-8d4f-369dd3221fe6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:34:46.137761 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-a846f15a-efc7-4dab-8d4f-369dd3221fe6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:34:46.247568 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a846f15a-efc7-4dab-8d4f-369dd3221fe6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:34:46.249038 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a846f15a-efc7-4dab-8d4f-369dd3221fe6 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:34:46.267233 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 734/1461] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:34:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:34:48.316921 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e467f7-ac40-49c3-9d03-cc618645e6c3 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:34:48.317380 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e467f7-ac40-49c3-9d03-cc618645e6c3 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:34:48.317476 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e467f7-ac40-49c3-9d03-cc618645e6c3 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:34:48.318838 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 728/1462] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 2 21:34:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:34:48.324083 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403dc884-86e8-4c9b-b163-01c4c4824aba None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:34:48.324672 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403dc884-86e8-4c9b-b163-01c4c4824aba None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:34:48.324672 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403dc884-86e8-4c9b-b163-01c4c4824aba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:34:48.393343 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-403dc884-86e8-4c9b-b163-01c4c4824aba None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:34:48.394560 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-403dc884-86e8-4c9b-b163-01c4c4824aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:34:48.433257 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:34:48.491979 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 735/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 2 21:34:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:34:48.529528 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e467f7-ac40-49c3-9d03-cc618645e6c3 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:34:48.531051 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-e7e467f7-ac40-49c3-9d03-cc618645e6c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:34:48.639022 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e467f7-ac40-49c3-9d03-cc618645e6c3 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:34:48.675826 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:34:48.711417 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100e9da2-c083-4459-9c3e-3c8ca74d8beb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '723f5f43572a493dae0349070a2adb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:34:48.712031 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100e9da2-c083-4459-9c3e-3c8ca74d8beb service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:34:48.712354 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100e9da2-c083-4459-9c3e-3c8ca74d8beb service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:34:48.712632 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100e9da2-c083-4459-9c3e-3c8ca74d8beb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:34:48.714239 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-100e9da2-c083-4459-9c3e-3c8ca74d8beb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:34:48.825133 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100e9da2-c083-4459-9c3e-3c8ca74d8beb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:34:48.826590 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100e9da2-c083-4459-9c3e-3c8ca74d8beb service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:34:48.844193 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 729/1464] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:34:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:34:50.886514 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47908dd5-720f-4e95-a4bf-ce2d33907219 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:34:50.887580 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47908dd5-720f-4e95-a4bf-ce2d33907219 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:34:50.887580 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47908dd5-720f-4e95-a4bf-ce2d33907219 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:34:50.888957 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 736/1465] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 2 21:34:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:34:50.894070 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49342b41-0fc5-4893-9819-f7c55e8367b4 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:34:50.894492 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49342b41-0fc5-4893-9819-f7c55e8367b4 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:34:50.894654 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49342b41-0fc5-4893-9819-f7c55e8367b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:34:50.960629 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-49342b41-0fc5-4893-9819-f7c55e8367b4 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:34:50.961849 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-49342b41-0fc5-4893-9819-f7c55e8367b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:34:50.980392 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:34:51.059452 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 730/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 2 21:34:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:34:51.095886 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47908dd5-720f-4e95-a4bf-ce2d33907219 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:34:51.097482 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-47908dd5-720f-4e95-a4bf-ce2d33907219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:34:51.201744 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47908dd5-720f-4e95-a4bf-ce2d33907219 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:34:51.274985 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:34:51.282540 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dbacf5-16b2-43c6-949b-ebbb5c30ce83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '723f5f43572a493dae0349070a2adb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:34:51.283167 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dbacf5-16b2-43c6-949b-ebbb5c30ce83 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:34:51.283568 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dbacf5-16b2-43c6-949b-ebbb5c30ce83 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:34:51.283854 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dbacf5-16b2-43c6-949b-ebbb5c30ce83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:34:51.285532 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-10dbacf5-16b2-43c6-949b-ebbb5c30ce83 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:34:51.397245 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dbacf5-16b2-43c6-949b-ebbb5c30ce83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:34:51.398688 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dbacf5-16b2-43c6-949b-ebbb5c30ce83 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:34:51.416320 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 737/1467] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:34:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:34:53.437772 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcb492f-a0ce-455f-8f9a-0b85e4264d7a None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:34:53.438319 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcb492f-a0ce-455f-8f9a-0b85e4264d7a None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:34:53.438319 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcb492f-a0ce-455f-8f9a-0b85e4264d7a None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:34:53.439686 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 731/1468] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 2 21:34:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:34:53.445068 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cd24e0-30b2-4aa2-8a7c-e7afc035da77 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:34:53.445508 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cd24e0-30b2-4aa2-8a7c-e7afc035da77 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:34:53.445617 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cd24e0-30b2-4aa2-8a7c-e7afc035da77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:34:53.511555 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-a2cd24e0-30b2-4aa2-8a7c-e7afc035da77 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:34:53.512989 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-a2cd24e0-30b2-4aa2-8a7c-e7afc035da77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:34:53.561149 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:34:53.609876 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 738/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 2 21:34:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:34:53.646429 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcb492f-a0ce-455f-8f9a-0b85e4264d7a None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:34:53.647948 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-ebcb492f-a0ce-455f-8f9a-0b85e4264d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:34:53.750149 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcb492f-a0ce-455f-8f9a-0b85e4264d7a None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:34:53.802332 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:34:53.828905 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dd3629-5bcb-4c99-b2e1-f2e0e0202cf6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '723f5f43572a493dae0349070a2adb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:34:53.829453 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd3629-5bcb-4c99-b2e1-f2e0e0202cf6 service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:34:53.829730 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd3629-5bcb-4c99-b2e1-f2e0e0202cf6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:34:53.829999 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd3629-5bcb-4c99-b2e1-f2e0e0202cf6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:34:53.831615 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-a8dd3629-5bcb-4c99-b2e1-f2e0e0202cf6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:34:53.939979 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dd3629-5bcb-4c99-b2e1-f2e0e0202cf6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:34:53.941574 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dd3629-5bcb-4c99-b2e1-f2e0e0202cf6 service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:34:53.960529 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 732/1470] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:34:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:35:03.608142 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=22 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:35:03.958122 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=66 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:35:13.582261 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c623ba1-ea48-48d1-b915-3dae1c36a4d9 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:35:13.582823 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c623ba1-ea48-48d1-b915-3dae1c36a4d9 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:35:13.582823 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c623ba1-ea48-48d1-b915-3dae1c36a4d9 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:35:13.584197 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 739/1471] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:35:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:35:13.589377 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77368233-de0a-4b5b-a093-4773213fc1b8 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:35:13.589778 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77368233-de0a-4b5b-a093-4773213fc1b8 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:35:13.589922 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77368233-de0a-4b5b-a093-4773213fc1b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:35:13.654970 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-77368233-de0a-4b5b-a093-4773213fc1b8 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:35:13.656291 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-77368233-de0a-4b5b-a093-4773213fc1b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:35:13.753537 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 733/1472] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:35:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:35:13.836147 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649f5f49-7f53-4c43-a14a-1660808f7164 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:35:13.836401 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649f5f49-7f53-4c43-a14a-1660808f7164 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:35:13.836714 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649f5f49-7f53-4c43-a14a-1660808f7164 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:35:13.838052 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 740/1473] 10.222.0.70 () {54 vars in 966 bytes} [Tue Aug 2 21:35:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:35:13.842709 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c46ccd-81b9-4ea4-a082-249c48ba9eeb None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:35:13.842996 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c46ccd-81b9-4ea4-a082-249c48ba9eeb None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:35:13.843269 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c46ccd-81b9-4ea4-a082-249c48ba9eeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:35:13.918218 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-02c46ccd-81b9-4ea4-a082-249c48ba9eeb None None] MFA Rules not processed for user `accb7ab8b4f447389ed394a48fc27619`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:35:13.919408 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-02c46ccd-81b9-4ea4-a082-249c48ba9eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:35:13.939620 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:35:13.996203 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 734/1474] 10.222.0.70 () {58 vars in 1063 bytes} [Tue Aug 2 21:35:13 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:35:14.003712 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649f5f49-7f53-4c43-a14a-1660808f7164 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:35:14.005249 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-649f5f49-7f53-4c43-a14a-1660808f7164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:35:14.108444 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649f5f49-7f53-4c43-a14a-1660808f7164 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:35:14.182658 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e33fb38-3654-4d70-8566-e716726eeed7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'accb7ab8b4f447389ed394a48fc27619', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:35:14.183271 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e33fb38-3654-4d70-8566-e716726eeed7 service glance] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:35:14.183552 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e33fb38-3654-4d70-8566-e716726eeed7 service glance] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:35:14.183833 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e33fb38-3654-4d70-8566-e716726eeed7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:35:14.185476 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-9e33fb38-3654-4d70-8566-e716726eeed7 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:35:14.238326 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:35:14.294825 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e33fb38-3654-4d70-8566-e716726eeed7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:35:14.296333 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e33fb38-3654-4d70-8566-e716726eeed7 service glance] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:35:14.316383 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 741/1475] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:35:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:35:16.428069 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3622ac71-7e06-4a96-affb-a7280c79a683 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:35:16.428541 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3622ac71-7e06-4a96-affb-a7280c79a683 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:35:16.428683 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3622ac71-7e06-4a96-affb-a7280c79a683 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:35:16.430053 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 735/1476] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:35:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:35:16.435257 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eac32f-2c14-40ac-875b-5f9167856eff None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:35:16.435685 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eac32f-2c14-40ac-875b-5f9167856eff None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:35:16.435849 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eac32f-2c14-40ac-875b-5f9167856eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:35:16.501738 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-f0eac32f-2c14-40ac-875b-5f9167856eff None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:35:16.502961 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-f0eac32f-2c14-40ac-875b-5f9167856eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:35:16.598933 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 742/1477] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:35:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:35:16.622055 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3622ac71-7e06-4a96-affb-a7280c79a683 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:35:16.623613 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-3622ac71-7e06-4a96-affb-a7280c79a683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:35:16.750295 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3622ac71-7e06-4a96-affb-a7280c79a683 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:35:16.799118 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:35:16.844638 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec866c27-1ba2-45b7-83cb-296348288261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:35:16.845245 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec866c27-1ba2-45b7-83cb-296348288261 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:35:16.845522 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec866c27-1ba2-45b7-83cb-296348288261 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:35:16.845791 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec866c27-1ba2-45b7-83cb-296348288261 admin admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:35:16.846469 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec866c27-1ba2-45b7-83cb-296348288261 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:35:16.848183 dv-cinder-851449-4-smb devstack@keystone.service[80420]: WARNING py.warnings [None req-ec866c27-1ba2-45b7-83cb-296348288261 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 02 21:35:16.848183 dv-cinder-851449-4-smb devstack@keystone.service[80420]: warnings.warn(msg) Aug 02 21:35:16.848183 dv-cinder-851449-4-smb devstack@keystone.service[80420]: Aug 02 21:35:16.849407 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec866c27-1ba2-45b7-83cb-296348288261 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:35:16.868027 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 736/1478] 10.222.0.70 () {56 vars in 1108 bytes} [Tue Aug 2 21:35:16 2022] GET /identity/v3/projects => generated 2553 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:35:18.889953 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0b955e-4ca3-4f17-b565-32260aa86fb7 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:35:18.890481 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0b955e-4ca3-4f17-b565-32260aa86fb7 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:35:18.890481 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0b955e-4ca3-4f17-b565-32260aa86fb7 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:35:18.891826 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 743/1479] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:35:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:35:18.896955 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4546bc-a3eb-4070-92aa-d6c8a7de6b18 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:35:18.897509 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4546bc-a3eb-4070-92aa-d6c8a7de6b18 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:35:18.897631 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4546bc-a3eb-4070-92aa-d6c8a7de6b18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:35:18.964808 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-9c4546bc-a3eb-4070-92aa-d6c8a7de6b18 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:35:18.966026 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-9c4546bc-a3eb-4070-92aa-d6c8a7de6b18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:35:19.061255 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 737/1480] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:35:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:35:19.107164 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0b955e-4ca3-4f17-b565-32260aa86fb7 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:35:19.109095 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-9c0b955e-4ca3-4f17-b565-32260aa86fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:35:19.119345 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:35:19.254286 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0b955e-4ca3-4f17-b565-32260aa86fb7 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:35:19.336819 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:35:19.370959 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe167a39-dcaf-4c9e-98b8-10ff80df01bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87dd5c1c5e854d4b96e0b7dad6aa3719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:35:19.371580 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe167a39-dcaf-4c9e-98b8-10ff80df01bc service nova] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:35:19.371867 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe167a39-dcaf-4c9e-98b8-10ff80df01bc service nova] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:35:19.372144 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe167a39-dcaf-4c9e-98b8-10ff80df01bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:35:19.373791 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-fe167a39-dcaf-4c9e-98b8-10ff80df01bc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:35:19.461321 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe167a39-dcaf-4c9e-98b8-10ff80df01bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:35:19.462971 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe167a39-dcaf-4c9e-98b8-10ff80df01bc service nova] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:35:19.481469 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 744/1481] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:35:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:35:21.701217 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c4e166-0316-455d-b527-ed6298f2a0fd None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:35:21.701749 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c4e166-0316-455d-b527-ed6298f2a0fd None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:35:21.701859 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c4e166-0316-455d-b527-ed6298f2a0fd None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:35:21.703181 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 738/1482] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:35:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:35:21.708604 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0d5513-b070-405a-ab9b-fa813e76a983 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:35:21.708999 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0d5513-b070-405a-ab9b-fa813e76a983 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:35:21.709167 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0d5513-b070-405a-ab9b-fa813e76a983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:35:21.776696 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-ec0d5513-b070-405a-ab9b-fa813e76a983 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:35:21.777901 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-ec0d5513-b070-405a-ab9b-fa813e76a983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:35:21.824989 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:35:21.875423 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 745/1483] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:35:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:35:21.914953 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c4e166-0316-455d-b527-ed6298f2a0fd None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:35:21.916586 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-99c4e166-0316-455d-b527-ed6298f2a0fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:35:21.940331 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:35:22.020742 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c4e166-0316-455d-b527-ed6298f2a0fd None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:35:22.092146 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef92fb82-cd18-431d-ab93-443399534725 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '723f5f43572a493dae0349070a2adb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:35:22.092786 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef92fb82-cd18-431d-ab93-443399534725 service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:35:22.093073 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef92fb82-cd18-431d-ab93-443399534725 service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:35:22.093351 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef92fb82-cd18-431d-ab93-443399534725 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:35:22.094965 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-ef92fb82-cd18-431d-ab93-443399534725 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:35:22.168117 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:35:22.204963 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef92fb82-cd18-431d-ab93-443399534725 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:35:22.206414 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef92fb82-cd18-431d-ab93-443399534725 service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:35:22.223983 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 739/1484] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:35:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:35:24.298072 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfcbf57-a576-4330-b3c7-d311cc6d32bb None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:35:24.298508 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfcbf57-a576-4330-b3c7-d311cc6d32bb None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:35:24.298630 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfcbf57-a576-4330-b3c7-d311cc6d32bb None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:35:24.300053 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 746/1485] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:35:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:35:24.305257 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c228f8a7-3c84-4c7a-be06-88006915e62c None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:35:24.305673 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c228f8a7-3c84-4c7a-be06-88006915e62c None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:35:24.305821 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c228f8a7-3c84-4c7a-be06-88006915e62c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:35:24.373153 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-c228f8a7-3c84-4c7a-be06-88006915e62c None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:35:24.374383 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-c228f8a7-3c84-4c7a-be06-88006915e62c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:35:24.471666 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 740/1486] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:35:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:35:24.510676 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfcbf57-a576-4330-b3c7-d311cc6d32bb None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:35:24.512251 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-6bfcbf57-a576-4330-b3c7-d311cc6d32bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:35:24.615712 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfcbf57-a576-4330-b3c7-d311cc6d32bb None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:35:24.686054 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:35:24.687786 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf13beb-6e9d-4b7c-ac26-8f66050c81eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '723f5f43572a493dae0349070a2adb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:35:24.688443 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf13beb-6e9d-4b7c-ac26-8f66050c81eb service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:35:24.688915 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf13beb-6e9d-4b7c-ac26-8f66050c81eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:35:24.689355 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf13beb-6e9d-4b7c-ac26-8f66050c81eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:35:24.691236 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-ddf13beb-6e9d-4b7c-ac26-8f66050c81eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:35:24.798799 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf13beb-6e9d-4b7c-ac26-8f66050c81eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:35:24.800253 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf13beb-6e9d-4b7c-ac26-8f66050c81eb service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:35:24.819430 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 747/1487] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:35:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:35:26.993455 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc781b53-d37c-4fcf-9b8c-3acffbf2827a None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:35:26.994021 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc781b53-d37c-4fcf-9b8c-3acffbf2827a None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:35:26.994021 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc781b53-d37c-4fcf-9b8c-3acffbf2827a None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:35:26.995395 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 741/1488] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:35:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:35:27.001055 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656dca58-d3a2-4f03-a35d-2dd203b1bcb8 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:35:27.001453 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656dca58-d3a2-4f03-a35d-2dd203b1bcb8 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:35:27.001618 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656dca58-d3a2-4f03-a35d-2dd203b1bcb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:35:27.071034 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-656dca58-d3a2-4f03-a35d-2dd203b1bcb8 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:35:27.073142 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-656dca58-d3a2-4f03-a35d-2dd203b1bcb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:35:27.127449 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:35:27.171466 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 748/1489] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:35:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:35:27.212864 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc781b53-d37c-4fcf-9b8c-3acffbf2827a None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:35:27.214389 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-bc781b53-d37c-4fcf-9b8c-3acffbf2827a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:35:27.250343 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:35:27.319323 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc781b53-d37c-4fcf-9b8c-3acffbf2827a None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:35:27.393580 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a535ae-886b-4870-af8e-01a6dea302ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '723f5f43572a493dae0349070a2adb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:35:27.394198 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a535ae-886b-4870-af8e-01a6dea302ff service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:35:27.394480 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a535ae-886b-4870-af8e-01a6dea302ff service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:35:27.394756 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a535ae-886b-4870-af8e-01a6dea302ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:35:27.396399 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-f0a535ae-886b-4870-af8e-01a6dea302ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:35:27.473977 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:35:27.504024 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a535ae-886b-4870-af8e-01a6dea302ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:35:27.505475 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a535ae-886b-4870-af8e-01a6dea302ff service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:35:27.523367 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 742/1490] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:35:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:35:29.730778 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befcc4eb-b1bc-40a1-aad9-7dfc2957ae3d None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:35:29.731347 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befcc4eb-b1bc-40a1-aad9-7dfc2957ae3d None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:35:29.731347 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befcc4eb-b1bc-40a1-aad9-7dfc2957ae3d None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:35:29.732709 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 749/1491] 10.222.0.70 () {54 vars in 926 bytes} [Tue Aug 2 21:35:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:35:29.738204 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd04195-06ba-4d14-a287-7518232719f5 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:35:29.738653 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd04195-06ba-4d14-a287-7518232719f5 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:35:29.738751 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd04195-06ba-4d14-a287-7518232719f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:35:29.804675 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-8fd04195-06ba-4d14-a287-7518232719f5 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:35:29.805903 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-8fd04195-06ba-4d14-a287-7518232719f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:35:29.902570 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 743/1492] 10.222.0.70 () {58 vars in 1023 bytes} [Tue Aug 2 21:35:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:35:29.945757 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befcc4eb-b1bc-40a1-aad9-7dfc2957ae3d None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:35:29.947299 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-befcc4eb-b1bc-40a1-aad9-7dfc2957ae3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:35:30.049424 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befcc4eb-b1bc-40a1-aad9-7dfc2957ae3d None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:35:30.121749 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cae66b0-3a0c-4ac0-8baf-7ad41f035b37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '723f5f43572a493dae0349070a2adb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:35:30.122364 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae66b0-3a0c-4ac0-8baf-7ad41f035b37 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:35:30.122647 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae66b0-3a0c-4ac0-8baf-7ad41f035b37 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:35:30.122923 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae66b0-3a0c-4ac0-8baf-7ad41f035b37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:35:30.124569 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-7cae66b0-3a0c-4ac0-8baf-7ad41f035b37 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:35:30.133510 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:35:30.231896 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cae66b0-3a0c-4ac0-8baf-7ad41f035b37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:35:30.233393 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cae66b0-3a0c-4ac0-8baf-7ad41f035b37 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:35:30.251671 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 750/1493] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:35:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:35:39.900417 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=82 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:35:40.249181 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=50 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:37:03.611109 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631ecb4a-18c9-4182-b634-612cff8932b2 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:37:03.611675 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631ecb4a-18c9-4182-b634-612cff8932b2 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:37:03.611675 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631ecb4a-18c9-4182-b634-612cff8932b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:37:03.687137 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-631ecb4a-18c9-4182-b634-612cff8932b2 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:37:03.688372 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-631ecb4a-18c9-4182-b634-612cff8932b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:37:03.781984 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 744/1494] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:37:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:37:03.790713 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70a77d9-20b7-474d-949d-802da0b53e3c None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:37:03.791208 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70a77d9-20b7-474d-949d-802da0b53e3c None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:37:03.791326 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70a77d9-20b7-474d-949d-802da0b53e3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:37:03.867348 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-c70a77d9-20b7-474d-949d-802da0b53e3c None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:37:03.868526 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-c70a77d9-20b7-474d-949d-802da0b53e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:37:03.965839 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 751/1495] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:37:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:37:03.970457 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631ecb4a-18c9-4182-b634-612cff8932b2 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:37:03.971650 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-631ecb4a-18c9-4182-b634-612cff8932b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:37:03.983825 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631ecb4a-18c9-4182-b634-612cff8932b2 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:37:04.044244 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:37:04.077653 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b2824f-0fa1-4afc-a854-ce6d6635e69b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:37:04.078306 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b2824f-0fa1-4afc-a854-ce6d6635e69b admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:37:04.078587 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b2824f-0fa1-4afc-a854-ce6d6635e69b admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:37:04.078862 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b2824f-0fa1-4afc-a854-ce6d6635e69b admin admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:37:04.079699 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b2824f-0fa1-4afc-a854-ce6d6635e69b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:37:04.080010 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b2824f-0fa1-4afc-a854-ce6d6635e69b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:37:04.081060 dv-cinder-851449-4-smb devstack@keystone.service[80420]: WARNING py.warnings [None req-12b2824f-0fa1-4afc-a854-ce6d6635e69b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 21:37:04.081060 dv-cinder-851449-4-smb devstack@keystone.service[80420]: warnings.warn(msg) Aug 02 21:37:04.081060 dv-cinder-851449-4-smb devstack@keystone.service[80420]: Aug 02 21:37:04.082487 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b2824f-0fa1-4afc-a854-ce6d6635e69b admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:37:04.093549 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 745/1496] 10.222.0.70 () {58 vars in 1153 bytes} [Tue Aug 2 21:37:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:37:04.103155 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70a77d9-20b7-474d-949d-802da0b53e3c None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:37:04.112907 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70a77d9-20b7-474d-949d-802da0b53e3c None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:37:04.174743 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:37:04.210021 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5b340d-ae09-40a2-9587-f10bf764a1b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:37:04.210643 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5b340d-ae09-40a2-9587-f10bf764a1b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:37:04.210928 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5b340d-ae09-40a2-9587-f10bf764a1b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:37:04.211208 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5b340d-ae09-40a2-9587-f10bf764a1b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:37:04.211871 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5b340d-ae09-40a2-9587-f10bf764a1b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:37:04.213644 dv-cinder-851449-4-smb devstack@keystone.service[80419]: WARNING py.warnings [None req-ad5b340d-ae09-40a2-9587-f10bf764a1b0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 02 21:37:04.213644 dv-cinder-851449-4-smb devstack@keystone.service[80419]: warnings.warn(msg) Aug 02 21:37:04.213644 dv-cinder-851449-4-smb devstack@keystone.service[80419]: Aug 02 21:37:04.214841 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5b340d-ae09-40a2-9587-f10bf764a1b0 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:37:04.271578 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 752/1497] 10.222.0.70 () {60 vars in 1153 bytes} [Tue Aug 2 21:37:04 2022] POST /identity/v3/projects => generated 377 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:37:04.275897 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b2824f-0fa1-4afc-a854-ce6d6635e69b admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:37:04.277487 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-12b2824f-0fa1-4afc-a854-ce6d6635e69b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:37:04.311853 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b2824f-0fa1-4afc-a854-ce6d6635e69b admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:37:04.406864 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ca0f18-ad50-4d8d-bc8e-0a807d9f6702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:37:04.407474 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ca0f18-ad50-4d8d-bc8e-0a807d9f6702 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:37:04.407754 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ca0f18-ad50-4d8d-bc8e-0a807d9f6702 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:37:04.408027 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ca0f18-ad50-4d8d-bc8e-0a807d9f6702 admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:37:04.408713 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ca0f18-ad50-4d8d-bc8e-0a807d9f6702 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:37:04.409726 dv-cinder-851449-4-smb devstack@keystone.service[80420]: WARNING py.warnings [None req-01ca0f18-ad50-4d8d-bc8e-0a807d9f6702 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 02 21:37:04.409726 dv-cinder-851449-4-smb devstack@keystone.service[80420]: warnings.warn(msg) Aug 02 21:37:04.409726 dv-cinder-851449-4-smb devstack@keystone.service[80420]: Aug 02 21:37:04.411447 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ca0f18-ad50-4d8d-bc8e-0a807d9f6702 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:37:04.452956 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 746/1498] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 2 21:37:04 2022] POST /identity/v3/users => generated 289 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:37:04.459185 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5b340d-ae09-40a2-9587-f10bf764a1b0 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:37:04.460800 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-ad5b340d-ae09-40a2-9587-f10bf764a1b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:37:04.530535 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5b340d-ae09-40a2-9587-f10bf764a1b0 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:37:04.613104 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:37:04.624136 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ae6792-d464-4798-82ea-36c81f8bb456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:37:04.624778 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ae6792-d464-4798-82ea-36c81f8bb456 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:37:04.625055 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ae6792-d464-4798-82ea-36c81f8bb456 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:37:04.625328 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ae6792-d464-4798-82ea-36c81f8bb456 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:37:04.626013 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ae6792-d464-4798-82ea-36c81f8bb456 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:37:04.627016 dv-cinder-851449-4-smb devstack@keystone.service[80419]: WARNING py.warnings [None req-65ae6792-d464-4798-82ea-36c81f8bb456 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 21:37:04.627016 dv-cinder-851449-4-smb devstack@keystone.service[80419]: warnings.warn(msg) Aug 02 21:37:04.627016 dv-cinder-851449-4-smb devstack@keystone.service[80419]: Aug 02 21:37:04.627903 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ae6792-d464-4798-82ea-36c81f8bb456 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:37:04.640094 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 753/1499] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:37:04 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:37:04.644287 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ca0f18-ad50-4d8d-bc8e-0a807d9f6702 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:37:04.646411 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-01ca0f18-ad50-4d8d-bc8e-0a807d9f6702 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:37:04.657632 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ca0f18-ad50-4d8d-bc8e-0a807d9f6702 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:37:04.682511 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:37:04.756209 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c630199-e4ca-4bde-8142-b68903016cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:37:04.756776 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c630199-e4ca-4bde-8142-b68903016cc3 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:37:04.757060 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c630199-e4ca-4bde-8142-b68903016cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:37:04.757337 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c630199-e4ca-4bde-8142-b68903016cc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:37:04.758052 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c630199-e4ca-4bde-8142-b68903016cc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:37:04.759074 dv-cinder-851449-4-smb devstack@keystone.service[80420]: WARNING py.warnings [None req-4c630199-e4ca-4bde-8142-b68903016cc3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 21:37:04.759074 dv-cinder-851449-4-smb devstack@keystone.service[80420]: warnings.warn(msg) Aug 02 21:37:04.759074 dv-cinder-851449-4-smb devstack@keystone.service[80420]: Aug 02 21:37:04.759970 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c630199-e4ca-4bde-8142-b68903016cc3 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:37:04.772720 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 747/1500] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:37:04 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:37:04.777088 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ae6792-d464-4798-82ea-36c81f8bb456 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:37:04.778602 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-65ae6792-d464-4798-82ea-36c81f8bb456 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:37:04.812101 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ae6792-d464-4798-82ea-36c81f8bb456 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:37:04.905904 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375bf080-c087-44f6-9ae4-58aefd54d97c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:37:04.906569 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375bf080-c087-44f6-9ae4-58aefd54d97c admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:37:04.906855 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375bf080-c087-44f6-9ae4-58aefd54d97c admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:37:04.907134 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375bf080-c087-44f6-9ae4-58aefd54d97c admin admin] PATH_INFO: `/v3/projects/c9b7653750b948fd859db95478e48f76/users/766cc0f7eabd49fcb2e23886b23766f2/roles/462e3381a85c42a9959201f9aa122f7c` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:37:04.929306 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375bf080-c087-44f6-9ae4-58aefd54d97c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9b7653750b948fd859db95478e48f76, user_id=766cc0f7eabd49fcb2e23886b23766f2, role_id=462e3381a85c42a9959201f9aa122f7c)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:37:04.930339 dv-cinder-851449-4-smb devstack@keystone.service[80419]: WARNING py.warnings [None req-375bf080-c087-44f6-9ae4-58aefd54d97c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 02 21:37:04.930339 dv-cinder-851449-4-smb devstack@keystone.service[80419]: warnings.warn(msg) Aug 02 21:37:04.930339 dv-cinder-851449-4-smb devstack@keystone.service[80419]: Aug 02 21:37:04.932353 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375bf080-c087-44f6-9ae4-58aefd54d97c admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:37:04.958363 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 754/1501] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:37:04 2022] PUT /identity/v3/projects/c9b7653750b948fd859db95478e48f76/users/766cc0f7eabd49fcb2e23886b23766f2/roles/462e3381a85c42a9959201f9aa122f7c => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:37:04.970708 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc15559-95c9-48e9-a5d1-edf9d6138f5b None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:37:04.971008 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc15559-95c9-48e9-a5d1-edf9d6138f5b None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:37:04.971292 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc15559-95c9-48e9-a5d1-edf9d6138f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:37:05.029236 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-8cc15559-95c9-48e9-a5d1-edf9d6138f5b None None] MFA Rules not processed for user `766cc0f7eabd49fcb2e23886b23766f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:37:05.030384 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-8cc15559-95c9-48e9-a5d1-edf9d6138f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:37:05.105989 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 748/1502] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:37:04 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:37:05.119435 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d3c606-5c36-4e5f-949b-7179be6d635b None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:37:05.119795 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d3c606-5c36-4e5f-949b-7179be6d635b None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:37:05.120071 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d3c606-5c36-4e5f-949b-7179be6d635b None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:37:05.121433 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 755/1503] 10.222.0.70 () {54 vars in 964 bytes} [Tue Aug 2 21:37:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:37:05.126424 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b801a39-fd97-4df5-b0d3-2ce94c3dee14 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:37:05.126719 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b801a39-fd97-4df5-b0d3-2ce94c3dee14 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:37:05.127001 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b801a39-fd97-4df5-b0d3-2ce94c3dee14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:37:05.161283 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:37:05.208452 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-5b801a39-fd97-4df5-b0d3-2ce94c3dee14 None None] MFA Rules not processed for user `123eb76f95ee4e39905944da701c712d`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:37:05.209669 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-5b801a39-fd97-4df5-b0d3-2ce94c3dee14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:37:05.289901 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 749/1504] 10.222.0.70 () {58 vars in 1061 bytes} [Tue Aug 2 21:37:05 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:37:05.297651 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d3c606-5c36-4e5f-949b-7179be6d635b None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:37:05.299163 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-11d3c606-5c36-4e5f-949b-7179be6d635b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:37:05.352845 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:37:05.410869 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d3c606-5c36-4e5f-949b-7179be6d635b None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:37:05.483667 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3add68-08ee-4241-a0f7-876dbbeac4f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '123eb76f95ee4e39905944da701c712d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:37:05.484307 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3add68-08ee-4241-a0f7-876dbbeac4f0 service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:37:05.484596 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3add68-08ee-4241-a0f7-876dbbeac4f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:37:05.484882 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3add68-08ee-4241-a0f7-876dbbeac4f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:37:05.486488 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-cb3add68-08ee-4241-a0f7-876dbbeac4f0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:37:05.585207 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3add68-08ee-4241-a0f7-876dbbeac4f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:37:05.586610 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3add68-08ee-4241-a0f7-876dbbeac4f0 service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:37:05.590230 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:37:05.605770 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 756/1505] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:37:05 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:37:05.650500 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10789c3e-95d3-4c73-a60f-4ac17e3a9f78 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:37:05.650908 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10789c3e-95d3-4c73-a60f-4ac17e3a9f78 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:37:05.651061 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10789c3e-95d3-4c73-a60f-4ac17e3a9f78 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:37:05.652360 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 750/1506] 10.222.0.70 () {52 vars in 830 bytes} [Tue Aug 2 21:37:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:37:05.655860 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3add68-08ee-4241-a0f7-876dbbeac4f0 service cinder] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:37:05.657097 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-cb3add68-08ee-4241-a0f7-876dbbeac4f0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:37:05.754550 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3add68-08ee-4241-a0f7-876dbbeac4f0 service cinder] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:37:05.852611 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa41c201-2226-45bd-a946-a2fc358b421b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:37:05.853298 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa41c201-2226-45bd-a946-a2fc358b421b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:37:05.853440 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa41c201-2226-45bd-a946-a2fc358b421b admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:37:05.853712 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa41c201-2226-45bd-a946-a2fc358b421b admin admin] PATH_INFO: `/v3/users/766cc0f7eabd49fcb2e23886b23766f2` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:37:05.865942 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa41c201-2226-45bd-a946-a2fc358b421b admin admin] RBAC: Authorizing `identity:delete_user(user_id=766cc0f7eabd49fcb2e23886b23766f2)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:37:05.866957 dv-cinder-851449-4-smb devstack@keystone.service[80419]: WARNING py.warnings [None req-aa41c201-2226-45bd-a946-a2fc358b421b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 02 21:37:05.866957 dv-cinder-851449-4-smb devstack@keystone.service[80419]: warnings.warn(msg) Aug 02 21:37:05.866957 dv-cinder-851449-4-smb devstack@keystone.service[80419]: Aug 02 21:37:05.868172 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa41c201-2226-45bd-a946-a2fc358b421b admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:37:05.877696 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:37:05.934607 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-aa41c201-2226-45bd-a946-a2fc358b421b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '766cc0f7eabd49fcb2e23886b23766f2'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:37:05.944639 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-aa41c201-2226-45bd-a946-a2fc358b421b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '766cc0f7eabd49fcb2e23886b23766f2'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:37:05.966807 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-aa41c201-2226-45bd-a946-a2fc358b421b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '766cc0f7eabd49fcb2e23886b23766f2'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:37:05.967252 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-aa41c201-2226-45bd-a946-a2fc358b421b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '766cc0f7eabd49fcb2e23886b23766f2'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:37:05.981855 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-aa41c201-2226-45bd-a946-a2fc358b421b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '766cc0f7eabd49fcb2e23886b23766f2'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:37:05.987400 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 757/1507] 10.222.0.70 () {58 vars in 1224 bytes} [Tue Aug 2 21:37:05 2022] DELETE /identity/v3/users/766cc0f7eabd49fcb2e23886b23766f2 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:37:05.992387 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c247efa0-e103-4056-ae8b-033508806792 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:37:05.992680 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c247efa0-e103-4056-ae8b-033508806792 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:37:05.992984 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c247efa0-e103-4056-ae8b-033508806792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:37:06.048773 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-c247efa0-e103-4056-ae8b-033508806792 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:37:06.049991 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-c247efa0-e103-4056-ae8b-033508806792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:37:06.134580 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:37:06.148076 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 751/1508] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:37:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:37:06.157608 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa41c201-2226-45bd-a946-a2fc358b421b admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:37:06.158830 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-aa41c201-2226-45bd-a946-a2fc358b421b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:37:06.257697 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa41c201-2226-45bd-a946-a2fc358b421b admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:37:06.312333 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:37:06.333480 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d87fc85-b1d2-46a0-97eb-de4f7d5bf7bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '723f5f43572a493dae0349070a2adb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:37:06.334296 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d87fc85-b1d2-46a0-97eb-de4f7d5bf7bc service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:37:06.335649 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d87fc85-b1d2-46a0-97eb-de4f7d5bf7bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:37:06.337421 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d87fc85-b1d2-46a0-97eb-de4f7d5bf7bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:37:06.340291 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-5d87fc85-b1d2-46a0-97eb-de4f7d5bf7bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:37:06.451876 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d87fc85-b1d2-46a0-97eb-de4f7d5bf7bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:37:06.453372 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d87fc85-b1d2-46a0-97eb-de4f7d5bf7bc service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:37:06.472825 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 758/1509] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:37:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:37:06.800360 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c247efa0-e103-4056-ae8b-033508806792 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:37:06.802098 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-c247efa0-e103-4056-ae8b-033508806792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:37:06.813493 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c247efa0-e103-4056-ae8b-033508806792 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:37:06.909071 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c49a0e-c3cb-41ef-89f6-a7c0ad958093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:37:06.909705 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c49a0e-c3cb-41ef-89f6-a7c0ad958093 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:37:06.910559 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c49a0e-c3cb-41ef-89f6-a7c0ad958093 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:37:06.910880 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c49a0e-c3cb-41ef-89f6-a7c0ad958093 admin admin] PATH_INFO: `/v3/projects/c9b7653750b948fd859db95478e48f76` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:37:06.920620 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c49a0e-c3cb-41ef-89f6-a7c0ad958093 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9b7653750b948fd859db95478e48f76)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:37:06.921689 dv-cinder-851449-4-smb devstack@keystone.service[80420]: WARNING py.warnings [None req-b6c49a0e-c3cb-41ef-89f6-a7c0ad958093 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 02 21:37:06.921689 dv-cinder-851449-4-smb devstack@keystone.service[80420]: warnings.warn(msg) Aug 02 21:37:06.921689 dv-cinder-851449-4-smb devstack@keystone.service[80420]: Aug 02 21:37:06.922938 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c49a0e-c3cb-41ef-89f6-a7c0ad958093 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:37:06.981100 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-b6c49a0e-c3cb-41ef-89f6-a7c0ad958093 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9b7653750b948fd859db95478e48f76', 'request_id': 'req-b6c49a0e-c3cb-41ef-89f6-a7c0ad958093'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:37:06.987423 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-b6c49a0e-c3cb-41ef-89f6-a7c0ad958093 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9b7653750b948fd859db95478e48f76', 'request_id': 'req-b6c49a0e-c3cb-41ef-89f6-a7c0ad958093'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:37:06.996999 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-b6c49a0e-c3cb-41ef-89f6-a7c0ad958093 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9b7653750b948fd859db95478e48f76', 'request_id': 'req-b6c49a0e-c3cb-41ef-89f6-a7c0ad958093'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:37:07.026876 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-b6c49a0e-c3cb-41ef-89f6-a7c0ad958093 admin admin] The token cache is being invalidate because project c9b7653750b948fd859db95478e48f76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:37:07.027171 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-b6c49a0e-c3cb-41ef-89f6-a7c0ad958093 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:37:07.027599 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-b6c49a0e-c3cb-41ef-89f6-a7c0ad958093 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:37:07.029083 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 752/1510] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Aug 2 21:37:06 2022] DELETE /identity/v3/projects/c9b7653750b948fd859db95478e48f76 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:37:16.470411 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=62 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:37:17.024677 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:38:55.775035 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c2648b-c0cb-4b14-8649-143132658230 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:38:55.775653 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c2648b-c0cb-4b14-8649-143132658230 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:38:55.775653 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c2648b-c0cb-4b14-8649-143132658230 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:38:55.777312 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 759/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 2 21:38:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:38:55.782432 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddd2660-8564-4504-9776-fa89e34b56f5 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:38:55.782885 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddd2660-8564-4504-9776-fa89e34b56f5 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:38:55.782994 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bddd2660-8564-4504-9776-fa89e34b56f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:38:55.863182 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-bddd2660-8564-4504-9776-fa89e34b56f5 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:38:55.864414 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-bddd2660-8564-4504-9776-fa89e34b56f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:38:55.964713 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 753/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 2 21:38:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:38:56.117477 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c2648b-c0cb-4b14-8649-143132658230 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:38:56.119616 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-47c2648b-c0cb-4b14-8649-143132658230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:38:56.236627 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c2648b-c0cb-4b14-8649-143132658230 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:38:56.241875 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c34fe4b-0601-4c7e-a169-2f4e1da04c57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87dd5c1c5e854d4b96e0b7dad6aa3719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:38:56.242486 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c34fe4b-0601-4c7e-a169-2f4e1da04c57 service nova] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:38:56.242766 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c34fe4b-0601-4c7e-a169-2f4e1da04c57 service nova] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:38:56.243041 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c34fe4b-0601-4c7e-a169-2f4e1da04c57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:38:56.250942 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c34fe4b-0601-4c7e-a169-2f4e1da04c57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:38:56.252544 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c34fe4b-0601-4c7e-a169-2f4e1da04c57 service nova] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:38:56.261661 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 760/1513] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:38:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:38:57.100577 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b558242-c9cc-4923-b677-577967082294 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:38:57.101145 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b558242-c9cc-4923-b677-577967082294 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:38:57.101145 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b558242-c9cc-4923-b677-577967082294 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:38:57.102527 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 754/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 2 21:38:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:38:57.107784 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d709d84-76a5-4521-b622-e89c4ef097f9 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:38:57.108206 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d709d84-76a5-4521-b622-e89c4ef097f9 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:38:57.108377 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d709d84-76a5-4521-b622-e89c4ef097f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:38:57.130064 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-8d709d84-76a5-4521-b622-e89c4ef097f9 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:38:57.131274 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-8d709d84-76a5-4521-b622-e89c4ef097f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:38:57.139033 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 761/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 2 21:38:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:38:57.294488 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b558242-c9cc-4923-b677-577967082294 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:38:57.310220 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b558242-c9cc-4923-b677-577967082294 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:38:57.316726 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf7ab2c-6857-4da5-965b-e609d23dd857 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87dd5c1c5e854d4b96e0b7dad6aa3719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:38:57.317372 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf7ab2c-6857-4da5-965b-e609d23dd857 service nova] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:38:57.317658 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf7ab2c-6857-4da5-965b-e609d23dd857 service nova] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:38:57.317936 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf7ab2c-6857-4da5-965b-e609d23dd857 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:38:57.326561 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf7ab2c-6857-4da5-965b-e609d23dd857 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:38:57.328178 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf7ab2c-6857-4da5-965b-e609d23dd857 service nova] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:38:57.338339 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 755/1516] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:38:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:38:57.360967 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c997ec-11ba-44b8-a12f-f4e35f30cfe8 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:38:57.361262 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c997ec-11ba-44b8-a12f-f4e35f30cfe8 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:38:57.361677 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c997ec-11ba-44b8-a12f-f4e35f30cfe8 None None] PATH_INFO: `/v3` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:38:57.363441 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 762/1517] 10.222.0.47 () {54 vars in 925 bytes} [Tue Aug 2 21:38:57 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:38:57.369995 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28512ed-584c-4586-b69f-8cfe35e864a9 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:38:57.370285 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28512ed-584c-4586-b69f-8cfe35e864a9 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:38:57.370562 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28512ed-584c-4586-b69f-8cfe35e864a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:38:57.439658 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-d28512ed-584c-4586-b69f-8cfe35e864a9 None None] MFA Rules not processed for user `83fcd951771e42959506b70b0137003f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:38:57.440914 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-d28512ed-584c-4586-b69f-8cfe35e864a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:38:57.457847 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:38:57.518790 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 756/1518] 10.222.0.47 () {58 vars in 1015 bytes} [Tue Aug 2 21:38:57 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:39:06.297732 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e55d0b2-ca82-4a59-93a9-4456aaa3ce38 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:06.298144 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e55d0b2-ca82-4a59-93a9-4456aaa3ce38 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:06.298240 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e55d0b2-ca82-4a59-93a9-4456aaa3ce38 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:06.299620 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 763/1519] 10.222.0.70 () {54 vars in 961 bytes} [Tue Aug 2 21:39:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:39:06.304961 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b23042d-36b3-4482-bea0-9ff80407238f None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:06.305364 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b23042d-36b3-4482-bea0-9ff80407238f None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:06.305525 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b23042d-36b3-4482-bea0-9ff80407238f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:06.325201 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-3b23042d-36b3-4482-bea0-9ff80407238f None None] MFA Rules not processed for user `83fcd951771e42959506b70b0137003f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:39:06.326403 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-3b23042d-36b3-4482-bea0-9ff80407238f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:39:06.335051 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 757/1520] 10.222.0.70 () {58 vars in 1058 bytes} [Tue Aug 2 21:39:06 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:39:06.342551 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e55d0b2-ca82-4a59-93a9-4456aaa3ce38 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:39:06.356447 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e55d0b2-ca82-4a59-93a9-4456aaa3ce38 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:39:06.361286 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb6c193-bd1f-465e-9da8-a22f1c381810 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83fcd951771e42959506b70b0137003f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:39:06.361879 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb6c193-bd1f-465e-9da8-a22f1c381810 service placement] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:06.362162 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb6c193-bd1f-465e-9da8-a22f1c381810 service placement] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:06.362440 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb6c193-bd1f-465e-9da8-a22f1c381810 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:06.371317 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb6c193-bd1f-465e-9da8-a22f1c381810 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:39:06.372927 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb6c193-bd1f-465e-9da8-a22f1c381810 service placement] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:39:06.382357 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 764/1521] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:39:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:39:08.545717 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4339af7e-478e-499a-b406-cded7e6cdee6 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:08.546184 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4339af7e-478e-499a-b406-cded7e6cdee6 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:08.546280 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4339af7e-478e-499a-b406-cded7e6cdee6 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:08.547608 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 758/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 2 21:39:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:39:08.552924 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc6f2e2-7199-4e9b-b56e-b73dd4b1e0ed None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:08.553350 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc6f2e2-7199-4e9b-b56e-b73dd4b1e0ed None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:08.553487 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc6f2e2-7199-4e9b-b56e-b73dd4b1e0ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:08.573231 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-7cc6f2e2-7199-4e9b-b56e-b73dd4b1e0ed None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:39:08.574441 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-7cc6f2e2-7199-4e9b-b56e-b73dd4b1e0ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:39:08.582294 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 765/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 2 21:39:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:39:08.734989 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4339af7e-478e-499a-b406-cded7e6cdee6 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:39:08.750213 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4339af7e-478e-499a-b406-cded7e6cdee6 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:39:08.755678 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970e9771-4b25-413a-9c50-d3f6cf6a06fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87dd5c1c5e854d4b96e0b7dad6aa3719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:39:08.756318 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e9771-4b25-413a-9c50-d3f6cf6a06fa service nova] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:08.756606 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e9771-4b25-413a-9c50-d3f6cf6a06fa service nova] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:08.756885 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e9771-4b25-413a-9c50-d3f6cf6a06fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:08.766282 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970e9771-4b25-413a-9c50-d3f6cf6a06fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:39:08.768011 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970e9771-4b25-413a-9c50-d3f6cf6a06fa service nova] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:39:08.777914 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 759/1524] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:39:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:39:09.627193 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc1e9af-dca1-4ff0-9678-a2bed76baac9 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:09.627730 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc1e9af-dca1-4ff0-9678-a2bed76baac9 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:09.627730 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc1e9af-dca1-4ff0-9678-a2bed76baac9 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:09.629076 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 766/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue Aug 2 21:39:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:39:09.633902 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7504245d-a057-428f-9a1a-2a6d93b92b2c None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:09.634326 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7504245d-a057-428f-9a1a-2a6d93b92b2c None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:09.634463 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7504245d-a057-428f-9a1a-2a6d93b92b2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:09.653478 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-7504245d-a057-428f-9a1a-2a6d93b92b2c None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:39:09.654675 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-7504245d-a057-428f-9a1a-2a6d93b92b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:39:09.663124 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 760/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue Aug 2 21:39:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:39:09.814716 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc1e9af-dca1-4ff0-9678-a2bed76baac9 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:39:09.828672 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc1e9af-dca1-4ff0-9678-a2bed76baac9 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:39:09.834505 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58eb810b-95b8-4365-8721-46c0ce247b0a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87dd5c1c5e854d4b96e0b7dad6aa3719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:39:09.835098 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eb810b-95b8-4365-8721-46c0ce247b0a service nova] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:09.835379 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eb810b-95b8-4365-8721-46c0ce247b0a service nova] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:09.835654 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58eb810b-95b8-4365-8721-46c0ce247b0a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:09.843601 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58eb810b-95b8-4365-8721-46c0ce247b0a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:39:09.845207 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58eb810b-95b8-4365-8721-46c0ce247b0a service nova] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:39:09.855231 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 767/1527] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:39:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:39:13.977594 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b5c5d-84d5-44dc-906a-2710895950fb None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:13.978155 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b5c5d-84d5-44dc-906a-2710895950fb None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:13.978155 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b5c5d-84d5-44dc-906a-2710895950fb None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:13.979797 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 761/1528] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 2 21:39:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:39:13.985052 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f964e2a-23c6-4fda-91d0-f56477b70837 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:13.985443 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f964e2a-23c6-4fda-91d0-f56477b70837 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:13.985615 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f964e2a-23c6-4fda-91d0-f56477b70837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:14.005549 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-0f964e2a-23c6-4fda-91d0-f56477b70837 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:39:14.006750 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-0f964e2a-23c6-4fda-91d0-f56477b70837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:39:14.014906 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 768/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 2 21:39:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:39:14.087438 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79b5c5d-84d5-44dc-906a-2710895950fb None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:39:14.089191 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-c79b5c5d-84d5-44dc-906a-2710895950fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:39:14.167639 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79b5c5d-84d5-44dc-906a-2710895950fb None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:39:14.171218 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfa1d76-4c3e-4cc6-8c6b-d75e5e1d5531 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '723f5f43572a493dae0349070a2adb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:39:14.171837 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa1d76-4c3e-4cc6-8c6b-d75e5e1d5531 service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:14.172123 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa1d76-4c3e-4cc6-8c6b-d75e5e1d5531 service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:14.172431 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa1d76-4c3e-4cc6-8c6b-d75e5e1d5531 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:14.182304 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfa1d76-4c3e-4cc6-8c6b-d75e5e1d5531 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:39:14.183790 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfa1d76-4c3e-4cc6-8c6b-d75e5e1d5531 service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:39:14.193719 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 762/1530] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:39:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:39:16.200667 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ecd44e-efda-403e-a68c-ef3e373c9d8b None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:16.201286 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ecd44e-efda-403e-a68c-ef3e373c9d8b None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:16.201286 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ecd44e-efda-403e-a68c-ef3e373c9d8b None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:16.202613 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 769/1531] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 2 21:39:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:39:16.207716 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895fb89c-f656-4353-b335-4bc531a5d66a None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:16.208146 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895fb89c-f656-4353-b335-4bc531a5d66a None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:16.208287 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895fb89c-f656-4353-b335-4bc531a5d66a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:16.228006 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-895fb89c-f656-4353-b335-4bc531a5d66a None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:39:16.229245 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-895fb89c-f656-4353-b335-4bc531a5d66a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:39:16.237954 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 763/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 2 21:39:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:39:16.273495 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ecd44e-efda-403e-a68c-ef3e373c9d8b None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:39:16.284774 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ecd44e-efda-403e-a68c-ef3e373c9d8b None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:39:16.288660 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b914b5ef-5077-4f9b-b741-c6ba5817f425 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '723f5f43572a493dae0349070a2adb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:39:16.289302 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b914b5ef-5077-4f9b-b741-c6ba5817f425 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:16.289808 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b914b5ef-5077-4f9b-b741-c6ba5817f425 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:16.290133 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b914b5ef-5077-4f9b-b741-c6ba5817f425 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:16.305435 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b914b5ef-5077-4f9b-b741-c6ba5817f425 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:39:16.306884 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b914b5ef-5077-4f9b-b741-c6ba5817f425 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:39:16.316415 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 770/1533] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:39:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:39:19.885030 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8722cae3-bfee-4031-992d-30fe7b522507 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:19.885571 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8722cae3-bfee-4031-992d-30fe7b522507 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:19.885571 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8722cae3-bfee-4031-992d-30fe7b522507 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:19.886946 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 764/1534] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 2 21:39:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:39:19.892193 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f613be6-ee9a-4469-90b3-957e1de78699 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:19.892621 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f613be6-ee9a-4469-90b3-957e1de78699 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:19.892791 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f613be6-ee9a-4469-90b3-957e1de78699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:19.901039 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=81 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:39:19.914123 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-6f613be6-ee9a-4469-90b3-957e1de78699 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:39:19.915345 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-6f613be6-ee9a-4469-90b3-957e1de78699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:39:19.923132 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 771/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 2 21:39:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:39:20.235783 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8722cae3-bfee-4031-992d-30fe7b522507 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:39:20.237843 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-8722cae3-bfee-4031-992d-30fe7b522507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:39:20.303426 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:39:20.317249 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8722cae3-bfee-4031-992d-30fe7b522507 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:39:20.320855 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d9253a-78ed-4e9e-adbf-2510a6c11c90 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '123eb76f95ee4e39905944da701c712d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:39:20.321472 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d9253a-78ed-4e9e-adbf-2510a6c11c90 service cinder] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:20.321756 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d9253a-78ed-4e9e-adbf-2510a6c11c90 service cinder] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:20.322034 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d9253a-78ed-4e9e-adbf-2510a6c11c90 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:20.331498 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d9253a-78ed-4e9e-adbf-2510a6c11c90 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:39:20.333052 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d9253a-78ed-4e9e-adbf-2510a6c11c90 service cinder] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:39:20.342426 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 765/1536] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:39:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:39:22.364410 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6ceb04-c88d-4564-a50e-81159db51244 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:22.364966 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6ceb04-c88d-4564-a50e-81159db51244 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:22.364966 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6ceb04-c88d-4564-a50e-81159db51244 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:22.366296 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 772/1537] 127.0.0.1 () {54 vars in 916 bytes} [Tue Aug 2 21:39:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:39:22.371717 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c5cff4-ee59-415d-bcec-0aba2eb6b9b3 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:22.372100 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c5cff4-ee59-415d-bcec-0aba2eb6b9b3 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:22.372310 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c5cff4-ee59-415d-bcec-0aba2eb6b9b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:22.394120 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-34c5cff4-ee59-415d-bcec-0aba2eb6b9b3 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:39:22.395359 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-34c5cff4-ee59-415d-bcec-0aba2eb6b9b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:39:22.403287 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 766/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Aug 2 21:39:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:39:22.708726 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6ceb04-c88d-4564-a50e-81159db51244 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:39:22.710426 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-4c6ceb04-c88d-4564-a50e-81159db51244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:39:22.724315 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6ceb04-c88d-4564-a50e-81159db51244 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:39:22.727778 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb9f7e4-909b-46d5-bdee-033a3509368e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '123eb76f95ee4e39905944da701c712d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:39:22.728432 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb9f7e4-909b-46d5-bdee-033a3509368e service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:39:22.728728 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb9f7e4-909b-46d5-bdee-033a3509368e service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:39:22.729005 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb9f7e4-909b-46d5-bdee-033a3509368e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:39:22.738111 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb9f7e4-909b-46d5-bdee-033a3509368e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:39:22.739549 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb9f7e4-909b-46d5-bdee-033a3509368e service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:39:22.749043 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 773/1539] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:39:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:39:32.389397 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=11 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:39:32.744767 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=8 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:40:55.081146 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc68e3d9-c118-4c09-a099-397de3dc7997 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:55.082276 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc68e3d9-c118-4c09-a099-397de3dc7997 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:55.082276 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc68e3d9-c118-4c09-a099-397de3dc7997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:55.105410 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-dc68e3d9-c118-4c09-a099-397de3dc7997 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:40:55.106651 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-dc68e3d9-c118-4c09-a099-397de3dc7997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:55.119031 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 767/1540] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:40:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:40:55.128042 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67c7ed7-541b-4189-b7c4-c84e7645a8c5 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:55.129656 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67c7ed7-541b-4189-b7c4-c84e7645a8c5 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:55.130103 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67c7ed7-541b-4189-b7c4-c84e7645a8c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:55.159124 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-b67c7ed7-541b-4189-b7c4-c84e7645a8c5 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:40:55.160686 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-b67c7ed7-541b-4189-b7c4-c84e7645a8c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:55.172082 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 774/1541] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:40:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:40:55.176881 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc68e3d9-c118-4c09-a099-397de3dc7997 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:55.187221 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc68e3d9-c118-4c09-a099-397de3dc7997 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:55.199265 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2a6901-31e2-4042-b5a3-1a20a4ecb5e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:55.199897 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a6901-31e2-4042-b5a3-1a20a4ecb5e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:55.200181 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a6901-31e2-4042-b5a3-1a20a4ecb5e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:55.200488 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a6901-31e2-4042-b5a3-1a20a4ecb5e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:55.201190 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2a6901-31e2-4042-b5a3-1a20a4ecb5e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:40:55.201497 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2a6901-31e2-4042-b5a3-1a20a4ecb5e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:55.203346 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2a6901-31e2-4042-b5a3-1a20a4ecb5e4 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:55.221936 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 768/1542] 10.222.0.70 () {58 vars in 1153 bytes} [Tue Aug 2 21:40:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:40:55.232326 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67c7ed7-541b-4189-b7c4-c84e7645a8c5 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:55.244280 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67c7ed7-541b-4189-b7c4-c84e7645a8c5 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:55.254720 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9547b15f-1d76-46e9-af44-37d3203d0ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:55.255415 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9547b15f-1d76-46e9-af44-37d3203d0ec7 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:55.255700 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9547b15f-1d76-46e9-af44-37d3203d0ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:55.255974 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9547b15f-1d76-46e9-af44-37d3203d0ec7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:55.256666 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9547b15f-1d76-46e9-af44-37d3203d0ec7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:55.259503 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9547b15f-1d76-46e9-af44-37d3203d0ec7 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:55.325291 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 775/1543] 10.222.0.70 () {60 vars in 1153 bytes} [Tue Aug 2 21:40:55 2022] POST /identity/v3/projects => generated 377 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:40:55.329298 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2a6901-31e2-4042-b5a3-1a20a4ecb5e4 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:55.341899 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2a6901-31e2-4042-b5a3-1a20a4ecb5e4 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:55.351551 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3756e018-85e2-4752-93cd-accd16257375 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:55.351858 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3756e018-85e2-4752-93cd-accd16257375 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:55.352112 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3756e018-85e2-4752-93cd-accd16257375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:55.389319 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-3756e018-85e2-4752-93cd-accd16257375 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:40:55.390545 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-3756e018-85e2-4752-93cd-accd16257375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:55.435324 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02554c5a-ed59-438a-9812-d841b4b9bbd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:55.436096 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02554c5a-ed59-438a-9812-d841b4b9bbd0 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:55.436424 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02554c5a-ed59-438a-9812-d841b4b9bbd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:55.436701 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02554c5a-ed59-438a-9812-d841b4b9bbd0 admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:55.437517 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02554c5a-ed59-438a-9812-d841b4b9bbd0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:55.439473 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02554c5a-ed59-438a-9812-d841b4b9bbd0 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:55.477258 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 769/1544] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 2 21:40:55 2022] POST /identity/v3/users => generated 289 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:40:55.478386 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5f71aa-b71c-49ec-be4f-5065b0f2143c None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:55.478677 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5f71aa-b71c-49ec-be4f-5065b0f2143c None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:55.479214 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5f71aa-b71c-49ec-be4f-5065b0f2143c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:55.506293 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 776/1545] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:40:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:40:55.507159 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3756e018-85e2-4752-93cd-accd16257375 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:55.515386 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-5a5f71aa-b71c-49ec-be4f-5065b0f2143c None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:40:55.516644 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-5a5f71aa-b71c-49ec-be4f-5065b0f2143c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:55.519965 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3756e018-85e2-4752-93cd-accd16257375 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:55.525043 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ba2020-449a-4a58-9254-7d6eda4f236e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:55.525878 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 770/1546] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:40:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:40:55.526008 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ba2020-449a-4a58-9254-7d6eda4f236e admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:55.527839 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ba2020-449a-4a58-9254-7d6eda4f236e admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:55.527839 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ba2020-449a-4a58-9254-7d6eda4f236e admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:55.528034 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c41968-3845-4375-a122-d728e8403c9c None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:55.528034 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c41968-3845-4375-a122-d728e8403c9c None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:55.528187 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ba2020-449a-4a58-9254-7d6eda4f236e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:55.528311 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c41968-3845-4375-a122-d728e8403c9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:55.532007 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ba2020-449a-4a58-9254-7d6eda4f236e admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:55.545279 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 777/1547] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:40:55 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:40:55.546788 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f313f8-8f4b-4de3-9da6-20a02a759877 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:55.547079 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f313f8-8f4b-4de3-9da6-20a02a759877 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:55.547475 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f313f8-8f4b-4de3-9da6-20a02a759877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:55.549529 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-31c41968-3845-4375-a122-d728e8403c9c None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:40:55.551943 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-31c41968-3845-4375-a122-d728e8403c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:55.560302 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 771/1548] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:40:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:40:55.566110 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01963498-a7b5-4a94-ba2f-0ac85f0872e4 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:55.566672 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01963498-a7b5-4a94-ba2f-0ac85f0872e4 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:55.567169 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01963498-a7b5-4a94-ba2f-0ac85f0872e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:55.569276 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-04f313f8-8f4b-4de3-9da6-20a02a759877 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:40:55.570491 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-04f313f8-8f4b-4de3-9da6-20a02a759877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:55.579094 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 778/1549] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:40:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:40:55.580212 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ff007e-0160-41a6-a23e-265e15759e79 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:55.580529 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ff007e-0160-41a6-a23e-265e15759e79 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:55.580808 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ff007e-0160-41a6-a23e-265e15759e79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:55.592620 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-01963498-a7b5-4a94-ba2f-0ac85f0872e4 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:40:55.594114 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-01963498-a7b5-4a94-ba2f-0ac85f0872e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:55.601691 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-f8ff007e-0160-41a6-a23e-265e15759e79 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:40:55.602874 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-f8ff007e-0160-41a6-a23e-265e15759e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:55.604330 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 772/1550] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:40:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:40:55.605750 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc566fae-af61-4599-bceb-e6131d406c1d None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:55.606043 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc566fae-af61-4599-bceb-e6131d406c1d None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:55.606325 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc566fae-af61-4599-bceb-e6131d406c1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:55.611549 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 779/1551] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:40:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:40:55.613898 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1b384b-933a-4266-a8b8-c48f68d22396 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:55.614201 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1b384b-933a-4266-a8b8-c48f68d22396 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:55.614829 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1b384b-933a-4266-a8b8-c48f68d22396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:55.628329 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-dc566fae-af61-4599-bceb-e6131d406c1d None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:40:55.628597 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-dc566fae-af61-4599-bceb-e6131d406c1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:55.634457 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-ab1b384b-933a-4266-a8b8-c48f68d22396 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:40:55.635911 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-ab1b384b-933a-4266-a8b8-c48f68d22396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:55.636721 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 773/1552] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:40:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:40:55.637512 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc566fae-af61-4599-bceb-e6131d406c1d None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:55.647745 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 780/1553] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:40:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:40:55.649057 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10b9efc-ece8-44f7-bfda-0d549312a30b None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:55.649381 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10b9efc-ece8-44f7-bfda-0d549312a30b None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:55.649663 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10b9efc-ece8-44f7-bfda-0d549312a30b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:55.653212 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc566fae-af61-4599-bceb-e6131d406c1d None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:55.657818 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda81ba2-a9ef-49ce-afa8-2b32e9af201e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:55.658430 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda81ba2-a9ef-49ce-afa8-2b32e9af201e admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:55.658715 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda81ba2-a9ef-49ce-afa8-2b32e9af201e admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:55.658991 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda81ba2-a9ef-49ce-afa8-2b32e9af201e admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:55.660262 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda81ba2-a9ef-49ce-afa8-2b32e9af201e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:55.661882 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda81ba2-a9ef-49ce-afa8-2b32e9af201e admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:55.669408 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-f10b9efc-ece8-44f7-bfda-0d549312a30b None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:40:55.670609 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-f10b9efc-ece8-44f7-bfda-0d549312a30b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:55.672024 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 774/1554] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:40:55 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:40:55.673221 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b4c93b-05b5-491f-b8ca-e3099f911cc2 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:55.673503 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b4c93b-05b5-491f-b8ca-e3099f911cc2 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:55.673780 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b4c93b-05b5-491f-b8ca-e3099f911cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:55.679698 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 781/1555] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:40:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:40:55.681046 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261c5380-8162-4aa0-80fe-c7184f0f7dfa None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:55.681333 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261c5380-8162-4aa0-80fe-c7184f0f7dfa None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:55.681618 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261c5380-8162-4aa0-80fe-c7184f0f7dfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:55.695411 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-50b4c93b-05b5-491f-b8ca-e3099f911cc2 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:40:55.696686 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-50b4c93b-05b5-491f-b8ca-e3099f911cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:55.701976 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-261c5380-8162-4aa0-80fe-c7184f0f7dfa None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:40:55.703528 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-261c5380-8162-4aa0-80fe-c7184f0f7dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:55.705928 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 775/1556] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:40:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:40:55.706823 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b4c93b-05b5-491f-b8ca-e3099f911cc2 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:55.711705 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 782/1557] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:40:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:40:55.713023 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef27199-77c4-46f9-8ee5-60e760ec7c0a None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:55.713310 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef27199-77c4-46f9-8ee5-60e760ec7c0a None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:55.713578 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef27199-77c4-46f9-8ee5-60e760ec7c0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:55.716928 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b4c93b-05b5-491f-b8ca-e3099f911cc2 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:55.722637 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867044ab-1572-4d8e-950a-f0fd6fbbdc61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:55.723259 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867044ab-1572-4d8e-950a-f0fd6fbbdc61 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:55.723537 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867044ab-1572-4d8e-950a-f0fd6fbbdc61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:55.723830 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867044ab-1572-4d8e-950a-f0fd6fbbdc61 admin admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:55.724559 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867044ab-1572-4d8e-950a-f0fd6fbbdc61 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:40:55.724862 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867044ab-1572-4d8e-950a-f0fd6fbbdc61 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:55.726467 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867044ab-1572-4d8e-950a-f0fd6fbbdc61 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:55.733914 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-1ef27199-77c4-46f9-8ee5-60e760ec7c0a None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:40:55.735124 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-1ef27199-77c4-46f9-8ee5-60e760ec7c0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:55.739297 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 776/1558] 10.222.0.70 () {58 vars in 1153 bytes} [Tue Aug 2 21:40:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:40:55.741418 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64098dc-8ac6-41d6-85d3-8083992c61da None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:55.741714 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64098dc-8ac6-41d6-85d3-8083992c61da None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:55.741993 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64098dc-8ac6-41d6-85d3-8083992c61da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:55.744276 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 783/1559] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:40:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:40:55.744976 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef27199-77c4-46f9-8ee5-60e760ec7c0a None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:55.754381 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef27199-77c4-46f9-8ee5-60e760ec7c0a None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:55.758993 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db63841e-ed42-44c2-a7b7-66d0f7bf539c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:55.759601 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db63841e-ed42-44c2-a7b7-66d0f7bf539c admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:55.759891 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db63841e-ed42-44c2-a7b7-66d0f7bf539c admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:55.760191 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db63841e-ed42-44c2-a7b7-66d0f7bf539c admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:55.760919 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db63841e-ed42-44c2-a7b7-66d0f7bf539c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:40:55.761227 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db63841e-ed42-44c2-a7b7-66d0f7bf539c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:55.761378 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-f64098dc-8ac6-41d6-85d3-8083992c61da None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:40:55.762243 dv-cinder-851449-4-smb devstack@keystone.service[80419]: WARNING py.warnings [None req-db63841e-ed42-44c2-a7b7-66d0f7bf539c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 02 21:40:55.762243 dv-cinder-851449-4-smb devstack@keystone.service[80419]: warnings.warn(msg) Aug 02 21:40:55.762243 dv-cinder-851449-4-smb devstack@keystone.service[80419]: Aug 02 21:40:55.762575 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-f64098dc-8ac6-41d6-85d3-8083992c61da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:55.763130 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db63841e-ed42-44c2-a7b7-66d0f7bf539c admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:55.771243 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 777/1560] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:40:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:40:55.771808 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64098dc-8ac6-41d6-85d3-8083992c61da None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:55.778173 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 784/1561] 10.222.0.70 () {58 vars in 1153 bytes} [Tue Aug 2 21:40:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:40:55.778854 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db63841e-ed42-44c2-a7b7-66d0f7bf539c admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:55.783844 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64098dc-8ac6-41d6-85d3-8083992c61da None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:55.789266 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14978e4d-80cb-4175-9164-2642c35d9805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:55.789944 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14978e4d-80cb-4175-9164-2642c35d9805 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:55.790258 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14978e4d-80cb-4175-9164-2642c35d9805 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:55.790546 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14978e4d-80cb-4175-9164-2642c35d9805 admin admin] PATH_INFO: `/v3/projects/fb128c47ae8445598a9979588c57381a/users/182daeeee91b4594b4eab1c28cba5067/roles/462e3381a85c42a9959201f9aa122f7c` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:55.794536 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db63841e-ed42-44c2-a7b7-66d0f7bf539c admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:55.799225 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dd893b-5cf1-4dec-9435-58bd57a55a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:55.799854 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dd893b-5cf1-4dec-9435-58bd57a55a16 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:55.800198 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dd893b-5cf1-4dec-9435-58bd57a55a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:55.800513 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dd893b-5cf1-4dec-9435-58bd57a55a16 admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:55.801226 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dd893b-5cf1-4dec-9435-58bd57a55a16 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:40:55.801533 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dd893b-5cf1-4dec-9435-58bd57a55a16 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:55.803127 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dd893b-5cf1-4dec-9435-58bd57a55a16 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:55.805470 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14978e4d-80cb-4175-9164-2642c35d9805 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb128c47ae8445598a9979588c57381a, user_id=182daeeee91b4594b4eab1c28cba5067, role_id=462e3381a85c42a9959201f9aa122f7c)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:55.806505 dv-cinder-851449-4-smb devstack@keystone.service[80420]: WARNING py.warnings [None req-14978e4d-80cb-4175-9164-2642c35d9805 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 02 21:40:55.806505 dv-cinder-851449-4-smb devstack@keystone.service[80420]: warnings.warn(msg) Aug 02 21:40:55.806505 dv-cinder-851449-4-smb devstack@keystone.service[80420]: Aug 02 21:40:55.808522 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14978e4d-80cb-4175-9164-2642c35d9805 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:55.816295 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 785/1562] 10.222.0.70 () {58 vars in 1153 bytes} [Tue Aug 2 21:40:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:40:55.817396 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dd893b-5cf1-4dec-9435-58bd57a55a16 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:55.825988 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 778/1563] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:40:55 2022] PUT /identity/v3/projects/fb128c47ae8445598a9979588c57381a/users/182daeeee91b4594b4eab1c28cba5067/roles/462e3381a85c42a9959201f9aa122f7c => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:40:55.827250 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185b36d2-aa50-4e8f-9cfe-ff03867daadb None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:55.827428 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dd893b-5cf1-4dec-9435-58bd57a55a16 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:55.827545 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185b36d2-aa50-4e8f-9cfe-ff03867daadb None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:55.827806 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185b36d2-aa50-4e8f-9cfe-ff03867daadb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:55.848501 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-185b36d2-aa50-4e8f-9cfe-ff03867daadb None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:40:55.849625 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-185b36d2-aa50-4e8f-9cfe-ff03867daadb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:55.873169 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:40:55.886642 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0326074-6fc5-4eb8-98f9-1a242e3ae2f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:55.887266 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0326074-6fc5-4eb8-98f9-1a242e3ae2f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:55.887555 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0326074-6fc5-4eb8-98f9-1a242e3ae2f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:55.887838 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0326074-6fc5-4eb8-98f9-1a242e3ae2f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:55.888625 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0326074-6fc5-4eb8-98f9-1a242e3ae2f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:40:55.888940 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0326074-6fc5-4eb8-98f9-1a242e3ae2f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:55.889361 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:40:55.890579 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0326074-6fc5-4eb8-98f9-1a242e3ae2f1 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:55.903152 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 786/1564] 10.222.0.70 () {58 vars in 1153 bytes} [Tue Aug 2 21:40:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:40:55.904074 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0326074-6fc5-4eb8-98f9-1a242e3ae2f1 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:55.914405 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0326074-6fc5-4eb8-98f9-1a242e3ae2f1 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:55.917834 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 779/1565] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:40:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:40:55.918744 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185b36d2-aa50-4e8f-9cfe-ff03867daadb None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:55.919358 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a492d7d1-f0e3-4678-89fb-7c7b32c3228c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:55.920137 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a492d7d1-f0e3-4678-89fb-7c7b32c3228c admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:55.920612 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a492d7d1-f0e3-4678-89fb-7c7b32c3228c admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:55.921046 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a492d7d1-f0e3-4678-89fb-7c7b32c3228c admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:55.921879 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a492d7d1-f0e3-4678-89fb-7c7b32c3228c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:55.923991 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a492d7d1-f0e3-4678-89fb-7c7b32c3228c admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:55.928413 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185b36d2-aa50-4e8f-9cfe-ff03867daadb None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:55.933001 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d770fec-2043-4711-b622-89fc9ffbe7dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:55.933594 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d770fec-2043-4711-b622-89fc9ffbe7dd admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:55.933873 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d770fec-2043-4711-b622-89fc9ffbe7dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:55.934146 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d770fec-2043-4711-b622-89fc9ffbe7dd admin admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:55.934835 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d770fec-2043-4711-b622-89fc9ffbe7dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:40:55.935135 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d770fec-2043-4711-b622-89fc9ffbe7dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:55.936756 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d770fec-2043-4711-b622-89fc9ffbe7dd admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:55.949010 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 780/1566] 10.222.0.70 () {58 vars in 1153 bytes} [Tue Aug 2 21:40:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:40:55.949832 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d770fec-2043-4711-b622-89fc9ffbe7dd admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:55.962272 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 787/1567] 10.222.0.70 () {60 vars in 1153 bytes} [Tue Aug 2 21:40:55 2022] POST /identity/v3/projects => generated 409 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:40:55.962272 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a492d7d1-f0e3-4678-89fb-7c7b32c3228c admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:55.962525 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d770fec-2043-4711-b622-89fc9ffbe7dd admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:56.019900 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2137dbe4-ff3c-4f35-bad9-352406e2f261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:56.020556 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2137dbe4-ff3c-4f35-bad9-352406e2f261 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:56.020844 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2137dbe4-ff3c-4f35-bad9-352406e2f261 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:56.021124 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2137dbe4-ff3c-4f35-bad9-352406e2f261 admin admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:56.021515 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a492d7d1-f0e3-4678-89fb-7c7b32c3228c admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:56.021849 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2137dbe4-ff3c-4f35-bad9-352406e2f261 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:40:56.022158 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2137dbe4-ff3c-4f35-bad9-352406e2f261 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:56.023782 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2137dbe4-ff3c-4f35-bad9-352406e2f261 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:56.026467 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e151a0-d25c-4df7-8920-0f3051862f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:56.027091 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e151a0-d25c-4df7-8920-0f3051862f16 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:56.027529 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e151a0-d25c-4df7-8920-0f3051862f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:56.027816 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e151a0-d25c-4df7-8920-0f3051862f16 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:56.028516 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e151a0-d25c-4df7-8920-0f3051862f16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:56.030467 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e151a0-d25c-4df7-8920-0f3051862f16 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:56.036377 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 781/1568] 10.222.0.70 () {58 vars in 1153 bytes} [Tue Aug 2 21:40:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:40:56.041554 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2137dbe4-ff3c-4f35-bad9-352406e2f261 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:56.051897 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2137dbe4-ff3c-4f35-bad9-352406e2f261 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:56.057315 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b783ccd-9760-4af3-b0e5-7cb06461429a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:56.058017 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b783ccd-9760-4af3-b0e5-7cb06461429a admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:56.058245 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b783ccd-9760-4af3-b0e5-7cb06461429a admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:56.058527 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b783ccd-9760-4af3-b0e5-7cb06461429a admin admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:56.059193 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b783ccd-9760-4af3-b0e5-7cb06461429a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:56.060285 dv-cinder-851449-4-smb devstack@keystone.service[80420]: WARNING py.warnings [None req-8b783ccd-9760-4af3-b0e5-7cb06461429a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 02 21:40:56.060285 dv-cinder-851449-4-smb devstack@keystone.service[80420]: warnings.warn(msg) Aug 02 21:40:56.060285 dv-cinder-851449-4-smb devstack@keystone.service[80420]: Aug 02 21:40:56.060525 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 788/1569] 10.222.0.70 () {60 vars in 1153 bytes} [Tue Aug 2 21:40:55 2022] POST /identity/v3/projects => generated 383 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:40:56.061499 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b783ccd-9760-4af3-b0e5-7cb06461429a admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:56.061723 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0818e341-f30b-4c43-990a-185097393372 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:56.061977 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0818e341-f30b-4c43-990a-185097393372 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:56.062256 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0818e341-f30b-4c43-990a-185097393372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:56.082176 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-0818e341-f30b-4c43-990a-185097393372 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:40:56.083393 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-0818e341-f30b-4c43-990a-185097393372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:56.090448 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 782/1570] 10.222.0.70 () {60 vars in 1153 bytes} [Tue Aug 2 21:40:56 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:40:56.091322 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b783ccd-9760-4af3-b0e5-7cb06461429a admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:56.145392 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 789/1571] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:40:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:40:56.146229 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0818e341-f30b-4c43-990a-185097393372 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:56.154814 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b783ccd-9760-4af3-b0e5-7cb06461429a admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:56.155667 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0818e341-f30b-4c43-990a-185097393372 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:56.159668 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31543fca-6acd-4f9a-a8c3-ed092ab9b712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:56.160322 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31543fca-6acd-4f9a-a8c3-ed092ab9b712 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:56.160612 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31543fca-6acd-4f9a-a8c3-ed092ab9b712 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:56.160740 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daa343b-9a4c-4931-989b-cd2a4ea65d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:56.160895 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31543fca-6acd-4f9a-a8c3-ed092ab9b712 admin admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:56.161273 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daa343b-9a4c-4931-989b-cd2a4ea65d10 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:56.161563 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31543fca-6acd-4f9a-a8c3-ed092ab9b712 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:56.161685 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daa343b-9a4c-4931-989b-cd2a4ea65d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:56.161967 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daa343b-9a4c-4931-989b-cd2a4ea65d10 admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:56.162671 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daa343b-9a4c-4931-989b-cd2a4ea65d10 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:40:56.163006 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daa343b-9a4c-4931-989b-cd2a4ea65d10 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:56.163538 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31543fca-6acd-4f9a-a8c3-ed092ab9b712 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:56.164636 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daa343b-9a4c-4931-989b-cd2a4ea65d10 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:56.176805 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 790/1572] 10.222.0.70 () {58 vars in 1153 bytes} [Tue Aug 2 21:40:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:40:56.179649 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daa343b-9a4c-4931-989b-cd2a4ea65d10 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:56.190613 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daa343b-9a4c-4931-989b-cd2a4ea65d10 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:56.193373 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 783/1573] 10.222.0.70 () {60 vars in 1153 bytes} [Tue Aug 2 21:40:56 2022] POST /identity/v3/projects => generated 363 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:40:56.194261 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31543fca-6acd-4f9a-a8c3-ed092ab9b712 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:56.198994 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2443e7a7-a60c-4a2f-b851-2177b24efb16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:56.199606 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2443e7a7-a60c-4a2f-b851-2177b24efb16 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:56.199886 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2443e7a7-a60c-4a2f-b851-2177b24efb16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:56.200164 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2443e7a7-a60c-4a2f-b851-2177b24efb16 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:56.200858 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2443e7a7-a60c-4a2f-b851-2177b24efb16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:56.202782 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2443e7a7-a60c-4a2f-b851-2177b24efb16 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:56.226702 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:40:56.230929 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 791/1574] 10.222.0.70 () {60 vars in 1153 bytes} [Tue Aug 2 21:40:56 2022] POST /identity/v3/projects => generated 377 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:40:56.231780 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2443e7a7-a60c-4a2f-b851-2177b24efb16 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:56.242292 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:40:56.260284 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31543fca-6acd-4f9a-a8c3-ed092ab9b712 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:56.296583 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2443e7a7-a60c-4a2f-b851-2177b24efb16 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:56.301267 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdee5c9-2f3f-4285-ac5e-3e93431921aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:56.301889 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdee5c9-2f3f-4285-ac5e-3e93431921aa admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:56.302176 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdee5c9-2f3f-4285-ac5e-3e93431921aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:56.302453 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdee5c9-2f3f-4285-ac5e-3e93431921aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:56.303122 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdee5c9-2f3f-4285-ac5e-3e93431921aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:56.305071 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdee5c9-2f3f-4285-ac5e-3e93431921aa admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:56.317552 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d34b61-68d2-4cb0-a2de-909fe80f60f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:56.318183 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d34b61-68d2-4cb0-a2de-909fe80f60f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:56.318468 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d34b61-68d2-4cb0-a2de-909fe80f60f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:56.318747 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d34b61-68d2-4cb0-a2de-909fe80f60f7 admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:56.319420 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d34b61-68d2-4cb0-a2de-909fe80f60f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:56.321455 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d34b61-68d2-4cb0-a2de-909fe80f60f7 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:56.332495 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 792/1575] 10.222.0.70 () {60 vars in 1153 bytes} [Tue Aug 2 21:40:56 2022] POST /identity/v3/projects => generated 389 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:40:56.336938 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdee5c9-2f3f-4285-ac5e-3e93431921aa admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:56.345735 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 784/1576] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 2 21:40:56 2022] POST /identity/v3/users => generated 305 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:40:56.345735 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d34b61-68d2-4cb0-a2de-909fe80f60f7 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:56.353396 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d34b61-68d2-4cb0-a2de-909fe80f60f7 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:56.406100 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdee5c9-2f3f-4285-ac5e-3e93431921aa admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:56.410432 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62654f75-5a9e-425c-b275-ac8bd5675551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:56.411067 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62654f75-5a9e-425c-b275-ac8bd5675551 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:56.411228 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6813e579-e6fd-4933-89a8-097e6b098c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:56.411359 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62654f75-5a9e-425c-b275-ac8bd5675551 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:56.411615 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62654f75-5a9e-425c-b275-ac8bd5675551 admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:56.412305 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62654f75-5a9e-425c-b275-ac8bd5675551 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:56.412468 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6813e579-e6fd-4933-89a8-097e6b098c0f admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:56.412753 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6813e579-e6fd-4933-89a8-097e6b098c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:56.413032 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6813e579-e6fd-4933-89a8-097e6b098c0f admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:56.413692 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6813e579-e6fd-4933-89a8-097e6b098c0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:56.414245 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62654f75-5a9e-425c-b275-ac8bd5675551 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:56.414701 dv-cinder-851449-4-smb devstack@keystone.service[80419]: WARNING py.warnings [None req-6813e579-e6fd-4933-89a8-097e6b098c0f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 02 21:40:56.414701 dv-cinder-851449-4-smb devstack@keystone.service[80419]: warnings.warn(msg) Aug 02 21:40:56.414701 dv-cinder-851449-4-smb devstack@keystone.service[80419]: Aug 02 21:40:56.415908 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6813e579-e6fd-4933-89a8-097e6b098c0f admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:56.435344 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 785/1577] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 2 21:40:56 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:40:56.436393 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62654f75-5a9e-425c-b275-ac8bd5675551 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:56.442463 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 793/1578] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 2 21:40:56 2022] POST /identity/v3/users => generated 292 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:40:56.442463 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6813e579-e6fd-4933-89a8-097e6b098c0f admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:56.452536 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6813e579-e6fd-4933-89a8-097e6b098c0f admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:56.457195 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f672e74-e226-4d3c-b76b-872213bebf3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:56.457802 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f672e74-e226-4d3c-b76b-872213bebf3b admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:56.458453 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f672e74-e226-4d3c-b76b-872213bebf3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:56.458937 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f672e74-e226-4d3c-b76b-872213bebf3b admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:56.459765 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f672e74-e226-4d3c-b76b-872213bebf3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:56.461772 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f672e74-e226-4d3c-b76b-872213bebf3b admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:56.490663 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 794/1579] 10.222.0.70 () {60 vars in 1153 bytes} [Tue Aug 2 21:40:56 2022] POST /identity/v3/projects => generated 393 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:40:56.491542 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f672e74-e226-4d3c-b76b-872213bebf3b admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:56.499170 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62654f75-5a9e-425c-b275-ac8bd5675551 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:56.504338 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:40:56.550294 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f92d79a-9b3d-4d67-9dea-fd5958f368ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '723f5f43572a493dae0349070a2adb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:56.551089 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f92d79a-9b3d-4d67-9dea-fd5958f368ec service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:56.551376 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f92d79a-9b3d-4d67-9dea-fd5958f368ec service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:56.551651 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f92d79a-9b3d-4d67-9dea-fd5958f368ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:56.554548 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f672e74-e226-4d3c-b76b-872213bebf3b admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:56.559130 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3df46f6-23de-4260-ad6c-c4ab54b84883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:56.559736 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df46f6-23de-4260-ad6c-c4ab54b84883 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:56.560021 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df46f6-23de-4260-ad6c-c4ab54b84883 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:56.560322 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df46f6-23de-4260-ad6c-c4ab54b84883 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:56.560980 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3df46f6-23de-4260-ad6c-c4ab54b84883 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:56.561303 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f92d79a-9b3d-4d67-9dea-fd5958f368ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:56.562826 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f92d79a-9b3d-4d67-9dea-fd5958f368ec service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:56.562943 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3df46f6-23de-4260-ad6c-c4ab54b84883 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:56.571623 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:40:56.573285 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 786/1580] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:40:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:40:56.573919 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f92d79a-9b3d-4d67-9dea-fd5958f368ec service neutron] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:56.584326 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f92d79a-9b3d-4d67-9dea-fd5958f368ec service neutron] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:56.589658 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb7c8ca-c419-4e48-9732-cb6c3e409245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:56.590278 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb7c8ca-c419-4e48-9732-cb6c3e409245 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:56.590566 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb7c8ca-c419-4e48-9732-cb6c3e409245 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:56.590859 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb7c8ca-c419-4e48-9732-cb6c3e409245 admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:56.591667 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb7c8ca-c419-4e48-9732-cb6c3e409245 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:56.593744 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb7c8ca-c419-4e48-9732-cb6c3e409245 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:56.594692 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 795/1581] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 2 21:40:56 2022] POST /identity/v3/users => generated 282 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:40:56.595342 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3df46f6-23de-4260-ad6c-c4ab54b84883 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:56.609244 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3df46f6-23de-4260-ad6c-c4ab54b84883 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:56.614740 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebb189e-f27b-41b0-9bd8-81c605a8a110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:56.615391 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb189e-f27b-41b0-9bd8-81c605a8a110 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:56.615687 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb189e-f27b-41b0-9bd8-81c605a8a110 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:56.615969 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebb189e-f27b-41b0-9bd8-81c605a8a110 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:56.616663 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebb189e-f27b-41b0-9bd8-81c605a8a110 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:56.618595 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ebb189e-f27b-41b0-9bd8-81c605a8a110 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:56.622730 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 787/1582] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 2 21:40:56 2022] POST /identity/v3/users => generated 289 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:40:56.622730 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb7c8ca-c419-4e48-9732-cb6c3e409245 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:56.632105 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb7c8ca-c419-4e48-9732-cb6c3e409245 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:56.637270 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea6682d-c88b-42f2-979b-b43557cd6e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:56.637874 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea6682d-c88b-42f2-979b-b43557cd6e6c admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:56.638158 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea6682d-c88b-42f2-979b-b43557cd6e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:56.638441 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea6682d-c88b-42f2-979b-b43557cd6e6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:56.639129 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea6682d-c88b-42f2-979b-b43557cd6e6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:56.640757 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea6682d-c88b-42f2-979b-b43557cd6e6c admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:56.645388 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 796/1583] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 2 21:40:56 2022] POST /identity/v3/users => generated 295 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:40:56.645388 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebb189e-f27b-41b0-9bd8-81c605a8a110 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:56.652367 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 788/1584] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:40:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:40:56.653123 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea6682d-c88b-42f2-979b-b43557cd6e6c admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:56.659103 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebb189e-f27b-41b0-9bd8-81c605a8a110 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:56.664472 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea6682d-c88b-42f2-979b-b43557cd6e6c admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:56.666269 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aa3640-e58d-4c40-8973-019c7c99d0e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:56.666914 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aa3640-e58d-4c40-8973-019c7c99d0e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:56.667189 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aa3640-e58d-4c40-8973-019c7c99d0e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:56.667532 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0aa3640-e58d-4c40-8973-019c7c99d0e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:56.668386 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0aa3640-e58d-4c40-8973-019c7c99d0e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:56.669489 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9bda72-8905-4d3c-b29f-9cd7c6325e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:56.670099 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9bda72-8905-4d3c-b29f-9cd7c6325e89 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:56.670236 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0aa3640-e58d-4c40-8973-019c7c99d0e4 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:56.670452 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9bda72-8905-4d3c-b29f-9cd7c6325e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:56.670659 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9bda72-8905-4d3c-b29f-9cd7c6325e89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:56.671327 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9bda72-8905-4d3c-b29f-9cd7c6325e89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:56.673035 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9bda72-8905-4d3c-b29f-9cd7c6325e89 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:56.683555 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 797/1585] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:40:56 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:40:56.684561 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aa3640-e58d-4c40-8973-019c7c99d0e4 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:56.685399 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 789/1586] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:40:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:40:56.686493 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9bda72-8905-4d3c-b29f-9cd7c6325e89 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:56.698110 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9bda72-8905-4d3c-b29f-9cd7c6325e89 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:56.698345 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0aa3640-e58d-4c40-8973-019c7c99d0e4 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:56.702942 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259c0909-de1b-4aa1-82d3-cf936752cef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:56.703106 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f3840b-8790-4e3f-9e38-72495a3ad834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:56.703562 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c0909-de1b-4aa1-82d3-cf936752cef1 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:56.703715 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f3840b-8790-4e3f-9e38-72495a3ad834 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:56.703843 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c0909-de1b-4aa1-82d3-cf936752cef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:56.704117 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f3840b-8790-4e3f-9e38-72495a3ad834 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:56.704265 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259c0909-de1b-4aa1-82d3-cf936752cef1 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:56.704551 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f3840b-8790-4e3f-9e38-72495a3ad834 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:56.704823 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259c0909-de1b-4aa1-82d3-cf936752cef1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:56.705371 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f3840b-8790-4e3f-9e38-72495a3ad834 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:56.707345 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259c0909-de1b-4aa1-82d3-cf936752cef1 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:56.707667 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f3840b-8790-4e3f-9e38-72495a3ad834 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:56.719936 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 790/1587] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:40:56 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:40:56.721046 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f3840b-8790-4e3f-9e38-72495a3ad834 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:56.732168 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f3840b-8790-4e3f-9e38-72495a3ad834 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:56.735878 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 798/1588] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 2 21:40:56 2022] POST /identity/v3/users => generated 297 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:40:56.735878 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259c0909-de1b-4aa1-82d3-cf936752cef1 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:56.739649 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cb1a6e-df95-45d3-9735-637bf110f158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:56.740297 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb1a6e-df95-45d3-9735-637bf110f158 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:56.740586 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb1a6e-df95-45d3-9735-637bf110f158 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:56.740871 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb1a6e-df95-45d3-9735-637bf110f158 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:56.741689 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cb1a6e-df95-45d3-9735-637bf110f158 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:56.743309 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cb1a6e-df95-45d3-9735-637bf110f158 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:56.748288 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259c0909-de1b-4aa1-82d3-cf936752cef1 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:56.754067 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130fa0c2-1406-449a-a682-a0ebe2ff2fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:56.754694 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130fa0c2-1406-449a-a682-a0ebe2ff2fe4 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:56.755057 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130fa0c2-1406-449a-a682-a0ebe2ff2fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:56.755420 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130fa0c2-1406-449a-a682-a0ebe2ff2fe4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:56.755892 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 791/1589] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:40:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:40:56.756770 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cb1a6e-df95-45d3-9735-637bf110f158 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:56.759347 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130fa0c2-1406-449a-a682-a0ebe2ff2fe4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:56.761069 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130fa0c2-1406-449a-a682-a0ebe2ff2fe4 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:56.770628 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cb1a6e-df95-45d3-9735-637bf110f158 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:56.775533 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 799/1590] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:40:56 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:40:56.776484 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130fa0c2-1406-449a-a682-a0ebe2ff2fe4 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:56.781870 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e075b68-6325-4011-9706-8106b4e51749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:56.782686 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e075b68-6325-4011-9706-8106b4e51749 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:56.783036 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e075b68-6325-4011-9706-8106b4e51749 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:56.783307 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e075b68-6325-4011-9706-8106b4e51749 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:56.784061 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e075b68-6325-4011-9706-8106b4e51749 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:56.786474 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e075b68-6325-4011-9706-8106b4e51749 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:56.790388 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130fa0c2-1406-449a-a682-a0ebe2ff2fe4 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:56.797923 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9fb426-5942-4eb2-bf7c-739b9b3cd7d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:56.798634 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9fb426-5942-4eb2-bf7c-739b9b3cd7d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:56.802363 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9fb426-5942-4eb2-bf7c-739b9b3cd7d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:56.802495 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 792/1591] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:40:56 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:40:56.802615 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9fb426-5942-4eb2-bf7c-739b9b3cd7d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:56.802707 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e075b68-6325-4011-9706-8106b4e51749 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:56.802795 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9fb426-5942-4eb2-bf7c-739b9b3cd7d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:56.802795 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9fb426-5942-4eb2-bf7c-739b9b3cd7d5 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:56.816142 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 800/1592] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:40:56 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:40:56.816358 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e075b68-6325-4011-9706-8106b4e51749 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:56.816459 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9fb426-5942-4eb2-bf7c-739b9b3cd7d5 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:56.823323 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecb30c7-9f47-473e-8a49-95301a9e0413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:56.823589 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9fb426-5942-4eb2-bf7c-739b9b3cd7d5 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:56.824224 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecb30c7-9f47-473e-8a49-95301a9e0413 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:56.824484 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecb30c7-9f47-473e-8a49-95301a9e0413 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:56.824761 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecb30c7-9f47-473e-8a49-95301a9e0413 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:56.825459 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecb30c7-9f47-473e-8a49-95301a9e0413 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:56.827073 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecb30c7-9f47-473e-8a49-95301a9e0413 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:56.828126 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3affc9f2-3934-4a65-9938-5434f126b118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:56.828761 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3affc9f2-3934-4a65-9938-5434f126b118 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:56.829041 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3affc9f2-3934-4a65-9938-5434f126b118 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:56.829323 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3affc9f2-3934-4a65-9938-5434f126b118 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:56.830007 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3affc9f2-3934-4a65-9938-5434f126b118 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:56.832131 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3affc9f2-3934-4a65-9938-5434f126b118 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:56.838931 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 793/1593] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:40:56 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:40:56.839542 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecb30c7-9f47-473e-8a49-95301a9e0413 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:56.846670 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 801/1594] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:40:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:40:56.848052 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3affc9f2-3934-4a65-9938-5434f126b118 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:56.854966 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecb30c7-9f47-473e-8a49-95301a9e0413 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:56.858807 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3affc9f2-3934-4a65-9938-5434f126b118 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:56.859601 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658d4f64-731b-45cc-b118-d8d115d7e9ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:56.860315 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658d4f64-731b-45cc-b118-d8d115d7e9ed admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:56.860667 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658d4f64-731b-45cc-b118-d8d115d7e9ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:56.861012 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658d4f64-731b-45cc-b118-d8d115d7e9ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:56.861774 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658d4f64-731b-45cc-b118-d8d115d7e9ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:56.863809 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658d4f64-731b-45cc-b118-d8d115d7e9ed admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:56.864006 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289986d9-5947-41ac-9dcd-bfbaeead09b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:56.864719 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289986d9-5947-41ac-9dcd-bfbaeead09b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:56.865075 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289986d9-5947-41ac-9dcd-bfbaeead09b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:56.865427 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289986d9-5947-41ac-9dcd-bfbaeead09b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:56.866206 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289986d9-5947-41ac-9dcd-bfbaeead09b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:56.867846 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289986d9-5947-41ac-9dcd-bfbaeead09b7 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:56.877037 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 794/1595] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:40:56 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:40:56.877037 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658d4f64-731b-45cc-b118-d8d115d7e9ed admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:56.881522 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 802/1596] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:40:56 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:40:56.882479 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289986d9-5947-41ac-9dcd-bfbaeead09b7 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:56.892919 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289986d9-5947-41ac-9dcd-bfbaeead09b7 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:56.893346 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658d4f64-731b-45cc-b118-d8d115d7e9ed admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:56.898184 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfa69e9-6c09-4a61-8c23-5113d234122e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:56.898914 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfa69e9-6c09-4a61-8c23-5113d234122e admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:56.899029 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac6bcde-72f6-44de-97e0-d41292cec1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:56.899322 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfa69e9-6c09-4a61-8c23-5113d234122e admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:56.899660 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac6bcde-72f6-44de-97e0-d41292cec1f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:56.899791 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfa69e9-6c09-4a61-8c23-5113d234122e admin admin] PATH_INFO: `/v3/projects/eb0068cd9c77401997db1aee81eb28f1/users/777f2873c1c7486da60dc472815a551b/roles/462e3381a85c42a9959201f9aa122f7c` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:56.900203 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac6bcde-72f6-44de-97e0-d41292cec1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:56.900515 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac6bcde-72f6-44de-97e0-d41292cec1f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:56.901236 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac6bcde-72f6-44de-97e0-d41292cec1f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:56.902848 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac6bcde-72f6-44de-97e0-d41292cec1f5 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:56.914132 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 795/1597] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:40:56 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:40:56.914702 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac6bcde-72f6-44de-97e0-d41292cec1f5 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:56.918675 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfa69e9-6c09-4a61-8c23-5113d234122e admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb0068cd9c77401997db1aee81eb28f1, user_id=777f2873c1c7486da60dc472815a551b, role_id=462e3381a85c42a9959201f9aa122f7c)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:56.921484 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfa69e9-6c09-4a61-8c23-5113d234122e admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:56.925627 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac6bcde-72f6-44de-97e0-d41292cec1f5 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:56.931508 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6566fe59-60ee-4b33-a724-f84cff223bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:56.932197 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6566fe59-60ee-4b33-a724-f84cff223bca admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:56.932500 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6566fe59-60ee-4b33-a724-f84cff223bca admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:56.932775 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6566fe59-60ee-4b33-a724-f84cff223bca admin admin] PATH_INFO: `/v3/projects/2a201dc7be3a4ba2a01b97d88aad7ebb/users/0fcff7222f6e49f8958263a73347dd5f/roles/462e3381a85c42a9959201f9aa122f7c` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:56.938588 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 803/1598] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:40:56 2022] PUT /identity/v3/projects/eb0068cd9c77401997db1aee81eb28f1/users/777f2873c1c7486da60dc472815a551b/roles/462e3381a85c42a9959201f9aa122f7c => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:40:56.939405 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfa69e9-6c09-4a61-8c23-5113d234122e admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:56.959591 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6566fe59-60ee-4b33-a724-f84cff223bca admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a201dc7be3a4ba2a01b97d88aad7ebb, user_id=0fcff7222f6e49f8958263a73347dd5f, role_id=462e3381a85c42a9959201f9aa122f7c)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:56.962584 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6566fe59-60ee-4b33-a724-f84cff223bca admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:56.990478 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 796/1599] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:40:56 2022] PUT /identity/v3/projects/2a201dc7be3a4ba2a01b97d88aad7ebb/users/0fcff7222f6e49f8958263a73347dd5f/roles/462e3381a85c42a9959201f9aa122f7c => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:40:56.990478 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6566fe59-60ee-4b33-a724-f84cff223bca admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:57.041436 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfa69e9-6c09-4a61-8c23-5113d234122e admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:57.046903 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:40:57.071593 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6566fe59-60ee-4b33-a724-f84cff223bca admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:57.077561 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48966dfa-0a86-46ea-958f-e2d81d4250ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:57.078481 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48966dfa-0a86-46ea-958f-e2d81d4250ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:57.078850 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48966dfa-0a86-46ea-958f-e2d81d4250ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:57.079207 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48966dfa-0a86-46ea-958f-e2d81d4250ef admin admin] PATH_INFO: `/v3/projects/1d3bee99dcd6425ba29be1d30ab74381/users/edd9b5d5e0b5450ea218d438c69e7fe0/roles/462e3381a85c42a9959201f9aa122f7c` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:57.098355 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48966dfa-0a86-46ea-958f-e2d81d4250ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d3bee99dcd6425ba29be1d30ab74381, user_id=edd9b5d5e0b5450ea218d438c69e7fe0, role_id=462e3381a85c42a9959201f9aa122f7c)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:57.101246 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48966dfa-0a86-46ea-958f-e2d81d4250ef admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:57.103172 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:INSERT=9,keystone:SELECT=91 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:40:57.118668 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 797/1600] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:40:56 2022] PUT /identity/v3/projects/1d3bee99dcd6425ba29be1d30ab74381/users/edd9b5d5e0b5450ea218d438c69e7fe0/roles/462e3381a85c42a9959201f9aa122f7c => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:40:57.128896 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536fe24f-30af-4886-93b6-1a446ed8522a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:57.129597 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536fe24f-30af-4886-93b6-1a446ed8522a admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:57.129885 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536fe24f-30af-4886-93b6-1a446ed8522a admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:57.130499 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536fe24f-30af-4886-93b6-1a446ed8522a admin admin] PATH_INFO: `/v3/projects/9fe85fcf38a14b68956d95e9ed0117da/users/54c59604553a491b9276bd45b3a2f6cf/roles/462e3381a85c42a9959201f9aa122f7c` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:57.130782 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48966dfa-0a86-46ea-958f-e2d81d4250ef admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:57.148355 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536fe24f-30af-4886-93b6-1a446ed8522a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fe85fcf38a14b68956d95e9ed0117da, user_id=54c59604553a491b9276bd45b3a2f6cf, role_id=462e3381a85c42a9959201f9aa122f7c)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:57.151440 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536fe24f-30af-4886-93b6-1a446ed8522a admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:57.165964 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 804/1601] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:40:56 2022] PUT /identity/v3/projects/9fe85fcf38a14b68956d95e9ed0117da/users/54c59604553a491b9276bd45b3a2f6cf/roles/462e3381a85c42a9959201f9aa122f7c => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:40:57.167347 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536fe24f-30af-4886-93b6-1a446ed8522a admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:57.210646 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48966dfa-0a86-46ea-958f-e2d81d4250ef admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:57.232097 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536fe24f-30af-4886-93b6-1a446ed8522a admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:57.239218 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc97b16f-1534-4706-8580-39782eaa8f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:57.240163 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc97b16f-1534-4706-8580-39782eaa8f38 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:57.240690 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc97b16f-1534-4706-8580-39782eaa8f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:57.241185 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc97b16f-1534-4706-8580-39782eaa8f38 admin admin] PATH_INFO: `/v3/projects/e07b172de67a409999c56738925838e1/users/2dc6150d8d9e41b596246f282ab9ac34/roles/462e3381a85c42a9959201f9aa122f7c` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:57.259701 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc97b16f-1534-4706-8580-39782eaa8f38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e07b172de67a409999c56738925838e1, user_id=2dc6150d8d9e41b596246f282ab9ac34, role_id=462e3381a85c42a9959201f9aa122f7c)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:57.262772 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc97b16f-1534-4706-8580-39782eaa8f38 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:57.270352 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d1479b-a499-492d-b7cc-81edce0b6c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:57.270996 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d1479b-a499-492d-b7cc-81edce0b6c27 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:57.271367 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d1479b-a499-492d-b7cc-81edce0b6c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:57.271701 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d1479b-a499-492d-b7cc-81edce0b6c27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:57.272400 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d1479b-a499-492d-b7cc-81edce0b6c27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:57.274086 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d1479b-a499-492d-b7cc-81edce0b6c27 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:57.281423 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 805/1602] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:40:57 2022] PUT /identity/v3/projects/e07b172de67a409999c56738925838e1/users/2dc6150d8d9e41b596246f282ab9ac34/roles/462e3381a85c42a9959201f9aa122f7c => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:40:57.285770 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 798/1603] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:40:57 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:40:57.285905 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d1479b-a499-492d-b7cc-81edce0b6c27 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:57.288729 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c783fdaa-fc7e-4a72-80df-28b8c5ac3221 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:57.296002 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c783fdaa-fc7e-4a72-80df-28b8c5ac3221 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:57.296673 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c783fdaa-fc7e-4a72-80df-28b8c5ac3221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:57.299221 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d1479b-a499-492d-b7cc-81edce0b6c27 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:57.343537 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-c783fdaa-fc7e-4a72-80df-28b8c5ac3221 None None] MFA Rules not processed for user `777f2873c1c7486da60dc472815a551b`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:40:57.344762 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-c783fdaa-fc7e-4a72-80df-28b8c5ac3221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:57.384771 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2f9e33-b37d-4c68-a2c7-3e74503b4831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:57.385519 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2f9e33-b37d-4c68-a2c7-3e74503b4831 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:57.386266 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2f9e33-b37d-4c68-a2c7-3e74503b4831 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:57.386608 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2f9e33-b37d-4c68-a2c7-3e74503b4831 admin admin] PATH_INFO: `/v3/projects/92ec84ceff494de79b4c58e98e88cddd/users/05fc0253234e42e7acbcc2f0959ac0db/roles/462e3381a85c42a9959201f9aa122f7c` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:57.403122 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:40:57.407378 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2f9e33-b37d-4c68-a2c7-3e74503b4831 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92ec84ceff494de79b4c58e98e88cddd, user_id=05fc0253234e42e7acbcc2f0959ac0db, role_id=462e3381a85c42a9959201f9aa122f7c)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:57.413044 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2f9e33-b37d-4c68-a2c7-3e74503b4831 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:57.432939 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 806/1604] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:40:57 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:40:57.434293 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee611a93-e324-4765-a263-e8f09953f6e4 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:57.434585 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee611a93-e324-4765-a263-e8f09953f6e4 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:57.434866 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee611a93-e324-4765-a263-e8f09953f6e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:57.439437 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 799/1605] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:40:57 2022] PUT /identity/v3/projects/92ec84ceff494de79b4c58e98e88cddd/users/05fc0253234e42e7acbcc2f0959ac0db/roles/462e3381a85c42a9959201f9aa122f7c => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:40:57.442814 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6acae9c-07a0-48c7-9d6c-9b1a2ae5927d None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:57.443151 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6acae9c-07a0-48c7-9d6c-9b1a2ae5927d None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:57.443427 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6acae9c-07a0-48c7-9d6c-9b1a2ae5927d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:57.485689 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-ee611a93-e324-4765-a263-e8f09953f6e4 None None] MFA Rules not processed for user `0fcff7222f6e49f8958263a73347dd5f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:40:57.486777 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-ee611a93-e324-4765-a263-e8f09953f6e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:57.489334 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-c6acae9c-07a0-48c7-9d6c-9b1a2ae5927d None None] MFA Rules not processed for user `edd9b5d5e0b5450ea218d438c69e7fe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:40:57.490613 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-c6acae9c-07a0-48c7-9d6c-9b1a2ae5927d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:57.534868 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:40:57.583114 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 800/1606] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:40:57 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:40:57.584823 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a3ed46-f1e2-4819-99c1-82e7aec127bd None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:57.585280 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a3ed46-f1e2-4819-99c1-82e7aec127bd None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:57.585873 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a3ed46-f1e2-4819-99c1-82e7aec127bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:57.593373 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 807/1607] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:40:57 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:40:57.594835 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872a4b3e-1c3c-4551-a924-b15a1a62e94d None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:57.595187 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872a4b3e-1c3c-4551-a924-b15a1a62e94d None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:57.595473 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872a4b3e-1c3c-4551-a924-b15a1a62e94d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:57.608330 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-06a3ed46-f1e2-4819-99c1-82e7aec127bd None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:40:57.609905 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-06a3ed46-f1e2-4819-99c1-82e7aec127bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:57.650634 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-872a4b3e-1c3c-4551-a924-b15a1a62e94d None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:40:57.653618 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-872a4b3e-1c3c-4551-a924-b15a1a62e94d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:57.685142 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 801/1608] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:40:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:40:57.685963 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a3ed46-f1e2-4819-99c1-82e7aec127bd None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:57.699687 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a3ed46-f1e2-4819-99c1-82e7aec127bd None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:57.706599 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869c913e-1e86-45fb-b14c-c2ca9f04ceb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:57.707403 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c913e-1e86-45fb-b14c-c2ca9f04ceb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:57.707747 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c913e-1e86-45fb-b14c-c2ca9f04ceb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:57.708163 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c913e-1e86-45fb-b14c-c2ca9f04ceb0 admin admin] PATH_INFO: `/v3/projects/b845596f9c074dc0ab26374cb98a5665/users/3081e110cdd94b8aa51f7bb237aec635/roles/462e3381a85c42a9959201f9aa122f7c` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:57.727372 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869c913e-1e86-45fb-b14c-c2ca9f04ceb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b845596f9c074dc0ab26374cb98a5665, user_id=3081e110cdd94b8aa51f7bb237aec635, role_id=462e3381a85c42a9959201f9aa122f7c)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:57.730486 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869c913e-1e86-45fb-b14c-c2ca9f04ceb0 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:57.746075 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 808/1609] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:40:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:40:57.747163 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872a4b3e-1c3c-4551-a924-b15a1a62e94d None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:57.747957 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 802/1610] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:40:57 2022] PUT /identity/v3/projects/b845596f9c074dc0ab26374cb98a5665/users/3081e110cdd94b8aa51f7bb237aec635/roles/462e3381a85c42a9959201f9aa122f7c => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:40:57.749398 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c89610-8e42-454c-829f-cef2d927d3cc None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:57.749743 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c89610-8e42-454c-829f-cef2d927d3cc None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:57.750118 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c89610-8e42-454c-829f-cef2d927d3cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:57.759048 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872a4b3e-1c3c-4551-a924-b15a1a62e94d None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:57.776667 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-b0c89610-8e42-454c-829f-cef2d927d3cc None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:40:57.777940 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-b0c89610-8e42-454c-829f-cef2d927d3cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:57.824077 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2bd85c-01eb-4083-afb7-ec0bc3bb1160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:57.825214 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2bd85c-01eb-4083-afb7-ec0bc3bb1160 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:57.825598 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2bd85c-01eb-4083-afb7-ec0bc3bb1160 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:57.825985 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2bd85c-01eb-4083-afb7-ec0bc3bb1160 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:57.826828 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2bd85c-01eb-4083-afb7-ec0bc3bb1160 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:57.828918 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2bd85c-01eb-4083-afb7-ec0bc3bb1160 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:57.857540 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:40:57.864598 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 809/1611] 10.222.0.70 () {60 vars in 1153 bytes} [Tue Aug 2 21:40:57 2022] POST /identity/v3/projects => generated 409 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:40:57.869620 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2bd85c-01eb-4083-afb7-ec0bc3bb1160 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:57.870517 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 803/1612] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:40:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:40:57.872511 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1686da-03cf-4907-ba44-4c3336d93d32 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:57.872963 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1686da-03cf-4907-ba44-4c3336d93d32 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:57.873391 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1686da-03cf-4907-ba44-4c3336d93d32 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:57.880352 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 804/1613] 10.222.0.70 () {54 vars in 962 bytes} [Tue Aug 2 21:40:57 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:40:57.881954 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1686da-03cf-4907-ba44-4c3336d93d32 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:57.884553 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-6d1686da-03cf-4907-ba44-4c3336d93d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:57.961106 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:40:57.968887 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2bd85c-01eb-4083-afb7-ec0bc3bb1160 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:57.978661 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1686da-03cf-4907-ba44-4c3336d93d32 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:57.979341 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a6659e-8910-4fb1-a8d3-cc9117f055df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:57.980068 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a6659e-8910-4fb1-a8d3-cc9117f055df admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:57.980484 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a6659e-8910-4fb1-a8d3-cc9117f055df admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:57.980987 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a6659e-8910-4fb1-a8d3-cc9117f055df admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:57.981994 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a6659e-8910-4fb1-a8d3-cc9117f055df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:57.984199 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a6659e-8910-4fb1-a8d3-cc9117f055df admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:57.984367 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250737ba-8596-4b28-a22b-5c518b6d4a5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '723f5f43572a493dae0349070a2adb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:57.985045 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250737ba-8596-4b28-a22b-5c518b6d4a5a service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:57.985510 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250737ba-8596-4b28-a22b-5c518b6d4a5a service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:57.985804 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250737ba-8596-4b28-a22b-5c518b6d4a5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:57.999249 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250737ba-8596-4b28-a22b-5c518b6d4a5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:58.000885 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250737ba-8596-4b28-a22b-5c518b6d4a5a service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:58.026127 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 805/1614] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:40:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:40:58.028560 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1b7739-0715-46de-9e51-7256072784ed None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:58.028880 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1b7739-0715-46de-9e51-7256072784ed None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:58.029165 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1b7739-0715-46de-9e51-7256072784ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:58.036218 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 810/1615] 10.222.0.70 () {60 vars in 1153 bytes} [Tue Aug 2 21:40:57 2022] POST /identity/v3/projects => generated 365 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:40:58.042431 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a6659e-8910-4fb1-a8d3-cc9117f055df admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:58.075917 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-0b1b7739-0715-46de-9e51-7256072784ed None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:40:58.078791 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-0b1b7739-0715-46de-9e51-7256072784ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:58.158542 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 806/1616] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:40:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:40:58.159523 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1b7739-0715-46de-9e51-7256072784ed None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:58.165685 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a6659e-8910-4fb1-a8d3-cc9117f055df admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:58.171694 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1b7739-0715-46de-9e51-7256072784ed None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:58.172326 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2878ad-ec3d-4f7d-929f-1be6817c53d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '723f5f43572a493dae0349070a2adb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:58.175593 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2878ad-ec3d-4f7d-929f-1be6817c53d9 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:58.175877 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2878ad-ec3d-4f7d-929f-1be6817c53d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:58.176328 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2878ad-ec3d-4f7d-929f-1be6817c53d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:58.177833 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6ba5a7-51c6-435c-91af-42805770af5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:58.178531 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ba5a7-51c6-435c-91af-42805770af5e admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:58.179767 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ba5a7-51c6-435c-91af-42805770af5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:58.180388 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6ba5a7-51c6-435c-91af-42805770af5e admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:58.181087 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6ba5a7-51c6-435c-91af-42805770af5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:58.186609 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6ba5a7-51c6-435c-91af-42805770af5e admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:58.190396 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2878ad-ec3d-4f7d-929f-1be6817c53d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:58.191977 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2878ad-ec3d-4f7d-929f-1be6817c53d9 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:58.213779 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 811/1617] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:40:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:40:58.215050 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434377c1-3c7f-429d-b2ff-641fa2b75d45 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:58.215345 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434377c1-3c7f-429d-b2ff-641fa2b75d45 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:58.215592 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434377c1-3c7f-429d-b2ff-641fa2b75d45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:58.230514 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 807/1618] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 2 21:40:58 2022] POST /identity/v3/users => generated 311 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:40:58.231621 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6ba5a7-51c6-435c-91af-42805770af5e admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:58.252378 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6ba5a7-51c6-435c-91af-42805770af5e admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:58.261268 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad752b5b-4fd7-4422-93ed-aba3d3fe5fef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '723f5f43572a493dae0349070a2adb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:58.261920 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad752b5b-4fd7-4422-93ed-aba3d3fe5fef service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:58.262184 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad752b5b-4fd7-4422-93ed-aba3d3fe5fef service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:58.262458 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad752b5b-4fd7-4422-93ed-aba3d3fe5fef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:58.290021 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad752b5b-4fd7-4422-93ed-aba3d3fe5fef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:58.297075 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad752b5b-4fd7-4422-93ed-aba3d3fe5fef service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:58.304473 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-434377c1-3c7f-429d-b2ff-641fa2b75d45 None None] MFA Rules not processed for user `87dd5c1c5e854d4b96e0b7dad6aa3719`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:40:58.306390 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-434377c1-3c7f-429d-b2ff-641fa2b75d45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:58.322532 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 808/1619] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:40:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:40:58.323075 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad752b5b-4fd7-4422-93ed-aba3d3fe5fef service neutron] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:58.357791 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad752b5b-4fd7-4422-93ed-aba3d3fe5fef service neutron] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:58.365289 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9fe01d-7383-44e1-9ace-5c9697a1d0da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:58.365289 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9fe01d-7383-44e1-9ace-5c9697a1d0da admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:58.365289 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9fe01d-7383-44e1-9ace-5c9697a1d0da admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:58.365948 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9fe01d-7383-44e1-9ace-5c9697a1d0da admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:58.366649 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9fe01d-7383-44e1-9ace-5c9697a1d0da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:58.369389 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9fe01d-7383-44e1-9ace-5c9697a1d0da admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:58.405514 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 809/1620] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 2 21:40:58 2022] POST /identity/v3/users => generated 289 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:40:58.405514 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9fe01d-7383-44e1-9ace-5c9697a1d0da admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:58.420088 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9fe01d-7383-44e1-9ace-5c9697a1d0da admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:58.425908 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88629fb-7f98-4c32-b080-dd362ecd2282 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '723f5f43572a493dae0349070a2adb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:58.426632 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88629fb-7f98-4c32-b080-dd362ecd2282 service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:58.426920 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88629fb-7f98-4c32-b080-dd362ecd2282 service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:58.427202 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88629fb-7f98-4c32-b080-dd362ecd2282 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:58.438391 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88629fb-7f98-4c32-b080-dd362ecd2282 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:58.440024 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88629fb-7f98-4c32-b080-dd362ecd2282 service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:58.442313 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 812/1621] 10.222.0.70 () {58 vars in 1059 bytes} [Tue Aug 2 21:40:58 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:40:58.443268 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434377c1-3c7f-429d-b2ff-641fa2b75d45 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:58.457268 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434377c1-3c7f-429d-b2ff-641fa2b75d45 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:58.457811 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 810/1622] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:40:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:40:58.458856 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88629fb-7f98-4c32-b080-dd362ecd2282 service neutron] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:58.468078 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25598fee-27ec-42f6-a800-46b60b118098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:58.468831 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25598fee-27ec-42f6-a800-46b60b118098 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:58.469600 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88629fb-7f98-4c32-b080-dd362ecd2282 service neutron] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:58.469885 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25598fee-27ec-42f6-a800-46b60b118098 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:58.470854 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25598fee-27ec-42f6-a800-46b60b118098 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:58.473889 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25598fee-27ec-42f6-a800-46b60b118098 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:58.475170 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1358dd9e-1e5e-4a12-ad81-bb682e420435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:58.476285 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1358dd9e-1e5e-4a12-ad81-bb682e420435 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:58.476285 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1358dd9e-1e5e-4a12-ad81-bb682e420435 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:58.476852 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1358dd9e-1e5e-4a12-ad81-bb682e420435 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:58.477786 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25598fee-27ec-42f6-a800-46b60b118098 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:58.478303 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1358dd9e-1e5e-4a12-ad81-bb682e420435 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:58.483057 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1358dd9e-1e5e-4a12-ad81-bb682e420435 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:58.492977 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 813/1623] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:40:58 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:40:58.494043 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25598fee-27ec-42f6-a800-46b60b118098 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:58.511184 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 811/1624] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:40:58 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:40:58.512628 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1358dd9e-1e5e-4a12-ad81-bb682e420435 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:58.524053 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25598fee-27ec-42f6-a800-46b60b118098 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:58.533536 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1358dd9e-1e5e-4a12-ad81-bb682e420435 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:58.536225 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432bb4d2-6f98-445b-b886-eff1a49d07f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87dd5c1c5e854d4b96e0b7dad6aa3719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:58.537445 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432bb4d2-6f98-445b-b886-eff1a49d07f8 service nova] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:58.537749 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432bb4d2-6f98-445b-b886-eff1a49d07f8 service nova] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:58.538028 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432bb4d2-6f98-445b-b886-eff1a49d07f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:58.544131 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2989b31-b493-4670-8dfa-bff0f646407b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:58.546617 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2989b31-b493-4670-8dfa-bff0f646407b admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:58.546883 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2989b31-b493-4670-8dfa-bff0f646407b admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:58.547209 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2989b31-b493-4670-8dfa-bff0f646407b admin admin] PATH_INFO: `/v3/projects/03598416026b4767afa26895a859a619/users/476f30417e6f4e6ca2087012fb86b48e/roles/3e32dbf75f9b41f5adb9fe59851267bb` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:58.612163 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2989b31-b493-4670-8dfa-bff0f646407b admin admin] RBAC: Authorizing `identity:create_grant(project_id=03598416026b4767afa26895a859a619, user_id=476f30417e6f4e6ca2087012fb86b48e, role_id=3e32dbf75f9b41f5adb9fe59851267bb)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:58.612163 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2989b31-b493-4670-8dfa-bff0f646407b admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:58.675470 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 812/1625] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:40:58 2022] PUT /identity/v3/projects/03598416026b4767afa26895a859a619/users/476f30417e6f4e6ca2087012fb86b48e/roles/3e32dbf75f9b41f5adb9fe59851267bb => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:40:58.676608 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2989b31-b493-4670-8dfa-bff0f646407b admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:58.690174 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:40:58.695680 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:40:58.744928 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432bb4d2-6f98-445b-b886-eff1a49d07f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:58.749433 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432bb4d2-6f98-445b-b886-eff1a49d07f8 service nova] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:58.778279 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 814/1626] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:40:58 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:40:58.781022 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432bb4d2-6f98-445b-b886-eff1a49d07f8 service nova] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:58.795012 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2989b31-b493-4670-8dfa-bff0f646407b admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:58.801111 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96944c1f-8dc8-4aa8-b9fc-571b3206ed71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:58.801965 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96944c1f-8dc8-4aa8-b9fc-571b3206ed71 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:58.802090 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432bb4d2-6f98-445b-b886-eff1a49d07f8 service nova] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:58.802290 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96944c1f-8dc8-4aa8-b9fc-571b3206ed71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:58.802522 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96944c1f-8dc8-4aa8-b9fc-571b3206ed71 admin admin] PATH_INFO: `/v3/projects/b8499ff9a9c446c9b5875a5a25946ede/users/bfe755c55fbb4205a274b5427fbe170f/roles/3e32dbf75f9b41f5adb9fe59851267bb` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:58.817648 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcd80e5-c0ce-4c6c-a802-070384aaa655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:58.818215 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd80e5-c0ce-4c6c-a802-070384aaa655 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:58.818500 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd80e5-c0ce-4c6c-a802-070384aaa655 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:58.818780 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd80e5-c0ce-4c6c-a802-070384aaa655 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:58.819486 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcd80e5-c0ce-4c6c-a802-070384aaa655 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:58.819899 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96944c1f-8dc8-4aa8-b9fc-571b3206ed71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8499ff9a9c446c9b5875a5a25946ede, user_id=bfe755c55fbb4205a274b5427fbe170f, role_id=3e32dbf75f9b41f5adb9fe59851267bb)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:58.821149 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcd80e5-c0ce-4c6c-a802-070384aaa655 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:58.822622 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96944c1f-8dc8-4aa8-b9fc-571b3206ed71 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:58.844051 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 813/1627] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:40:58 2022] PUT /identity/v3/projects/b8499ff9a9c446c9b5875a5a25946ede/users/bfe755c55fbb4205a274b5427fbe170f/roles/3e32dbf75f9b41f5adb9fe59851267bb => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:40:58.844743 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 815/1628] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:40:58 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:40:58.849611 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96944c1f-8dc8-4aa8-b9fc-571b3206ed71 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:58.854029 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcd80e5-c0ce-4c6c-a802-070384aaa655 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:58.879746 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcd80e5-c0ce-4c6c-a802-070384aaa655 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:59.002277 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96944c1f-8dc8-4aa8-b9fc-571b3206ed71 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:59.015964 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc0aed3-645d-42ca-95ef-4567e367b90c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:59.017186 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc0aed3-645d-42ca-95ef-4567e367b90c admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:59.017718 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc0aed3-645d-42ca-95ef-4567e367b90c admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:59.019382 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc0aed3-645d-42ca-95ef-4567e367b90c admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:59.020354 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc0aed3-645d-42ca-95ef-4567e367b90c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:59.022459 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc0aed3-645d-42ca-95ef-4567e367b90c admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:59.030487 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f0bfd4-8889-4339-9638-01ecc9e7e64e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:59.031383 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f0bfd4-8889-4339-9638-01ecc9e7e64e admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:59.031736 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f0bfd4-8889-4339-9638-01ecc9e7e64e admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:59.031940 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f0bfd4-8889-4339-9638-01ecc9e7e64e admin admin] PATH_INFO: `/v3/projects/03598416026b4767afa26895a859a619/users/476f30417e6f4e6ca2087012fb86b48e/roles/3e32dbf75f9b41f5adb9fe59851267bb` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:59.045568 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f0bfd4-8889-4339-9638-01ecc9e7e64e admin admin] RBAC: Authorizing `identity:create_grant(project_id=03598416026b4767afa26895a859a619, user_id=476f30417e6f4e6ca2087012fb86b48e, role_id=3e32dbf75f9b41f5adb9fe59851267bb)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:59.049666 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 814/1629] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:40:58 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:40:59.049835 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f0bfd4-8889-4339-9638-01ecc9e7e64e admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:59.051154 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc0aed3-645d-42ca-95ef-4567e367b90c admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:59.063797 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc0aed3-645d-42ca-95ef-4567e367b90c admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:59.067994 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 816/1630] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:40:58 2022] PUT /identity/v3/projects/03598416026b4767afa26895a859a619/users/476f30417e6f4e6ca2087012fb86b48e/roles/3e32dbf75f9b41f5adb9fe59851267bb => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:40:59.081961 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd8079-62e5-4e01-97b2-b3187b1fe5b2 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:59.081961 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd8079-62e5-4e01-97b2-b3187b1fe5b2 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:59.082305 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bd8079-62e5-4e01-97b2-b3187b1fe5b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:59.137546 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-16bd8079-62e5-4e01-97b2-b3187b1fe5b2 None None] MFA Rules not processed for user `476f30417e6f4e6ca2087012fb86b48e`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:40:59.139101 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-16bd8079-62e5-4e01-97b2-b3187b1fe5b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:59.187664 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df53c90b-4446-4e41-99ac-651202d496af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:59.190081 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df53c90b-4446-4e41-99ac-651202d496af admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:59.190528 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df53c90b-4446-4e41-99ac-651202d496af admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:59.191465 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df53c90b-4446-4e41-99ac-651202d496af admin admin] PATH_INFO: `/v3/projects/b8499ff9a9c446c9b5875a5a25946ede/users/bfe755c55fbb4205a274b5427fbe170f/roles/3e32dbf75f9b41f5adb9fe59851267bb` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:59.196095 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df53c90b-4446-4e41-99ac-651202d496af admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8499ff9a9c446c9b5875a5a25946ede, user_id=bfe755c55fbb4205a274b5427fbe170f, role_id=3e32dbf75f9b41f5adb9fe59851267bb)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:59.203094 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df53c90b-4446-4e41-99ac-651202d496af admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:59.238006 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 815/1631] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:40:59 2022] PUT /identity/v3/projects/b8499ff9a9c446c9b5875a5a25946ede/users/bfe755c55fbb4205a274b5427fbe170f/roles/3e32dbf75f9b41f5adb9fe59851267bb => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:40:59.239302 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 817/1632] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:40:59 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:40:59.240010 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134df183-fa64-4054-bd22-52a4920cebe3 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:59.240471 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134df183-fa64-4054-bd22-52a4920cebe3 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:59.240845 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134df183-fa64-4054-bd22-52a4920cebe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:59.252422 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bd8079-62e5-4e01-97b2-b3187b1fe5b2 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:59.312031 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-134df183-fa64-4054-bd22-52a4920cebe3 None None] MFA Rules not processed for user `bfe755c55fbb4205a274b5427fbe170f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:40:59.315418 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-134df183-fa64-4054-bd22-52a4920cebe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:59.339114 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:40:59.363901 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bd8079-62e5-4e01-97b2-b3187b1fe5b2 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:59.385940 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:40:59.458895 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 816/1633] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:40:59 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:40:59.460407 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc04330-309c-4e60-8216-098d28d2c0dc None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:59.460700 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc04330-309c-4e60-8216-098d28d2c0dc None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:59.460982 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc04330-309c-4e60-8216-098d28d2c0dc None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:59.467030 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 817/1634] 10.222.0.70 () {54 vars in 912 bytes} [Tue Aug 2 21:40:59 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:40:59.468666 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e9e167-bc8a-4b75-ab5d-f98e5b19c84a None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:59.468962 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e9e167-bc8a-4b75-ab5d-f98e5b19c84a None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:59.469246 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e9e167-bc8a-4b75-ab5d-f98e5b19c84a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:59.495905 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-46e9e167-bc8a-4b75-ab5d-f98e5b19c84a None None] MFA Rules not processed for user `87dd5c1c5e854d4b96e0b7dad6aa3719`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:40:59.497124 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-46e9e167-bc8a-4b75-ab5d-f98e5b19c84a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:40:59.500283 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c23f559-430f-40eb-9866-35e75abae262 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '123eb76f95ee4e39905944da701c712d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:59.505952 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c23f559-430f-40eb-9866-35e75abae262 service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:59.507001 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c23f559-430f-40eb-9866-35e75abae262 service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:59.507511 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c23f559-430f-40eb-9866-35e75abae262 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:59.617132 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 818/1635] 10.222.0.70 () {58 vars in 1009 bytes} [Tue Aug 2 21:40:59 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:40:59.623680 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e9e167-bc8a-4b75-ab5d-f98e5b19c84a None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:59.639937 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e9e167-bc8a-4b75-ab5d-f98e5b19c84a None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:59.643984 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9046a7e2-6f11-4f56-986c-bde12c559776 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '123eb76f95ee4e39905944da701c712d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:59.644789 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9046a7e2-6f11-4f56-986c-bde12c559776 service cinder] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:59.645185 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9046a7e2-6f11-4f56-986c-bde12c559776 service cinder] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:59.646177 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9046a7e2-6f11-4f56-986c-bde12c559776 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:59.653449 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c23f559-430f-40eb-9866-35e75abae262 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:59.658459 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c23f559-430f-40eb-9866-35e75abae262 service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:59.667017 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9046a7e2-6f11-4f56-986c-bde12c559776 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:59.669532 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9046a7e2-6f11-4f56-986c-bde12c559776 service cinder] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:59.685369 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 818/1636] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:40:59 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 21:40:59.699120 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 819/1637] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:40:59 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:40:59.761244 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c23f559-430f-40eb-9866-35e75abae262 service cinder] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:40:59.771026 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c23f559-430f-40eb-9866-35e75abae262 service cinder] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:40:59.780678 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b693f22-42ba-46db-a9ce-f4dee5eb631f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '123eb76f95ee4e39905944da701c712d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:40:59.783411 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b693f22-42ba-46db-a9ce-f4dee5eb631f service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:40:59.783852 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b693f22-42ba-46db-a9ce-f4dee5eb631f service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:40:59.784163 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b693f22-42ba-46db-a9ce-f4dee5eb631f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:40:59.810074 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b693f22-42ba-46db-a9ce-f4dee5eb631f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:40:59.812031 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b693f22-42ba-46db-a9ce-f4dee5eb631f service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:40:59.829087 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 819/1638] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:40:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:41:00.161588 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9046a7e2-6f11-4f56-986c-bde12c559776 service cinder] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:00.172642 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9046a7e2-6f11-4f56-986c-bde12c559776 service cinder] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:00.184042 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e5707d-e75a-4786-8349-bde0716f6e16 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '123eb76f95ee4e39905944da701c712d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:00.184870 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e5707d-e75a-4786-8349-bde0716f6e16 service cinder] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:00.185224 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e5707d-e75a-4786-8349-bde0716f6e16 service cinder] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:00.185518 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e5707d-e75a-4786-8349-bde0716f6e16 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:00.354006 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e5707d-e75a-4786-8349-bde0716f6e16 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:00.358241 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e5707d-e75a-4786-8349-bde0716f6e16 service cinder] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:00.394291 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 820/1639] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:41:00 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:41:00.736396 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b693f22-42ba-46db-a9ce-f4dee5eb631f service cinder] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:00.754992 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b693f22-42ba-46db-a9ce-f4dee5eb631f service cinder] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:00.767529 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15985172-f755-4e29-8715-f2c21e354bb1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '123eb76f95ee4e39905944da701c712d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:00.768518 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15985172-f755-4e29-8715-f2c21e354bb1 service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:00.769163 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15985172-f755-4e29-8715-f2c21e354bb1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:00.769620 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15985172-f755-4e29-8715-f2c21e354bb1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:00.963003 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15985172-f755-4e29-8715-f2c21e354bb1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:00.966327 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15985172-f755-4e29-8715-f2c21e354bb1 service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:00.991085 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 820/1640] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:41:00 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:41:01.711757 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ec914-c603-4287-8c05-3ac713d1dab5 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:01.712835 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ec914-c603-4287-8c05-3ac713d1dab5 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:01.713281 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9ec914-c603-4287-8c05-3ac713d1dab5 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:01.715319 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 821/1641] 10.222.0.70 () {54 vars in 962 bytes} [Tue Aug 2 21:41:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:41:01.723478 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2705001-2d6f-4601-a36a-d830cc516a80 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:01.724014 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2705001-2d6f-4601-a36a-d830cc516a80 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:01.724328 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2705001-2d6f-4601-a36a-d830cc516a80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:01.768203 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-c2705001-2d6f-4601-a36a-d830cc516a80 None None] MFA Rules not processed for user `87dd5c1c5e854d4b96e0b7dad6aa3719`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:41:01.769491 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-c2705001-2d6f-4601-a36a-d830cc516a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:01.790668 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 821/1642] 10.222.0.70 () {58 vars in 1059 bytes} [Tue Aug 2 21:41:01 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:41:01.797350 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b191c93-dfaf-4e79-99b3-0f2680e5a291 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:01.798144 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b191c93-dfaf-4e79-99b3-0f2680e5a291 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:01.798144 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b191c93-dfaf-4e79-99b3-0f2680e5a291 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:01.799709 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 822/1643] 10.222.0.70 () {54 vars in 912 bytes} [Tue Aug 2 21:41:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:41:01.809329 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c4eb23-db7c-4a36-a80c-8fc34170da72 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:01.809623 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c4eb23-db7c-4a36-a80c-8fc34170da72 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:01.809896 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c4eb23-db7c-4a36-a80c-8fc34170da72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:01.856797 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-59c4eb23-db7c-4a36-a80c-8fc34170da72 None None] MFA Rules not processed for user `87dd5c1c5e854d4b96e0b7dad6aa3719`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:41:01.858050 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-59c4eb23-db7c-4a36-a80c-8fc34170da72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:01.878824 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 822/1644] 10.222.0.70 () {58 vars in 1009 bytes} [Tue Aug 2 21:41:01 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:41:01.892815 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b191c93-dfaf-4e79-99b3-0f2680e5a291 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:01.910436 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b191c93-dfaf-4e79-99b3-0f2680e5a291 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:01.919314 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6427ad68-5fcf-420f-8b64-5d0e8e48bc32 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '123eb76f95ee4e39905944da701c712d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:01.919993 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6427ad68-5fcf-420f-8b64-5d0e8e48bc32 service cinder] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:01.920315 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6427ad68-5fcf-420f-8b64-5d0e8e48bc32 service cinder] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:01.920599 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6427ad68-5fcf-420f-8b64-5d0e8e48bc32 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:01.943922 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6427ad68-5fcf-420f-8b64-5d0e8e48bc32 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:01.945731 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6427ad68-5fcf-420f-8b64-5d0e8e48bc32 service cinder] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:01.980617 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 823/1645] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:41:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:41:05.426363 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c4eb23-db7c-4a36-a80c-8fc34170da72 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:05.505266 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:05.535640 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c4eb23-db7c-4a36-a80c-8fc34170da72 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:05.552666 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e4f980-786d-48ba-ad9b-ba20e34fcf2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:05.553774 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e4f980-786d-48ba-ad9b-ba20e34fcf2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:05.555501 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e4f980-786d-48ba-ad9b-ba20e34fcf2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:05.555943 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e4f980-786d-48ba-ad9b-ba20e34fcf2f admin admin] PATH_INFO: `/v3/users/edd9b5d5e0b5450ea218d438c69e7fe0` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:05.557552 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e4f980-786d-48ba-ad9b-ba20e34fcf2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=edd9b5d5e0b5450ea218d438c69e7fe0)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:05.559993 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e4f980-786d-48ba-ad9b-ba20e34fcf2f admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:05.669060 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-f6e4f980-786d-48ba-ad9b-ba20e34fcf2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'edd9b5d5e0b5450ea218d438c69e7fe0'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:05.719484 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-f6e4f980-786d-48ba-ad9b-ba20e34fcf2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'edd9b5d5e0b5450ea218d438c69e7fe0'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:05.757184 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-f6e4f980-786d-48ba-ad9b-ba20e34fcf2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'edd9b5d5e0b5450ea218d438c69e7fe0'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:05.758688 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-f6e4f980-786d-48ba-ad9b-ba20e34fcf2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'edd9b5d5e0b5450ea218d438c69e7fe0'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:05.786507 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-f6e4f980-786d-48ba-ad9b-ba20e34fcf2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'edd9b5d5e0b5450ea218d438c69e7fe0'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:05.821763 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 823/1646] 10.222.0.70 () {58 vars in 1224 bytes} [Tue Aug 2 21:41:05 2022] DELETE /identity/v3/users/edd9b5d5e0b5450ea218d438c69e7fe0 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:41:05.826135 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d567fe-6419-4dbc-948d-ae3b1f71ce83 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:05.827097 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d567fe-6419-4dbc-948d-ae3b1f71ce83 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:05.827530 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d567fe-6419-4dbc-948d-ae3b1f71ce83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:05.851555 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:05.872586 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-c2d567fe-6419-4dbc-948d-ae3b1f71ce83 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:41:05.875830 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-c2d567fe-6419-4dbc-948d-ae3b1f71ce83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:06.085447 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 824/1647] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:41:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:41:06.119283 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e4f980-786d-48ba-ad9b-ba20e34fcf2f admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:06.121074 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-f6e4f980-786d-48ba-ad9b-ba20e34fcf2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:06.262679 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d567fe-6419-4dbc-948d-ae3b1f71ce83 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:06.264747 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-c2d567fe-6419-4dbc-948d-ae3b1f71ce83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:06.299275 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d567fe-6419-4dbc-948d-ae3b1f71ce83 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:06.310976 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b557719-198e-4e3c-b2a2-dfb96cde8017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:06.313341 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b557719-198e-4e3c-b2a2-dfb96cde8017 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:06.314539 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b557719-198e-4e3c-b2a2-dfb96cde8017 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:06.315028 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b557719-198e-4e3c-b2a2-dfb96cde8017 admin admin] PATH_INFO: `/v3/users/0fcff7222f6e49f8958263a73347dd5f` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:06.316810 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b557719-198e-4e3c-b2a2-dfb96cde8017 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fcff7222f6e49f8958263a73347dd5f)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:06.317029 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e4f980-786d-48ba-ad9b-ba20e34fcf2f admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:06.318510 dv-cinder-851449-4-smb devstack@keystone.service[80420]: WARNING py.warnings [None req-3b557719-198e-4e3c-b2a2-dfb96cde8017 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 02 21:41:06.318510 dv-cinder-851449-4-smb devstack@keystone.service[80420]: warnings.warn(msg) Aug 02 21:41:06.318510 dv-cinder-851449-4-smb devstack@keystone.service[80420]: Aug 02 21:41:06.320906 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b557719-198e-4e3c-b2a2-dfb96cde8017 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:06.332129 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1949b12c-e700-4698-8182-5a125e1d9565 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '723f5f43572a493dae0349070a2adb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:06.334923 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1949b12c-e700-4698-8182-5a125e1d9565 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:06.335449 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1949b12c-e700-4698-8182-5a125e1d9565 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:06.335982 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1949b12c-e700-4698-8182-5a125e1d9565 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:06.376611 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1949b12c-e700-4698-8182-5a125e1d9565 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:06.379675 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1949b12c-e700-4698-8182-5a125e1d9565 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:06.418169 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 824/1648] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:41:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:41:06.485930 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-3b557719-198e-4e3c-b2a2-dfb96cde8017 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fcff7222f6e49f8958263a73347dd5f'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:06.529111 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-3b557719-198e-4e3c-b2a2-dfb96cde8017 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fcff7222f6e49f8958263a73347dd5f'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:06.577411 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-3b557719-198e-4e3c-b2a2-dfb96cde8017 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fcff7222f6e49f8958263a73347dd5f'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:06.592130 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-3b557719-198e-4e3c-b2a2-dfb96cde8017 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fcff7222f6e49f8958263a73347dd5f'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:06.593350 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-3b557719-198e-4e3c-b2a2-dfb96cde8017 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fcff7222f6e49f8958263a73347dd5f'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:06.604979 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 825/1649] 10.222.0.70 () {58 vars in 1224 bytes} [Tue Aug 2 21:41:06 2022] DELETE /identity/v3/users/0fcff7222f6e49f8958263a73347dd5f => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:41:06.605815 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa8c2a0-9833-489b-afbc-cd3864c2f189 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:06.606377 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa8c2a0-9833-489b-afbc-cd3864c2f189 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:06.606377 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa8c2a0-9833-489b-afbc-cd3864c2f189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:06.643205 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-9aa8c2a0-9833-489b-afbc-cd3864c2f189 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:41:06.645074 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-9aa8c2a0-9833-489b-afbc-cd3864c2f189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:06.760422 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:06.773140 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 825/1650] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:41:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:41:06.805246 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b557719-198e-4e3c-b2a2-dfb96cde8017 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:06.809456 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-3b557719-198e-4e3c-b2a2-dfb96cde8017 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:06.907037 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b557719-198e-4e3c-b2a2-dfb96cde8017 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:06.911525 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd6b297-ab42-44f4-b5a9-199f3e53e9d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '723f5f43572a493dae0349070a2adb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:06.913106 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd6b297-ab42-44f4-b5a9-199f3e53e9d6 service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:06.913676 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd6b297-ab42-44f4-b5a9-199f3e53e9d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:06.914163 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd6b297-ab42-44f4-b5a9-199f3e53e9d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:06.925662 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd6b297-ab42-44f4-b5a9-199f3e53e9d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:06.927662 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd6b297-ab42-44f4-b5a9-199f3e53e9d6 service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:06.940034 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 826/1651] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:41:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:41:07.050540 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001aefd9-5daa-4fb4-9a67-999b7506b500 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:07.050883 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001aefd9-5daa-4fb4-9a67-999b7506b500 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:07.051796 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001aefd9-5daa-4fb4-9a67-999b7506b500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:07.126624 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-001aefd9-5daa-4fb4-9a67-999b7506b500 None None] MFA Rules not processed for user `182daeeee91b4594b4eab1c28cba5067`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:41:07.128567 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-001aefd9-5daa-4fb4-9a67-999b7506b500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:07.337976 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 826/1652] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:41:07 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:41:07.347866 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd6b297-ab42-44f4-b5a9-199f3e53e9d6 service neutron] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:07.349429 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-9fd6b297-ab42-44f4-b5a9-199f3e53e9d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:07.430323 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:07.580878 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd6b297-ab42-44f4-b5a9-199f3e53e9d6 service neutron] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:07.601178 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a14b33-b02e-46c7-b7f4-176a9d50583c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87dd5c1c5e854d4b96e0b7dad6aa3719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:07.602919 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a14b33-b02e-46c7-b7f4-176a9d50583c service nova] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:07.605017 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a14b33-b02e-46c7-b7f4-176a9d50583c service nova] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:07.605365 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a14b33-b02e-46c7-b7f4-176a9d50583c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:07.638578 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a14b33-b02e-46c7-b7f4-176a9d50583c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:07.644980 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a14b33-b02e-46c7-b7f4-176a9d50583c service nova] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:07.676886 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 827/1653] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:41:07 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:41:08.072970 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001aefd9-5daa-4fb4-9a67-999b7506b500 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:08.076151 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-001aefd9-5daa-4fb4-9a67-999b7506b500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:08.104309 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001aefd9-5daa-4fb4-9a67-999b7506b500 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:08.138689 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701eaf06-ab8f-42e8-92cc-c4e34e65b544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:08.142798 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701eaf06-ab8f-42e8-92cc-c4e34e65b544 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:08.145293 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701eaf06-ab8f-42e8-92cc-c4e34e65b544 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:08.145943 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701eaf06-ab8f-42e8-92cc-c4e34e65b544 admin admin] PATH_INFO: `/v3/projects/1d3bee99dcd6425ba29be1d30ab74381` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:08.149918 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701eaf06-ab8f-42e8-92cc-c4e34e65b544 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d3bee99dcd6425ba29be1d30ab74381)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:08.151346 dv-cinder-851449-4-smb devstack@keystone.service[80419]: WARNING py.warnings [None req-701eaf06-ab8f-42e8-92cc-c4e34e65b544 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 02 21:41:08.151346 dv-cinder-851449-4-smb devstack@keystone.service[80419]: warnings.warn(msg) Aug 02 21:41:08.151346 dv-cinder-851449-4-smb devstack@keystone.service[80419]: Aug 02 21:41:08.153123 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701eaf06-ab8f-42e8-92cc-c4e34e65b544 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:08.224306 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a14b33-b02e-46c7-b7f4-176a9d50583c service nova] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:08.226033 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-e3a14b33-b02e-46c7-b7f4-176a9d50583c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:08.248541 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a14b33-b02e-46c7-b7f4-176a9d50583c service nova] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:08.303974 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-701eaf06-ab8f-42e8-92cc-c4e34e65b544 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d3bee99dcd6425ba29be1d30ab74381', 'request_id': 'req-701eaf06-ab8f-42e8-92cc-c4e34e65b544'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:08.326024 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-701eaf06-ab8f-42e8-92cc-c4e34e65b544 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d3bee99dcd6425ba29be1d30ab74381', 'request_id': 'req-701eaf06-ab8f-42e8-92cc-c4e34e65b544'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:08.334297 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-701eaf06-ab8f-42e8-92cc-c4e34e65b544 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d3bee99dcd6425ba29be1d30ab74381', 'request_id': 'req-701eaf06-ab8f-42e8-92cc-c4e34e65b544'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:08.377580 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-701eaf06-ab8f-42e8-92cc-c4e34e65b544 admin admin] The token cache is being invalidate because project 1d3bee99dcd6425ba29be1d30ab74381 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:41:08.378438 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-701eaf06-ab8f-42e8-92cc-c4e34e65b544 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:08.380711 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-701eaf06-ab8f-42e8-92cc-c4e34e65b544 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:08.386676 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 827/1654] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Aug 2 21:41:08 2022] DELETE /identity/v3/projects/1d3bee99dcd6425ba29be1d30ab74381 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:41:08.387713 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701eaf06-ab8f-42e8-92cc-c4e34e65b544 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:08.389584 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-701eaf06-ab8f-42e8-92cc-c4e34e65b544 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:08.433975 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e072acb9-5f07-408f-a3b2-589a577047dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:08.435515 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e072acb9-5f07-408f-a3b2-589a577047dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:08.435808 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e072acb9-5f07-408f-a3b2-589a577047dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:08.436093 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e072acb9-5f07-408f-a3b2-589a577047dc admin admin] PATH_INFO: `/v3/users/777f2873c1c7486da60dc472815a551b` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:08.441644 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e072acb9-5f07-408f-a3b2-589a577047dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=777f2873c1c7486da60dc472815a551b)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:08.447213 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e072acb9-5f07-408f-a3b2-589a577047dc admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:08.554823 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701eaf06-ab8f-42e8-92cc-c4e34e65b544 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:08.568139 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fce5faa-12f1-4d47-bd9c-af9cf41de81f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:08.568892 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fce5faa-12f1-4d47-bd9c-af9cf41de81f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:08.569127 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fce5faa-12f1-4d47-bd9c-af9cf41de81f admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:08.569408 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fce5faa-12f1-4d47-bd9c-af9cf41de81f admin admin] PATH_INFO: `/v3/users/bfe755c55fbb4205a274b5427fbe170f` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:08.570927 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-e072acb9-5f07-408f-a3b2-589a577047dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '777f2873c1c7486da60dc472815a551b'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:08.571162 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fce5faa-12f1-4d47-bd9c-af9cf41de81f admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfe755c55fbb4205a274b5427fbe170f)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:08.573170 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fce5faa-12f1-4d47-bd9c-af9cf41de81f admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:08.593269 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-e072acb9-5f07-408f-a3b2-589a577047dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '777f2873c1c7486da60dc472815a551b'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:08.610696 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:08.629690 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-e072acb9-5f07-408f-a3b2-589a577047dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '777f2873c1c7486da60dc472815a551b'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:08.653843 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-e072acb9-5f07-408f-a3b2-589a577047dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '777f2873c1c7486da60dc472815a551b'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:08.654892 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-e072acb9-5f07-408f-a3b2-589a577047dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '777f2873c1c7486da60dc472815a551b'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:08.676488 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 828/1655] 10.222.0.70 () {58 vars in 1224 bytes} [Tue Aug 2 21:41:08 2022] DELETE /identity/v3/users/777f2873c1c7486da60dc472815a551b => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:41:08.678069 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc6aec-53fd-4340-ac44-3a38aa634ba5 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:08.678369 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc6aec-53fd-4340-ac44-3a38aa634ba5 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:08.678652 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc6aec-53fd-4340-ac44-3a38aa634ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:08.689487 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-5fce5faa-12f1-4d47-bd9c-af9cf41de81f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfe755c55fbb4205a274b5427fbe170f'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:08.712688 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-5fce5faa-12f1-4d47-bd9c-af9cf41de81f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfe755c55fbb4205a274b5427fbe170f'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:08.733850 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-55bc6aec-53fd-4340-ac44-3a38aa634ba5 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:41:08.735245 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-55bc6aec-53fd-4340-ac44-3a38aa634ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:08.735655 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-5fce5faa-12f1-4d47-bd9c-af9cf41de81f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfe755c55fbb4205a274b5427fbe170f'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:08.737438 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-5fce5faa-12f1-4d47-bd9c-af9cf41de81f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfe755c55fbb4205a274b5427fbe170f'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:08.749175 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-5fce5faa-12f1-4d47-bd9c-af9cf41de81f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfe755c55fbb4205a274b5427fbe170f'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:08.757697 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 828/1656] 10.222.0.70 () {58 vars in 1224 bytes} [Tue Aug 2 21:41:08 2022] DELETE /identity/v3/users/bfe755c55fbb4205a274b5427fbe170f => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:41:08.788163 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:08.892659 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 829/1657] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:41:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:41:08.959803 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fce5faa-12f1-4d47-bd9c-af9cf41de81f admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:08.962016 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-5fce5faa-12f1-4d47-bd9c-af9cf41de81f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:09.139357 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fce5faa-12f1-4d47-bd9c-af9cf41de81f admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:09.150300 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6a0a05-2d78-448b-935a-012f25bab7eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '723f5f43572a493dae0349070a2adb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:09.151021 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a0a05-2d78-448b-935a-012f25bab7eb service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:09.151307 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a0a05-2d78-448b-935a-012f25bab7eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:09.151590 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6a0a05-2d78-448b-935a-012f25bab7eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:09.303159 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6a0a05-2d78-448b-935a-012f25bab7eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:09.304978 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6a0a05-2d78-448b-935a-012f25bab7eb service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:09.321400 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 829/1658] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:41:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:41:09.438058 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bc6aec-53fd-4340-ac44-3a38aa634ba5 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:09.439740 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-55bc6aec-53fd-4340-ac44-3a38aa634ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:09.464948 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bc6aec-53fd-4340-ac44-3a38aa634ba5 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:09.478017 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9f9809-5036-44f5-9fb3-2388aa923b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:09.479013 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9f9809-5036-44f5-9fb3-2388aa923b22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:09.479299 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9f9809-5036-44f5-9fb3-2388aa923b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:09.484341 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9f9809-5036-44f5-9fb3-2388aa923b22 admin admin] PATH_INFO: `/v3/projects/2a201dc7be3a4ba2a01b97d88aad7ebb` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:09.488879 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9f9809-5036-44f5-9fb3-2388aa923b22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a201dc7be3a4ba2a01b97d88aad7ebb)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:09.497206 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9f9809-5036-44f5-9fb3-2388aa923b22 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:09.669332 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-ed9f9809-5036-44f5-9fb3-2388aa923b22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a201dc7be3a4ba2a01b97d88aad7ebb', 'request_id': 'req-ed9f9809-5036-44f5-9fb3-2388aa923b22'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:09.715175 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-ed9f9809-5036-44f5-9fb3-2388aa923b22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a201dc7be3a4ba2a01b97d88aad7ebb', 'request_id': 'req-ed9f9809-5036-44f5-9fb3-2388aa923b22'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:09.727195 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-ed9f9809-5036-44f5-9fb3-2388aa923b22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a201dc7be3a4ba2a01b97d88aad7ebb', 'request_id': 'req-ed9f9809-5036-44f5-9fb3-2388aa923b22'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:09.755998 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-ed9f9809-5036-44f5-9fb3-2388aa923b22 admin admin] The token cache is being invalidate because project 2a201dc7be3a4ba2a01b97d88aad7ebb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:41:09.756881 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-ed9f9809-5036-44f5-9fb3-2388aa923b22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:09.757805 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-ed9f9809-5036-44f5-9fb3-2388aa923b22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:09.771930 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 830/1659] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Aug 2 21:41:09 2022] DELETE /identity/v3/projects/2a201dc7be3a4ba2a01b97d88aad7ebb => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:41:09.780491 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05b0c78-d7a9-479a-98a4-475e98bb0d32 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:09.780777 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05b0c78-d7a9-479a-98a4-475e98bb0d32 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:09.781799 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05b0c78-d7a9-479a-98a4-475e98bb0d32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:09.805952 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-c05b0c78-d7a9-479a-98a4-475e98bb0d32 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:41:09.807291 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-c05b0c78-d7a9-479a-98a4-475e98bb0d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:09.878387 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:09.939975 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 830/1660] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:41:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:41:09.948150 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcd25f8-aad9-4e8d-8e15-a0ccb9eeb253 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:09.948753 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcd25f8-aad9-4e8d-8e15-a0ccb9eeb253 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:09.949278 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcd25f8-aad9-4e8d-8e15-a0ccb9eeb253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:09.999048 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-ddcd25f8-aad9-4e8d-8e15-a0ccb9eeb253 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:41:10.002206 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-ddcd25f8-aad9-4e8d-8e15-a0ccb9eeb253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:10.015251 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 831/1661] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:41:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:41:10.019743 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05b0c78-d7a9-479a-98a4-475e98bb0d32 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:10.037023 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05b0c78-d7a9-479a-98a4-475e98bb0d32 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:10.051758 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf28c08-9a85-4e2c-919f-485e3d3db7dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:10.052511 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf28c08-9a85-4e2c-919f-485e3d3db7dc admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:10.052804 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf28c08-9a85-4e2c-919f-485e3d3db7dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:10.053088 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf28c08-9a85-4e2c-919f-485e3d3db7dc admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:10.053812 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf28c08-9a85-4e2c-919f-485e3d3db7dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:41:10.054124 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf28c08-9a85-4e2c-919f-485e3d3db7dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:10.055774 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf28c08-9a85-4e2c-919f-485e3d3db7dc admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:10.085848 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 831/1662] 10.222.0.70 () {58 vars in 1153 bytes} [Tue Aug 2 21:41:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:41:10.087180 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcd25f8-aad9-4e8d-8e15-a0ccb9eeb253 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:10.103071 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcd25f8-aad9-4e8d-8e15-a0ccb9eeb253 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:10.110463 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5b1e7b-1723-4df2-8854-22379cdcb394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:10.111668 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5b1e7b-1723-4df2-8854-22379cdcb394 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:10.112196 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5b1e7b-1723-4df2-8854-22379cdcb394 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:10.114436 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5b1e7b-1723-4df2-8854-22379cdcb394 admin admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:10.115453 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5b1e7b-1723-4df2-8854-22379cdcb394 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:10.117703 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5b1e7b-1723-4df2-8854-22379cdcb394 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:10.197449 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 832/1663] 10.222.0.70 () {60 vars in 1153 bytes} [Tue Aug 2 21:41:10 2022] POST /identity/v3/projects => generated 365 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:41:10.201462 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf28c08-9a85-4e2c-919f-485e3d3db7dc admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:10.222996 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf28c08-9a85-4e2c-919f-485e3d3db7dc admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:10.384643 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dab126d-66b8-43a8-a783-fd178cfb971f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:10.386436 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dab126d-66b8-43a8-a783-fd178cfb971f admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:10.386726 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dab126d-66b8-43a8-a783-fd178cfb971f admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:10.386999 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dab126d-66b8-43a8-a783-fd178cfb971f admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:10.387680 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dab126d-66b8-43a8-a783-fd178cfb971f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:10.397757 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dab126d-66b8-43a8-a783-fd178cfb971f admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:10.447529 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 832/1664] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 2 21:41:10 2022] POST /identity/v3/users => generated 283 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:41:10.453025 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5b1e7b-1723-4df2-8854-22379cdcb394 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:10.468193 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5b1e7b-1723-4df2-8854-22379cdcb394 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:10.483420 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa61805-689b-4f19-97ae-d545213aa5fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:10.484855 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa61805-689b-4f19-97ae-d545213aa5fb admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:10.485285 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa61805-689b-4f19-97ae-d545213aa5fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:10.485567 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa61805-689b-4f19-97ae-d545213aa5fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:10.491580 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa61805-689b-4f19-97ae-d545213aa5fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:10.493381 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa61805-689b-4f19-97ae-d545213aa5fb admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:10.520392 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 833/1665] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:41:10 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:41:10.525462 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dab126d-66b8-43a8-a783-fd178cfb971f admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:10.549345 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dab126d-66b8-43a8-a783-fd178cfb971f admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:10.569616 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3645521-7e79-4423-91de-635072d27096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:10.570720 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3645521-7e79-4423-91de-635072d27096 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:10.571100 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3645521-7e79-4423-91de-635072d27096 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:10.571472 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3645521-7e79-4423-91de-635072d27096 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:10.572297 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3645521-7e79-4423-91de-635072d27096 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:10.577533 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3645521-7e79-4423-91de-635072d27096 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:10.652862 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 833/1666] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:41:10 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:41:10.657150 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa61805-689b-4f19-97ae-d545213aa5fb admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:10.673703 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa61805-689b-4f19-97ae-d545213aa5fb admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:10.686247 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c7ae0c-8f34-431d-b120-3b2255a268e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:10.687003 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c7ae0c-8f34-431d-b120-3b2255a268e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:10.687244 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c7ae0c-8f34-431d-b120-3b2255a268e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:10.687533 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c7ae0c-8f34-431d-b120-3b2255a268e5 admin admin] PATH_INFO: `/v3/projects/1a43727fdcb34d5e935596f80e5e23d9/users/9a670dc222f64ed3b3e2f9ba5f63fb9a/roles/462e3381a85c42a9959201f9aa122f7c` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:10.737854 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c7ae0c-8f34-431d-b120-3b2255a268e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a43727fdcb34d5e935596f80e5e23d9, user_id=9a670dc222f64ed3b3e2f9ba5f63fb9a, role_id=462e3381a85c42a9959201f9aa122f7c)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:10.740670 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c7ae0c-8f34-431d-b120-3b2255a268e5 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:10.784412 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 834/1667] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:41:10 2022] PUT /identity/v3/projects/1a43727fdcb34d5e935596f80e5e23d9/users/9a670dc222f64ed3b3e2f9ba5f63fb9a/roles/462e3381a85c42a9959201f9aa122f7c => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:41:10.786259 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628fbd8c-551f-420d-8a72-82b77c00523b None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:10.786757 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628fbd8c-551f-420d-8a72-82b77c00523b None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:10.787230 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628fbd8c-551f-420d-8a72-82b77c00523b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:10.859596 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-628fbd8c-551f-420d-8a72-82b77c00523b None None] MFA Rules not processed for user `9a670dc222f64ed3b3e2f9ba5f63fb9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:41:10.861111 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-628fbd8c-551f-420d-8a72-82b77c00523b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:11.084929 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 834/1668] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:41:10 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:41:11.092044 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c7ae0c-8f34-431d-b120-3b2255a268e5 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:11.165931 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:11.185149 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c7ae0c-8f34-431d-b120-3b2255a268e5 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:11.193571 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99646e83-96e5-43fd-8a0c-42ea1fdc05aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:11.194496 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99646e83-96e5-43fd-8a0c-42ea1fdc05aa admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:11.194829 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99646e83-96e5-43fd-8a0c-42ea1fdc05aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:11.195164 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99646e83-96e5-43fd-8a0c-42ea1fdc05aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:11.195911 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99646e83-96e5-43fd-8a0c-42ea1fdc05aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:11.200074 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99646e83-96e5-43fd-8a0c-42ea1fdc05aa admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:11.233354 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628fbd8c-551f-420d-8a72-82b77c00523b None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:11.234821 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-628fbd8c-551f-420d-8a72-82b77c00523b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:11.260556 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628fbd8c-551f-420d-8a72-82b77c00523b None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:11.270938 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 835/1669] 10.222.0.70 () {60 vars in 1153 bytes} [Tue Aug 2 21:41:11 2022] POST /identity/v3/projects => generated 361 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:41:11.272356 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99646e83-96e5-43fd-8a0c-42ea1fdc05aa admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:11.306134 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e784b9-20ca-4a93-bf52-1c85423aace8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:11.306951 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e784b9-20ca-4a93-bf52-1c85423aace8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:11.307401 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e784b9-20ca-4a93-bf52-1c85423aace8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:11.307853 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e784b9-20ca-4a93-bf52-1c85423aace8 admin admin] PATH_INFO: `/v3/projects/eb0068cd9c77401997db1aee81eb28f1` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:11.317257 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e784b9-20ca-4a93-bf52-1c85423aace8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb0068cd9c77401997db1aee81eb28f1)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:11.319362 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e784b9-20ca-4a93-bf52-1c85423aace8 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:11.361209 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99646e83-96e5-43fd-8a0c-42ea1fdc05aa admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:11.370556 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a556ac55-c251-41fd-911c-d550fd89ef42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:11.371205 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a556ac55-c251-41fd-911c-d550fd89ef42 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:11.371494 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a556ac55-c251-41fd-911c-d550fd89ef42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:11.371774 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a556ac55-c251-41fd-911c-d550fd89ef42 admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:11.373059 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a556ac55-c251-41fd-911c-d550fd89ef42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:11.375566 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a556ac55-c251-41fd-911c-d550fd89ef42 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:11.404334 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 836/1670] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 2 21:41:11 2022] POST /identity/v3/users => generated 287 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:41:11.405382 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a556ac55-c251-41fd-911c-d550fd89ef42 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:11.415739 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:11.423285 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a556ac55-c251-41fd-911c-d550fd89ef42 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:11.449313 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-f6e784b9-20ca-4a93-bf52-1c85423aace8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb0068cd9c77401997db1aee81eb28f1', 'request_id': 'req-f6e784b9-20ca-4a93-bf52-1c85423aace8'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:11.470554 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-f6e784b9-20ca-4a93-bf52-1c85423aace8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb0068cd9c77401997db1aee81eb28f1', 'request_id': 'req-f6e784b9-20ca-4a93-bf52-1c85423aace8'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:11.482601 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-f6e784b9-20ca-4a93-bf52-1c85423aace8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb0068cd9c77401997db1aee81eb28f1', 'request_id': 'req-f6e784b9-20ca-4a93-bf52-1c85423aace8'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:11.503696 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6705d2f-c091-40c5-95c6-00a6f7d49537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:11.504513 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6705d2f-c091-40c5-95c6-00a6f7d49537 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:11.505413 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6705d2f-c091-40c5-95c6-00a6f7d49537 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:11.505709 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6705d2f-c091-40c5-95c6-00a6f7d49537 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:11.506525 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6705d2f-c091-40c5-95c6-00a6f7d49537 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:11.507356 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-f6e784b9-20ca-4a93-bf52-1c85423aace8 admin admin] The token cache is being invalidate because project eb0068cd9c77401997db1aee81eb28f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:41:11.507356 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-f6e784b9-20ca-4a93-bf52-1c85423aace8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:11.509310 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6705d2f-c091-40c5-95c6-00a6f7d49537 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:11.510606 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-f6e784b9-20ca-4a93-bf52-1c85423aace8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:11.526691 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 835/1671] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Aug 2 21:41:11 2022] DELETE /identity/v3/projects/eb0068cd9c77401997db1aee81eb28f1 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:41:11.528259 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 837/1672] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:41:11 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:41:11.528448 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e784b9-20ca-4a93-bf52-1c85423aace8 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:11.530027 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-f6e784b9-20ca-4a93-bf52-1c85423aace8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:11.535491 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6705d2f-c091-40c5-95c6-00a6f7d49537 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:11.541076 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-e6705d2f-c091-40c5-95c6-00a6f7d49537 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:11.554715 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e784b9-20ca-4a93-bf52-1c85423aace8 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:11.568361 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6705d2f-c091-40c5-95c6-00a6f7d49537 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:11.570519 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9a864b-765f-446f-810d-6a2220aab199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:11.571300 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a864b-765f-446f-810d-6a2220aab199 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:11.571689 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a864b-765f-446f-810d-6a2220aab199 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:11.572073 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a864b-765f-446f-810d-6a2220aab199 admin admin] PATH_INFO: `/v3/users/476f30417e6f4e6ca2087012fb86b48e` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:11.575194 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9a864b-765f-446f-810d-6a2220aab199 admin admin] RBAC: Authorizing `identity:delete_user(user_id=476f30417e6f4e6ca2087012fb86b48e)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:11.577514 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9a864b-765f-446f-810d-6a2220aab199 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:11.582808 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df22b1a3-d21a-427c-9c71-2112456f2680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:11.583758 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df22b1a3-d21a-427c-9c71-2112456f2680 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:11.583758 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df22b1a3-d21a-427c-9c71-2112456f2680 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:11.584048 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df22b1a3-d21a-427c-9c71-2112456f2680 admin admin] PATH_INFO: `/v3/projects/d4f750d3133a4697a2f2698b57bbdd0f/users/2be2d72cd57c472aa424dfce40512f1a/roles/3e32dbf75f9b41f5adb9fe59851267bb` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:11.627843 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df22b1a3-d21a-427c-9c71-2112456f2680 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4f750d3133a4697a2f2698b57bbdd0f, user_id=2be2d72cd57c472aa424dfce40512f1a, role_id=3e32dbf75f9b41f5adb9fe59851267bb)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:11.630436 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df22b1a3-d21a-427c-9c71-2112456f2680 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:11.662760 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 838/1673] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:41:11 2022] PUT /identity/v3/projects/d4f750d3133a4697a2f2698b57bbdd0f/users/2be2d72cd57c472aa424dfce40512f1a/roles/3e32dbf75f9b41f5adb9fe59851267bb => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:41:11.667747 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df22b1a3-d21a-427c-9c71-2112456f2680 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:11.695932 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-8e9a864b-765f-446f-810d-6a2220aab199 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '476f30417e6f4e6ca2087012fb86b48e'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:11.715465 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-8e9a864b-765f-446f-810d-6a2220aab199 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '476f30417e6f4e6ca2087012fb86b48e'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:11.745012 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-8e9a864b-765f-446f-810d-6a2220aab199 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '476f30417e6f4e6ca2087012fb86b48e'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:11.749038 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-8e9a864b-765f-446f-810d-6a2220aab199 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '476f30417e6f4e6ca2087012fb86b48e'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:11.749730 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:11.773248 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-8e9a864b-765f-446f-810d-6a2220aab199 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '476f30417e6f4e6ca2087012fb86b48e'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:11.787750 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 836/1674] 10.222.0.70 () {58 vars in 1224 bytes} [Tue Aug 2 21:41:11 2022] DELETE /identity/v3/users/476f30417e6f4e6ca2087012fb86b48e => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:41:11.808754 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df22b1a3-d21a-427c-9c71-2112456f2680 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:11.896702 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9a864b-765f-446f-810d-6a2220aab199 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:11.898469 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-8e9a864b-765f-446f-810d-6a2220aab199 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:11.951314 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b020bba-8f50-4d9d-9bfa-ee6af0f8a87e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:11.952067 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b020bba-8f50-4d9d-9bfa-ee6af0f8a87e admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:11.952391 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b020bba-8f50-4d9d-9bfa-ee6af0f8a87e admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:11.952689 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b020bba-8f50-4d9d-9bfa-ee6af0f8a87e admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:11.953828 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b020bba-8f50-4d9d-9bfa-ee6af0f8a87e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:11.955504 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b020bba-8f50-4d9d-9bfa-ee6af0f8a87e admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:11.998911 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 839/1675] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:41:11 2022] GET /identity/v3/roles => generated 1420 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 21:41:11.999985 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b020bba-8f50-4d9d-9bfa-ee6af0f8a87e admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:12.007168 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-8b020bba-8f50-4d9d-9bfa-ee6af0f8a87e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:12.032657 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b020bba-8f50-4d9d-9bfa-ee6af0f8a87e admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:12.050557 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c95241-cbf0-45b0-a19d-816e2238d7e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:12.050754 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9a864b-765f-446f-810d-6a2220aab199 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:12.051285 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c95241-cbf0-45b0-a19d-816e2238d7e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:12.051571 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c95241-cbf0-45b0-a19d-816e2238d7e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:12.051856 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c95241-cbf0-45b0-a19d-816e2238d7e0 admin admin] PATH_INFO: `/v3/projects/d4f750d3133a4697a2f2698b57bbdd0f/users/2be2d72cd57c472aa424dfce40512f1a/roles/3e32dbf75f9b41f5adb9fe59851267bb` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:12.062736 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ec8e8a-d281-4956-874e-df702919d555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:12.065096 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ec8e8a-d281-4956-874e-df702919d555 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:12.066615 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c95241-cbf0-45b0-a19d-816e2238d7e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4f750d3133a4697a2f2698b57bbdd0f, user_id=2be2d72cd57c472aa424dfce40512f1a, role_id=3e32dbf75f9b41f5adb9fe59851267bb)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:12.070175 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c95241-cbf0-45b0-a19d-816e2238d7e0 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:12.070514 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ec8e8a-d281-4956-874e-df702919d555 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:12.070852 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ec8e8a-d281-4956-874e-df702919d555 admin admin] PATH_INFO: `/v3/projects/b8499ff9a9c446c9b5875a5a25946ede` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:12.074032 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ec8e8a-d281-4956-874e-df702919d555 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8499ff9a9c446c9b5875a5a25946ede)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:12.080993 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ec8e8a-d281-4956-874e-df702919d555 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:12.111261 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 840/1676] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:41:11 2022] PUT /identity/v3/projects/d4f750d3133a4697a2f2698b57bbdd0f/users/2be2d72cd57c472aa424dfce40512f1a/roles/3e32dbf75f9b41f5adb9fe59851267bb => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:41:12.113167 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e50af7f-b19e-4283-9f43-df9bfd6d139b None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:12.113492 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e50af7f-b19e-4283-9f43-df9bfd6d139b None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:12.114012 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e50af7f-b19e-4283-9f43-df9bfd6d139b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:12.205111 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:12.207461 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-9e50af7f-b19e-4283-9f43-df9bfd6d139b None None] MFA Rules not processed for user `2be2d72cd57c472aa424dfce40512f1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:41:12.208942 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-9e50af7f-b19e-4283-9f43-df9bfd6d139b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:12.233972 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-92ec8e8a-d281-4956-874e-df702919d555 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8499ff9a9c446c9b5875a5a25946ede', 'request_id': 'req-92ec8e8a-d281-4956-874e-df702919d555'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:12.263646 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-92ec8e8a-d281-4956-874e-df702919d555 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8499ff9a9c446c9b5875a5a25946ede', 'request_id': 'req-92ec8e8a-d281-4956-874e-df702919d555'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:12.276870 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-92ec8e8a-d281-4956-874e-df702919d555 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8499ff9a9c446c9b5875a5a25946ede', 'request_id': 'req-92ec8e8a-d281-4956-874e-df702919d555'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:12.324653 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-92ec8e8a-d281-4956-874e-df702919d555 admin admin] The token cache is being invalidate because project b8499ff9a9c446c9b5875a5a25946ede was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:41:12.325008 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-92ec8e8a-d281-4956-874e-df702919d555 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:12.329459 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-92ec8e8a-d281-4956-874e-df702919d555 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:12.333679 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 837/1677] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Aug 2 21:41:11 2022] DELETE /identity/v3/projects/b8499ff9a9c446c9b5875a5a25946ede => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:41:12.345541 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e2e84a-b404-4a04-966b-5eefd214af2f None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:12.347334 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e2e84a-b404-4a04-966b-5eefd214af2f None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:12.347647 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e2e84a-b404-4a04-966b-5eefd214af2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:12.417152 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-88e2e84a-b404-4a04-966b-5eefd214af2f None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:41:12.419987 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-88e2e84a-b404-4a04-966b-5eefd214af2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:12.441289 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 841/1678] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:41:12 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:41:12.459678 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e50af7f-b19e-4283-9f43-df9bfd6d139b None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:12.463462 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-9e50af7f-b19e-4283-9f43-df9bfd6d139b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:12.571815 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:12.578657 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e50af7f-b19e-4283-9f43-df9bfd6d139b None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:12.585646 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339c1bad-c8bc-491e-ace8-3dbeff81533e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '123eb76f95ee4e39905944da701c712d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:12.586289 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c1bad-c8bc-491e-ace8-3dbeff81533e service cinder] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:12.586571 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c1bad-c8bc-491e-ace8-3dbeff81533e service cinder] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:12.586848 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339c1bad-c8bc-491e-ace8-3dbeff81533e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:12.598938 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339c1bad-c8bc-491e-ace8-3dbeff81533e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:12.600611 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339c1bad-c8bc-491e-ace8-3dbeff81533e service cinder] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:12.615573 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 842/1679] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:41:12 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:41:12.642164 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 838/1680] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:41:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:41:12.650914 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb6dfb6-8c6c-49fa-884f-82e3523863c9 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:12.651380 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb6dfb6-8c6c-49fa-884f-82e3523863c9 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:12.651759 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb6dfb6-8c6c-49fa-884f-82e3523863c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:12.697365 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-eeb6dfb6-8c6c-49fa-884f-82e3523863c9 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:41:12.698688 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-eeb6dfb6-8c6c-49fa-884f-82e3523863c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:12.727139 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 843/1681] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:41:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:41:12.727960 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e2e84a-b404-4a04-966b-5eefd214af2f None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:12.746025 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e2e84a-b404-4a04-966b-5eefd214af2f None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:12.772320 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9528598b-d052-4037-a295-b6e64fd71dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:12.772773 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9528598b-d052-4037-a295-b6e64fd71dde admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:12.773063 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9528598b-d052-4037-a295-b6e64fd71dde admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:12.773343 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9528598b-d052-4037-a295-b6e64fd71dde admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:12.774743 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9528598b-d052-4037-a295-b6e64fd71dde admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:41:12.775066 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9528598b-d052-4037-a295-b6e64fd71dde admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:12.776730 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9528598b-d052-4037-a295-b6e64fd71dde admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:12.829681 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 839/1682] 10.222.0.70 () {58 vars in 1153 bytes} [Tue Aug 2 21:41:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:41:12.834966 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb6dfb6-8c6c-49fa-884f-82e3523863c9 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:12.856380 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb6dfb6-8c6c-49fa-884f-82e3523863c9 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:12.870132 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4720ea8-00ae-4858-8111-0dbc240110b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:12.870774 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4720ea8-00ae-4858-8111-0dbc240110b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:12.871055 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4720ea8-00ae-4858-8111-0dbc240110b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:12.871326 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4720ea8-00ae-4858-8111-0dbc240110b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:12.872110 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4720ea8-00ae-4858-8111-0dbc240110b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:12.874068 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4720ea8-00ae-4858-8111-0dbc240110b5 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:12.936269 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 844/1683] 10.222.0.70 () {60 vars in 1153 bytes} [Tue Aug 2 21:41:12 2022] POST /identity/v3/projects => generated 369 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:41:12.940498 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9528598b-d052-4037-a295-b6e64fd71dde admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:12.951571 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9528598b-d052-4037-a295-b6e64fd71dde admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:13.103397 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8bdaf8-81f1-4cb7-aa1b-a882ba53cbe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:13.104538 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8bdaf8-81f1-4cb7-aa1b-a882ba53cbe7 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:13.105239 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8bdaf8-81f1-4cb7-aa1b-a882ba53cbe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:13.105620 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8bdaf8-81f1-4cb7-aa1b-a882ba53cbe7 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:13.106797 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8bdaf8-81f1-4cb7-aa1b-a882ba53cbe7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:13.109488 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8bdaf8-81f1-4cb7-aa1b-a882ba53cbe7 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:13.150311 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 840/1684] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 2 21:41:12 2022] POST /identity/v3/users => generated 285 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:41:13.153853 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4720ea8-00ae-4858-8111-0dbc240110b5 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:13.170952 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4720ea8-00ae-4858-8111-0dbc240110b5 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:13.179171 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c558660-c33e-4928-8d4f-657aff6cee0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:13.180065 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c558660-c33e-4928-8d4f-657aff6cee0b admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:13.180395 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c558660-c33e-4928-8d4f-657aff6cee0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:13.180826 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c558660-c33e-4928-8d4f-657aff6cee0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:13.181549 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c558660-c33e-4928-8d4f-657aff6cee0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:13.183770 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c558660-c33e-4928-8d4f-657aff6cee0b admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:13.201316 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 845/1685] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:41:13 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:41:13.204996 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8bdaf8-81f1-4cb7-aa1b-a882ba53cbe7 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:13.223548 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8bdaf8-81f1-4cb7-aa1b-a882ba53cbe7 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:13.242849 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25551d2f-4d1d-4e55-a6c8-e08c111738e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:13.243421 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25551d2f-4d1d-4e55-a6c8-e08c111738e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:13.243676 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25551d2f-4d1d-4e55-a6c8-e08c111738e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:13.244010 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25551d2f-4d1d-4e55-a6c8-e08c111738e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:13.244753 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25551d2f-4d1d-4e55-a6c8-e08c111738e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:13.246391 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25551d2f-4d1d-4e55-a6c8-e08c111738e6 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:13.293392 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 841/1686] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:41:13 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 21:41:13.294843 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c558660-c33e-4928-8d4f-657aff6cee0b admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:13.323875 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c558660-c33e-4928-8d4f-657aff6cee0b admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:13.336930 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0a6e6c-7e5b-4b61-b1bf-17b98094cfb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:13.337682 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0a6e6c-7e5b-4b61-b1bf-17b98094cfb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:13.337993 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0a6e6c-7e5b-4b61-b1bf-17b98094cfb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:13.338280 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0a6e6c-7e5b-4b61-b1bf-17b98094cfb4 admin admin] PATH_INFO: `/v3/projects/e6b67529e4424d9983fba6b3ec6681d6/users/de428fb0f7d349a7bb50d069500ce32e/roles/462e3381a85c42a9959201f9aa122f7c` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:13.369291 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25551d2f-4d1d-4e55-a6c8-e08c111738e6 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:13.377106 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-25551d2f-4d1d-4e55-a6c8-e08c111738e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:13.387389 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0a6e6c-7e5b-4b61-b1bf-17b98094cfb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6b67529e4424d9983fba6b3ec6681d6, user_id=de428fb0f7d349a7bb50d069500ce32e, role_id=462e3381a85c42a9959201f9aa122f7c)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:13.390902 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0a6e6c-7e5b-4b61-b1bf-17b98094cfb4 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:13.418552 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 846/1687] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:41:13 2022] PUT /identity/v3/projects/e6b67529e4424d9983fba6b3ec6681d6/users/de428fb0f7d349a7bb50d069500ce32e/roles/462e3381a85c42a9959201f9aa122f7c => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:41:13.418860 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25551d2f-4d1d-4e55-a6c8-e08c111738e6 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:13.424667 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca574ba-3c6b-4589-be71-db7df0e813ce None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:13.425240 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca574ba-3c6b-4589-be71-db7df0e813ce None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:13.431288 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca574ba-3c6b-4589-be71-db7df0e813ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:13.482015 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-0ca574ba-3c6b-4589-be71-db7df0e813ce None None] MFA Rules not processed for user `de428fb0f7d349a7bb50d069500ce32e`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:41:13.483400 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-0ca574ba-3c6b-4589-be71-db7df0e813ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:13.524192 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:13.635328 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08b4d79-81d9-43cd-8380-a3797da573c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:13.636021 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08b4d79-81d9-43cd-8380-a3797da573c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:13.636331 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08b4d79-81d9-43cd-8380-a3797da573c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:13.636825 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08b4d79-81d9-43cd-8380-a3797da573c2 admin admin] PATH_INFO: `/v3/users/9a670dc222f64ed3b3e2f9ba5f63fb9a` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:13.640868 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08b4d79-81d9-43cd-8380-a3797da573c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a670dc222f64ed3b3e2f9ba5f63fb9a)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:13.642819 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08b4d79-81d9-43cd-8380-a3797da573c2 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:13.672895 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 847/1688] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:41:13 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:41:13.677244 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca574ba-3c6b-4589-be71-db7df0e813ce None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:13.704090 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca574ba-3c6b-4589-be71-db7df0e813ce None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:13.726861 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1ec242-bad6-48ed-9e3b-0f18b4b16332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:13.730011 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1ec242-bad6-48ed-9e3b-0f18b4b16332 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:13.731116 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1ec242-bad6-48ed-9e3b-0f18b4b16332 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:13.731685 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1ec242-bad6-48ed-9e3b-0f18b4b16332 admin admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:13.733791 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1ec242-bad6-48ed-9e3b-0f18b4b16332 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:13.737810 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1ec242-bad6-48ed-9e3b-0f18b4b16332 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:13.774176 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-a08b4d79-81d9-43cd-8380-a3797da573c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a670dc222f64ed3b3e2f9ba5f63fb9a'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:13.792088 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-a08b4d79-81d9-43cd-8380-a3797da573c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a670dc222f64ed3b3e2f9ba5f63fb9a'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:13.820826 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 848/1689] 10.222.0.70 () {60 vars in 1153 bytes} [Tue Aug 2 21:41:13 2022] POST /identity/v3/projects => generated 369 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:41:13.824316 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-a08b4d79-81d9-43cd-8380-a3797da573c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a670dc222f64ed3b3e2f9ba5f63fb9a'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:13.825446 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1ec242-bad6-48ed-9e3b-0f18b4b16332 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:13.826180 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-a08b4d79-81d9-43cd-8380-a3797da573c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a670dc222f64ed3b3e2f9ba5f63fb9a'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:13.829297 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-ef1ec242-bad6-48ed-9e3b-0f18b4b16332 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:13.848255 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-a08b4d79-81d9-43cd-8380-a3797da573c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a670dc222f64ed3b3e2f9ba5f63fb9a'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:13.869079 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 842/1690] 10.222.0.70 () {58 vars in 1224 bytes} [Tue Aug 2 21:41:13 2022] DELETE /identity/v3/users/9a670dc222f64ed3b3e2f9ba5f63fb9a => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:41:13.870561 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4badeb5-1e8a-4e6a-89cc-b4e6df9dcdf4 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:13.870861 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4badeb5-1e8a-4e6a-89cc-b4e6df9dcdf4 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:13.871158 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4badeb5-1e8a-4e6a-89cc-b4e6df9dcdf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:13.934114 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-b4badeb5-1e8a-4e6a-89cc-b4e6df9dcdf4 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:41:13.937361 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-b4badeb5-1e8a-4e6a-89cc-b4e6df9dcdf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:13.999231 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:14.011086 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1ec242-bad6-48ed-9e3b-0f18b4b16332 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:14.106830 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 843/1691] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:41:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:41:14.135204 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033550b7-ef61-4bf8-8d25-5f7bf116aec0 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:14.135505 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033550b7-ef61-4bf8-8d25-5f7bf116aec0 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:14.135794 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033550b7-ef61-4bf8-8d25-5f7bf116aec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:14.161349 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6d3269-a41d-4755-8304-cad1808cce79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:14.161989 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d3269-a41d-4755-8304-cad1808cce79 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:14.162274 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d3269-a41d-4755-8304-cad1808cce79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:14.165182 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6d3269-a41d-4755-8304-cad1808cce79 admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:14.165976 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6d3269-a41d-4755-8304-cad1808cce79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:14.167973 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6d3269-a41d-4755-8304-cad1808cce79 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:14.199835 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-033550b7-ef61-4bf8-8d25-5f7bf116aec0 None None] MFA Rules not processed for user `54c59604553a491b9276bd45b3a2f6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:41:14.205569 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-033550b7-ef61-4bf8-8d25-5f7bf116aec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:14.231918 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 849/1692] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 2 21:41:13 2022] POST /identity/v3/users => generated 291 bytes in 407 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:41:14.234660 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6d3269-a41d-4755-8304-cad1808cce79 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:14.238282 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-6c6d3269-a41d-4755-8304-cad1808cce79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:14.297201 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:14.397774 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 844/1693] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:41:14 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:41:14.398700 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033550b7-ef61-4bf8-8d25-5f7bf116aec0 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:14.402860 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6d3269-a41d-4755-8304-cad1808cce79 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:14.414353 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c63533a-ca4a-43c9-a5f7-41cf52e19959 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '723f5f43572a493dae0349070a2adb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:14.414853 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c63533a-ca4a-43c9-a5f7-41cf52e19959 service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:14.415140 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c63533a-ca4a-43c9-a5f7-41cf52e19959 service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:14.415416 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c63533a-ca4a-43c9-a5f7-41cf52e19959 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:14.422814 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033550b7-ef61-4bf8-8d25-5f7bf116aec0 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:14.434735 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0868b0b4-5652-4018-b902-1b55c7fefcad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:14.436826 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0868b0b4-5652-4018-b902-1b55c7fefcad admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:14.437117 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0868b0b4-5652-4018-b902-1b55c7fefcad admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:14.437398 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0868b0b4-5652-4018-b902-1b55c7fefcad admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:14.438121 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0868b0b4-5652-4018-b902-1b55c7fefcad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:14.441676 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c63533a-ca4a-43c9-a5f7-41cf52e19959 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:14.443169 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c63533a-ca4a-43c9-a5f7-41cf52e19959 service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:14.446421 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0868b0b4-5652-4018-b902-1b55c7fefcad admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:14.471193 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 845/1694] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:41:14 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:41:14.473581 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 850/1695] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:41:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:41:14.475523 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c63533a-ca4a-43c9-a5f7-41cf52e19959 service neutron] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:14.476464 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0868b0b4-5652-4018-b902-1b55c7fefcad admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:14.482572 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-0868b0b4-5652-4018-b902-1b55c7fefcad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:14.493978 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c63533a-ca4a-43c9-a5f7-41cf52e19959 service neutron] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:14.532033 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0230530-1883-4768-9997-3e6353fff3ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:14.534533 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0230530-1883-4768-9997-3e6353fff3ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:14.534988 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0230530-1883-4768-9997-3e6353fff3ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:14.537974 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0230530-1883-4768-9997-3e6353fff3ba admin admin] PATH_INFO: `/v3/projects/9a0ddee54cc84bac903e22b48e14fe87/users/3cfb968e5d3b4c50bf18ff7256c0f50e/roles/3e32dbf75f9b41f5adb9fe59851267bb` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:14.592058 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0230530-1883-4768-9997-3e6353fff3ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a0ddee54cc84bac903e22b48e14fe87, user_id=3cfb968e5d3b4c50bf18ff7256c0f50e, role_id=3e32dbf75f9b41f5adb9fe59851267bb)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:14.599590 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0230530-1883-4768-9997-3e6353fff3ba admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:14.630376 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 851/1696] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:41:14 2022] PUT /identity/v3/projects/9a0ddee54cc84bac903e22b48e14fe87/users/3cfb968e5d3b4c50bf18ff7256c0f50e/roles/3e32dbf75f9b41f5adb9fe59851267bb => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:41:14.634850 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0230530-1883-4768-9997-3e6353fff3ba admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:14.702691 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0868b0b4-5652-4018-b902-1b55c7fefcad admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:14.806299 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0230530-1883-4768-9997-3e6353fff3ba admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:14.822934 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c96c4da-0b91-49d9-a6ed-6a58d83740fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:14.823588 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c96c4da-0b91-49d9-a6ed-6a58d83740fa admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:14.823870 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c96c4da-0b91-49d9-a6ed-6a58d83740fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:14.824455 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c96c4da-0b91-49d9-a6ed-6a58d83740fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:14.825146 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c96c4da-0b91-49d9-a6ed-6a58d83740fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:14.832001 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c96c4da-0b91-49d9-a6ed-6a58d83740fa admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:14.878191 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 852/1697] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:41:14 2022] GET /identity/v3/roles => generated 1420 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:41:14.880487 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c96c4da-0b91-49d9-a6ed-6a58d83740fa admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:14.895427 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c96c4da-0b91-49d9-a6ed-6a58d83740fa admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:14.912181 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce684c6-874f-4d1e-93c8-8a8a66bccd01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:14.918536 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce684c6-874f-4d1e-93c8-8a8a66bccd01 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:14.918897 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce684c6-874f-4d1e-93c8-8a8a66bccd01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:14.924267 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce684c6-874f-4d1e-93c8-8a8a66bccd01 admin admin] PATH_INFO: `/v3/projects/9a0ddee54cc84bac903e22b48e14fe87/users/3cfb968e5d3b4c50bf18ff7256c0f50e/roles/3e32dbf75f9b41f5adb9fe59851267bb` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:14.924267 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce684c6-874f-4d1e-93c8-8a8a66bccd01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a0ddee54cc84bac903e22b48e14fe87, user_id=3cfb968e5d3b4c50bf18ff7256c0f50e, role_id=3e32dbf75f9b41f5adb9fe59851267bb)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:14.927079 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce684c6-874f-4d1e-93c8-8a8a66bccd01 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:14.931673 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:14.932970 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bfc8d7-c3a0-4e9c-a8b3-a8cfac0d45c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87dd5c1c5e854d4b96e0b7dad6aa3719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:14.933960 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bfc8d7-c3a0-4e9c-a8b3-a8cfac0d45c3 service nova] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:14.936423 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bfc8d7-c3a0-4e9c-a8b3-a8cfac0d45c3 service nova] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:14.936423 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bfc8d7-c3a0-4e9c-a8b3-a8cfac0d45c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:14.970701 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 853/1698] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:41:14 2022] PUT /identity/v3/projects/9a0ddee54cc84bac903e22b48e14fe87/users/3cfb968e5d3b4c50bf18ff7256c0f50e/roles/3e32dbf75f9b41f5adb9fe59851267bb => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:41:14.986597 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4499143b-2fe8-4a7e-83d4-07bf2833b68f None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:14.986809 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4499143b-2fe8-4a7e-83d4-07bf2833b68f None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:14.987762 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4499143b-2fe8-4a7e-83d4-07bf2833b68f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:15.053915 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-4499143b-2fe8-4a7e-83d4-07bf2833b68f None None] MFA Rules not processed for user `3cfb968e5d3b4c50bf18ff7256c0f50e`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:41:15.055303 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-4499143b-2fe8-4a7e-83d4-07bf2833b68f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:15.105564 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bfc8d7-c3a0-4e9c-a8b3-a8cfac0d45c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:15.107689 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bfc8d7-c3a0-4e9c-a8b3-a8cfac0d45c3 service nova] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:15.139173 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:15.162003 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 846/1699] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:41:14 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 690 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:41:15.188594 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 854/1700] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:41:14 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:41:15.204641 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bfc8d7-c3a0-4e9c-a8b3-a8cfac0d45c3 service nova] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:15.206152 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-a0bfc8d7-c3a0-4e9c-a8b3-a8cfac0d45c3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:15.338856 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bfc8d7-c3a0-4e9c-a8b3-a8cfac0d45c3 service nova] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:15.434929 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7115c3-34da-47ef-b524-f0363409f9b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '123eb76f95ee4e39905944da701c712d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:15.436374 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7115c3-34da-47ef-b524-f0363409f9b4 service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:15.436954 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7115c3-34da-47ef-b524-f0363409f9b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:15.437468 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7115c3-34da-47ef-b524-f0363409f9b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:15.455407 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7115c3-34da-47ef-b524-f0363409f9b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:15.464482 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7115c3-34da-47ef-b524-f0363409f9b4 service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:15.486785 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 847/1701] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:41:15 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:41:15.555531 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4499143b-2fe8-4a7e-83d4-07bf2833b68f None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:15.561265 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-4499143b-2fe8-4a7e-83d4-07bf2833b68f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:15.715598 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4499143b-2fe8-4a7e-83d4-07bf2833b68f None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:15.722067 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e083f83d-4f6b-4e7a-8a8f-8fd8c93f6478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:15.726362 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e083f83d-4f6b-4e7a-8a8f-8fd8c93f6478 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:15.727545 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e083f83d-4f6b-4e7a-8a8f-8fd8c93f6478 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:15.729552 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e083f83d-4f6b-4e7a-8a8f-8fd8c93f6478 admin admin] PATH_INFO: `/v3/projects/03598416026b4767afa26895a859a619` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:15.733904 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e083f83d-4f6b-4e7a-8a8f-8fd8c93f6478 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03598416026b4767afa26895a859a619)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:15.738099 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e083f83d-4f6b-4e7a-8a8f-8fd8c93f6478 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:15.847923 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-e083f83d-4f6b-4e7a-8a8f-8fd8c93f6478 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03598416026b4767afa26895a859a619', 'request_id': 'req-e083f83d-4f6b-4e7a-8a8f-8fd8c93f6478'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:15.851011 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-e083f83d-4f6b-4e7a-8a8f-8fd8c93f6478 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03598416026b4767afa26895a859a619', 'request_id': 'req-e083f83d-4f6b-4e7a-8a8f-8fd8c93f6478'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:15.868711 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-e083f83d-4f6b-4e7a-8a8f-8fd8c93f6478 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03598416026b4767afa26895a859a619', 'request_id': 'req-e083f83d-4f6b-4e7a-8a8f-8fd8c93f6478'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:15.920906 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-e083f83d-4f6b-4e7a-8a8f-8fd8c93f6478 admin admin] The token cache is being invalidate because project 03598416026b4767afa26895a859a619 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:41:15.921549 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-e083f83d-4f6b-4e7a-8a8f-8fd8c93f6478 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:15.923275 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-e083f83d-4f6b-4e7a-8a8f-8fd8c93f6478 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:15.926432 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 855/1702] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Aug 2 21:41:15 2022] DELETE /identity/v3/projects/03598416026b4767afa26895a859a619 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:41:15.931553 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23394f7-f83b-438c-9a98-ad7d151b1ff5 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:15.932157 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23394f7-f83b-438c-9a98-ad7d151b1ff5 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:15.932759 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23394f7-f83b-438c-9a98-ad7d151b1ff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:15.976198 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-a23394f7-f83b-438c-9a98-ad7d151b1ff5 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:41:15.979798 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-a23394f7-f83b-438c-9a98-ad7d151b1ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:16.017320 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d127642-4679-4d2d-8cca-ae58b582a927 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:16.017602 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d127642-4679-4d2d-8cca-ae58b582a927 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:16.017878 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d127642-4679-4d2d-8cca-ae58b582a927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:16.068534 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-1d127642-4679-4d2d-8cca-ae58b582a927 None None] MFA Rules not processed for user `182daeeee91b4594b4eab1c28cba5067`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:41:16.069810 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-1d127642-4679-4d2d-8cca-ae58b582a927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:16.081385 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:16.178490 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 848/1703] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:41:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:41:16.182844 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e663c1-4474-44b5-b507-c20981b2d017 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:16.183235 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e663c1-4474-44b5-b507-c20981b2d017 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:16.183649 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e663c1-4474-44b5-b507-c20981b2d017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:16.231490 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 856/1704] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:41:16 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:41:16.279977 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-21e663c1-4474-44b5-b507-c20981b2d017 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:41:16.299220 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-21e663c1-4474-44b5-b507-c20981b2d017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:16.332059 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 849/1705] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:41:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:41:16.333518 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d127642-4679-4d2d-8cca-ae58b582a927 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:16.347667 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d127642-4679-4d2d-8cca-ae58b582a927 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:16.364384 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755ddeb1-1d80-4936-93d3-afd82165d7c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:16.365388 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755ddeb1-1d80-4936-93d3-afd82165d7c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:16.365388 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755ddeb1-1d80-4936-93d3-afd82165d7c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:16.367011 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755ddeb1-1d80-4936-93d3-afd82165d7c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:16.370040 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755ddeb1-1d80-4936-93d3-afd82165d7c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:41:16.370378 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755ddeb1-1d80-4936-93d3-afd82165d7c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:16.382211 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755ddeb1-1d80-4936-93d3-afd82165d7c2 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:16.420528 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 857/1706] 10.222.0.70 () {58 vars in 1153 bytes} [Tue Aug 2 21:41:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:41:16.421703 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e663c1-4474-44b5-b507-c20981b2d017 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:16.446870 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e663c1-4474-44b5-b507-c20981b2d017 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:16.462526 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8537f371-c7b7-4ede-a8e9-e5b1805761a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:16.463181 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8537f371-c7b7-4ede-a8e9-e5b1805761a8 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:16.463496 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8537f371-c7b7-4ede-a8e9-e5b1805761a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:16.463734 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8537f371-c7b7-4ede-a8e9-e5b1805761a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:16.464521 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8537f371-c7b7-4ede-a8e9-e5b1805761a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:16.466548 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8537f371-c7b7-4ede-a8e9-e5b1805761a8 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:16.531895 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 850/1707] 10.222.0.70 () {60 vars in 1153 bytes} [Tue Aug 2 21:41:16 2022] POST /identity/v3/projects => generated 367 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 21:41:16.535457 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755ddeb1-1d80-4936-93d3-afd82165d7c2 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:16.554868 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755ddeb1-1d80-4936-93d3-afd82165d7c2 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:16.716567 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3f5f34-096b-40b9-8f23-f21b9507d039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:16.718149 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f5f34-096b-40b9-8f23-f21b9507d039 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:16.718646 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f5f34-096b-40b9-8f23-f21b9507d039 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:16.718994 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f5f34-096b-40b9-8f23-f21b9507d039 admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:16.719933 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3f5f34-096b-40b9-8f23-f21b9507d039 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:16.724200 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3f5f34-096b-40b9-8f23-f21b9507d039 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:16.785960 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 858/1708] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 2 21:41:16 2022] POST /identity/v3/users => generated 284 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:41:16.787064 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8537f371-c7b7-4ede-a8e9-e5b1805761a8 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:16.801766 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8537f371-c7b7-4ede-a8e9-e5b1805761a8 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:16.808319 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b51b24-cb1e-4de9-a2f6-bd0b2d39155a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:16.809001 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b51b24-cb1e-4de9-a2f6-bd0b2d39155a admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:16.809289 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b51b24-cb1e-4de9-a2f6-bd0b2d39155a admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:16.809717 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b51b24-cb1e-4de9-a2f6-bd0b2d39155a admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:16.810593 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b51b24-cb1e-4de9-a2f6-bd0b2d39155a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:16.815775 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b51b24-cb1e-4de9-a2f6-bd0b2d39155a admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:16.842462 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 851/1709] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:41:16 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:41:16.843868 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3f5f34-096b-40b9-8f23-f21b9507d039 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:16.864312 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3f5f34-096b-40b9-8f23-f21b9507d039 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:16.871588 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab14b91-2248-4438-92ae-f18c305136dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:16.872438 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab14b91-2248-4438-92ae-f18c305136dc admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:16.872731 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab14b91-2248-4438-92ae-f18c305136dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:16.873014 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab14b91-2248-4438-92ae-f18c305136dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:16.873736 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab14b91-2248-4438-92ae-f18c305136dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:16.875428 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab14b91-2248-4438-92ae-f18c305136dc admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:16.914107 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b51b24-cb1e-4de9-a2f6-bd0b2d39155a admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:16.916352 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 859/1710] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:41:16 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:41:16.951377 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b51b24-cb1e-4de9-a2f6-bd0b2d39155a admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:16.984787 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b39872e-b0d9-4d8e-9c7f-5c7e74445462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:16.989866 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b39872e-b0d9-4d8e-9c7f-5c7e74445462 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:16.993023 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b39872e-b0d9-4d8e-9c7f-5c7e74445462 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:16.995383 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b39872e-b0d9-4d8e-9c7f-5c7e74445462 admin admin] PATH_INFO: `/v3/projects/62a6e8fdbb72410c8a263492e1f2613c/users/fa71c189b1c24c97beb00bdce2872287/roles/462e3381a85c42a9959201f9aa122f7c` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:17.052137 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b39872e-b0d9-4d8e-9c7f-5c7e74445462 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62a6e8fdbb72410c8a263492e1f2613c, user_id=fa71c189b1c24c97beb00bdce2872287, role_id=462e3381a85c42a9959201f9aa122f7c)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:17.054923 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b39872e-b0d9-4d8e-9c7f-5c7e74445462 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:17.065525 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:17.102567 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5916d09-e994-42c8-b189-edcdbac3d6f9 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:17.103156 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5916d09-e994-42c8-b189-edcdbac3d6f9 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:17.103476 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5916d09-e994-42c8-b189-edcdbac3d6f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:17.107313 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 852/1711] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:41:16 2022] PUT /identity/v3/projects/62a6e8fdbb72410c8a263492e1f2613c/users/fa71c189b1c24c97beb00bdce2872287/roles/462e3381a85c42a9959201f9aa122f7c => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:41:17.159538 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-a5916d09-e994-42c8-b189-edcdbac3d6f9 None None] MFA Rules not processed for user `fa71c189b1c24c97beb00bdce2872287`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:41:17.162673 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-a5916d09-e994-42c8-b189-edcdbac3d6f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:17.285743 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a58440-e699-4000-91e9-55262142998b None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:17.286036 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a58440-e699-4000-91e9-55262142998b None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:17.286317 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a58440-e699-4000-91e9-55262142998b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:17.354440 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 860/1712] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:41:17 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:41:17.356275 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5916d09-e994-42c8-b189-edcdbac3d6f9 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:17.383335 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:17.385913 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-b1a58440-e699-4000-91e9-55262142998b None None] MFA Rules not processed for user `05fc0253234e42e7acbcc2f0959ac0db`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:41:17.388548 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-b1a58440-e699-4000-91e9-55262142998b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:17.544732 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5916d09-e994-42c8-b189-edcdbac3d6f9 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:17.558522 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf6fc8a-804f-49f7-abc7-55c47f1183e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:17.559172 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf6fc8a-804f-49f7-abc7-55c47f1183e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:17.564198 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf6fc8a-804f-49f7-abc7-55c47f1183e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:17.564588 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf6fc8a-804f-49f7-abc7-55c47f1183e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:17.565881 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf6fc8a-804f-49f7-abc7-55c47f1183e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:17.575286 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf6fc8a-804f-49f7-abc7-55c47f1183e6 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:17.601904 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 853/1713] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:41:17 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:41:17.602760 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a58440-e699-4000-91e9-55262142998b None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:17.611760 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-b1a58440-e699-4000-91e9-55262142998b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:17.655671 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a58440-e699-4000-91e9-55262142998b None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:17.667371 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 861/1714] 10.222.0.70 () {60 vars in 1153 bytes} [Tue Aug 2 21:41:17 2022] POST /identity/v3/projects => generated 367 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:41:17.668164 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf6fc8a-804f-49f7-abc7-55c47f1183e6 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:17.676860 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-ecf6fc8a-804f-49f7-abc7-55c47f1183e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:17.684324 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf192c3d-b1ac-45aa-b668-7417260abc70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:17.686074 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf192c3d-b1ac-45aa-b668-7417260abc70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:17.686736 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf192c3d-b1ac-45aa-b668-7417260abc70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:17.688153 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf192c3d-b1ac-45aa-b668-7417260abc70 admin admin] PATH_INFO: `/v3/projects/1a43727fdcb34d5e935596f80e5e23d9` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:17.694989 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf192c3d-b1ac-45aa-b668-7417260abc70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a43727fdcb34d5e935596f80e5e23d9)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:17.702736 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf192c3d-b1ac-45aa-b668-7417260abc70 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:17.840150 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-bf192c3d-b1ac-45aa-b668-7417260abc70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a43727fdcb34d5e935596f80e5e23d9', 'request_id': 'req-bf192c3d-b1ac-45aa-b668-7417260abc70'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:17.869020 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-bf192c3d-b1ac-45aa-b668-7417260abc70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a43727fdcb34d5e935596f80e5e23d9', 'request_id': 'req-bf192c3d-b1ac-45aa-b668-7417260abc70'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:17.881417 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-bf192c3d-b1ac-45aa-b668-7417260abc70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a43727fdcb34d5e935596f80e5e23d9', 'request_id': 'req-bf192c3d-b1ac-45aa-b668-7417260abc70'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:17.896368 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf6fc8a-804f-49f7-abc7-55c47f1183e6 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:17.921185 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-bf192c3d-b1ac-45aa-b668-7417260abc70 admin admin] The token cache is being invalidate because project 1a43727fdcb34d5e935596f80e5e23d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:41:17.921478 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-bf192c3d-b1ac-45aa-b668-7417260abc70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:17.925359 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-bf192c3d-b1ac-45aa-b668-7417260abc70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:17.927444 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 854/1715] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Aug 2 21:41:17 2022] DELETE /identity/v3/projects/1a43727fdcb34d5e935596f80e5e23d9 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:41:17.928462 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf192c3d-b1ac-45aa-b668-7417260abc70 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:17.930518 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-bf192c3d-b1ac-45aa-b668-7417260abc70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:18.126163 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb53f69-4474-44b2-8500-5648a884a32d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87dd5c1c5e854d4b96e0b7dad6aa3719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:18.129134 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb53f69-4474-44b2-8500-5648a884a32d service nova] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:18.129742 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb53f69-4474-44b2-8500-5648a884a32d service nova] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:18.130034 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb53f69-4474-44b2-8500-5648a884a32d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:18.136963 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-ffb53f69-4474-44b2-8500-5648a884a32d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:18.146736 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf192c3d-b1ac-45aa-b668-7417260abc70 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:18.164875 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc551058-5c43-49ad-88b0-208f1e1ae2f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:18.165821 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc551058-5c43-49ad-88b0-208f1e1ae2f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:18.166111 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc551058-5c43-49ad-88b0-208f1e1ae2f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:18.168076 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc551058-5c43-49ad-88b0-208f1e1ae2f2 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:18.171748 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc551058-5c43-49ad-88b0-208f1e1ae2f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:18.179200 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc551058-5c43-49ad-88b0-208f1e1ae2f2 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:18.224899 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:18.230233 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:18.239933 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 855/1716] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 2 21:41:17 2022] POST /identity/v3/users => generated 290 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:41:18.242040 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc551058-5c43-49ad-88b0-208f1e1ae2f2 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:18.245497 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-fc551058-5c43-49ad-88b0-208f1e1ae2f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:18.301079 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc551058-5c43-49ad-88b0-208f1e1ae2f2 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:18.316302 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3ef521-2068-4099-8ca8-06fb1b194529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:18.318490 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3ef521-2068-4099-8ca8-06fb1b194529 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:18.319837 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3ef521-2068-4099-8ca8-06fb1b194529 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:18.320789 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3ef521-2068-4099-8ca8-06fb1b194529 admin admin] PATH_INFO: `/v3/users/2be2d72cd57c472aa424dfce40512f1a` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:18.324983 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3ef521-2068-4099-8ca8-06fb1b194529 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2be2d72cd57c472aa424dfce40512f1a)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:18.332731 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3ef521-2068-4099-8ca8-06fb1b194529 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:18.341282 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb53f69-4474-44b2-8500-5648a884a32d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:18.355094 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb53f69-4474-44b2-8500-5648a884a32d service nova] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:18.389310 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 862/1717] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:41:17 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 721 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:41:18.390829 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e6439c-c5a7-40a6-9079-d02d4847cf5d None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:18.394212 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e6439c-c5a7-40a6-9079-d02d4847cf5d None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:18.394653 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e6439c-c5a7-40a6-9079-d02d4847cf5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:18.510026 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-8d3ef521-2068-4099-8ca8-06fb1b194529 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2be2d72cd57c472aa424dfce40512f1a'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:18.515629 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-88e6439c-c5a7-40a6-9079-d02d4847cf5d None None] MFA Rules not processed for user `3081e110cdd94b8aa51f7bb237aec635`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:41:18.517090 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-88e6439c-c5a7-40a6-9079-d02d4847cf5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:18.544119 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-8d3ef521-2068-4099-8ca8-06fb1b194529 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2be2d72cd57c472aa424dfce40512f1a'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:18.583812 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-8d3ef521-2068-4099-8ca8-06fb1b194529 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2be2d72cd57c472aa424dfce40512f1a'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:18.584654 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-8d3ef521-2068-4099-8ca8-06fb1b194529 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2be2d72cd57c472aa424dfce40512f1a'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:18.603117 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-8d3ef521-2068-4099-8ca8-06fb1b194529 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2be2d72cd57c472aa424dfce40512f1a'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:18.629882 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 856/1718] 10.222.0.70 () {58 vars in 1224 bytes} [Tue Aug 2 21:41:18 2022] DELETE /identity/v3/users/2be2d72cd57c472aa424dfce40512f1a => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:41:18.630853 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3ef521-2068-4099-8ca8-06fb1b194529 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:18.639190 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-8d3ef521-2068-4099-8ca8-06fb1b194529 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:18.726106 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 863/1719] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:41:18 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:41:18.727642 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e40fa97-2837-4448-9d68-16c4932db9da None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:18.727938 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e40fa97-2837-4448-9d68-16c4932db9da None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:18.728219 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e40fa97-2837-4448-9d68-16c4932db9da None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:18.729981 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 864/1720] 10.222.0.70 () {54 vars in 912 bytes} [Tue Aug 2 21:41:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:41:18.730718 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e40fa97-2837-4448-9d68-16c4932db9da None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:18.732510 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-6e40fa97-2837-4448-9d68-16c4932db9da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:18.864898 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3ef521-2068-4099-8ca8-06fb1b194529 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:18.870813 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba8b1cd-de26-4f0a-9bd4-2690c311ad99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:18.871889 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba8b1cd-de26-4f0a-9bd4-2690c311ad99 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:18.872817 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba8b1cd-de26-4f0a-9bd4-2690c311ad99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:18.873208 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba8b1cd-de26-4f0a-9bd4-2690c311ad99 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:18.874106 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba8b1cd-de26-4f0a-9bd4-2690c311ad99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:18.876207 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba8b1cd-de26-4f0a-9bd4-2690c311ad99 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:18.894223 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e40fa97-2837-4448-9d68-16c4932db9da None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:18.906261 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 857/1721] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:41:18 2022] GET /identity/v3/roles => generated 1420 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:41:18.908159 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d0201-73a4-4b8e-a8de-4ae50ee042f0 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:18.908904 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d0201-73a4-4b8e-a8de-4ae50ee042f0 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:18.909132 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5d0201-73a4-4b8e-a8de-4ae50ee042f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:18.909745 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1b6bd6-17a6-4667-922e-22bee80f490f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:18.910426 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1b6bd6-17a6-4667-922e-22bee80f490f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:18.910717 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1b6bd6-17a6-4667-922e-22bee80f490f admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:18.910993 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1b6bd6-17a6-4667-922e-22bee80f490f admin admin] PATH_INFO: `/v3/users/de428fb0f7d349a7bb50d069500ce32e` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:18.913965 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1b6bd6-17a6-4667-922e-22bee80f490f admin admin] RBAC: Authorizing `identity:delete_user(user_id=de428fb0f7d349a7bb50d069500ce32e)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:18.916203 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1b6bd6-17a6-4667-922e-22bee80f490f admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:18.937941 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-bb5d0201-73a4-4b8e-a8de-4ae50ee042f0 None None] MFA Rules not processed for user `3081e110cdd94b8aa51f7bb237aec635`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:41:18.939405 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-bb5d0201-73a4-4b8e-a8de-4ae50ee042f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:19.017554 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 858/1722] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:41:18 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:41:19.019246 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae88ff1d-f721-4797-a227-1d290287bc38 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:19.019830 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae88ff1d-f721-4797-a227-1d290287bc38 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:19.020737 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae88ff1d-f721-4797-a227-1d290287bc38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:19.021658 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-ff1b6bd6-17a6-4667-922e-22bee80f490f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de428fb0f7d349a7bb50d069500ce32e'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:19.044751 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-ff1b6bd6-17a6-4667-922e-22bee80f490f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de428fb0f7d349a7bb50d069500ce32e'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:19.056304 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:19.071371 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:19.073114 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-ff1b6bd6-17a6-4667-922e-22bee80f490f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de428fb0f7d349a7bb50d069500ce32e'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:19.089287 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-ff1b6bd6-17a6-4667-922e-22bee80f490f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de428fb0f7d349a7bb50d069500ce32e'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:19.091744 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-ff1b6bd6-17a6-4667-922e-22bee80f490f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de428fb0f7d349a7bb50d069500ce32e'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:19.106350 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 865/1723] 10.222.0.70 () {58 vars in 1224 bytes} [Tue Aug 2 21:41:18 2022] DELETE /identity/v3/users/de428fb0f7d349a7bb50d069500ce32e => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:41:19.107519 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1b6bd6-17a6-4667-922e-22bee80f490f admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:19.112440 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-ff1b6bd6-17a6-4667-922e-22bee80f490f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:19.121302 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-ae88ff1d-f721-4797-a227-1d290287bc38 None None] MFA Rules not processed for user `723f5f43572a493dae0349070a2adb5e`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:41:19.124907 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-ae88ff1d-f721-4797-a227-1d290287bc38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:19.262099 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 859/1724] 10.222.0.70 () {58 vars in 1009 bytes} [Tue Aug 2 21:41:19 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:41:19.262855 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae88ff1d-f721-4797-a227-1d290287bc38 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:19.264216 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-ae88ff1d-f721-4797-a227-1d290287bc38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:19.283432 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1b6bd6-17a6-4667-922e-22bee80f490f admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:19.291846 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94196c23-9189-411b-b5de-c1ee2e2525c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:19.292902 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94196c23-9189-411b-b5de-c1ee2e2525c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:19.295501 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94196c23-9189-411b-b5de-c1ee2e2525c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:19.311336 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94196c23-9189-411b-b5de-c1ee2e2525c9 admin admin] PATH_INFO: `/v3/projects/7de4257a985e45d5aeea6b23c618f1dd/users/f6b3bd043e0644daa38ad0f9a095e9da/roles/3e32dbf75f9b41f5adb9fe59851267bb` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:19.350249 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94196c23-9189-411b-b5de-c1ee2e2525c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7de4257a985e45d5aeea6b23c618f1dd, user_id=f6b3bd043e0644daa38ad0f9a095e9da, role_id=3e32dbf75f9b41f5adb9fe59851267bb)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:19.355942 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94196c23-9189-411b-b5de-c1ee2e2525c9 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:19.389740 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 866/1725] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:41:19 2022] PUT /identity/v3/projects/7de4257a985e45d5aeea6b23c618f1dd/users/f6b3bd043e0644daa38ad0f9a095e9da/roles/3e32dbf75f9b41f5adb9fe59851267bb => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:41:19.394832 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd733f4e-2fd3-492f-b3ba-4b277c07e2bf None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:19.395197 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd733f4e-2fd3-492f-b3ba-4b277c07e2bf None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:19.395555 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd733f4e-2fd3-492f-b3ba-4b277c07e2bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:19.418538 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-fd733f4e-2fd3-492f-b3ba-4b277c07e2bf None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:41:19.420178 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-fd733f4e-2fd3-492f-b3ba-4b277c07e2bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:19.485478 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae88ff1d-f721-4797-a227-1d290287bc38 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:19.537549 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 867/1726] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:41:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:41:19.554373 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec8c169-1fe0-4684-ab92-61dac9c62410 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:19.554373 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec8c169-1fe0-4684-ab92-61dac9c62410 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:19.554373 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec8c169-1fe0-4684-ab92-61dac9c62410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:19.589091 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-0ec8c169-1fe0-4684-ab92-61dac9c62410 None None] MFA Rules not processed for user `2dc6150d8d9e41b596246f282ab9ac34`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:41:19.590531 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-0ec8c169-1fe0-4684-ab92-61dac9c62410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:19.674184 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50a55a8-8059-4c82-8f52-8f938faf4f0f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87dd5c1c5e854d4b96e0b7dad6aa3719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:19.675399 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50a55a8-8059-4c82-8f52-8f938faf4f0f service nova] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:19.675682 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50a55a8-8059-4c82-8f52-8f938faf4f0f service nova] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:19.675955 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50a55a8-8059-4c82-8f52-8f938faf4f0f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:19.680998 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-d50a55a8-8059-4c82-8f52-8f938faf4f0f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:19.724794 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:19.757770 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:19.778273 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 868/1727] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:41:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:41:19.778273 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec8c169-1fe0-4684-ab92-61dac9c62410 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:19.778273 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-0ec8c169-1fe0-4684-ab92-61dac9c62410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:19.795488 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50a55a8-8059-4c82-8f52-8f938faf4f0f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:19.797433 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50a55a8-8059-4c82-8f52-8f938faf4f0f service nova] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:19.811401 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 860/1728] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:41:19 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 549 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:41:19.813170 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50a55a8-8059-4c82-8f52-8f938faf4f0f service nova] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:19.838160 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50a55a8-8059-4c82-8f52-8f938faf4f0f service nova] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:19.845551 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b34b8c-d8b6-48fa-9da1-c7005c8cae88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:19.846527 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b34b8c-d8b6-48fa-9da1-c7005c8cae88 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:19.846948 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b34b8c-d8b6-48fa-9da1-c7005c8cae88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:19.847372 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b34b8c-d8b6-48fa-9da1-c7005c8cae88 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:19.849670 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b34b8c-d8b6-48fa-9da1-c7005c8cae88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:19.852464 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b34b8c-d8b6-48fa-9da1-c7005c8cae88 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:19.873060 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 861/1729] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:41:19 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:41:19.881147 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b34b8c-d8b6-48fa-9da1-c7005c8cae88 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:19.884826 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-21b34b8c-d8b6-48fa-9da1-c7005c8cae88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:19.930294 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec8c169-1fe0-4684-ab92-61dac9c62410 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:19.941299 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e329f902-3709-4088-b81a-250cec01a23f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '723f5f43572a493dae0349070a2adb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:19.941957 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e329f902-3709-4088-b81a-250cec01a23f service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:19.942237 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e329f902-3709-4088-b81a-250cec01a23f service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:19.942576 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e329f902-3709-4088-b81a-250cec01a23f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:19.954167 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e329f902-3709-4088-b81a-250cec01a23f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:19.955684 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e329f902-3709-4088-b81a-250cec01a23f service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:19.981562 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 869/1730] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:41:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:41:19.982963 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fbf051-13c4-4676-9bd2-07640763ffd0 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:19.983390 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fbf051-13c4-4676-9bd2-07640763ffd0 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:19.983494 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fbf051-13c4-4676-9bd2-07640763ffd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:19.993539 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b34b8c-d8b6-48fa-9da1-c7005c8cae88 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:19.998876 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57795574-0c84-4997-84df-d68478cc5a82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '723f5f43572a493dae0349070a2adb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:19.999575 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57795574-0c84-4997-84df-d68478cc5a82 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:19.999867 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57795574-0c84-4997-84df-d68478cc5a82 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:20.000152 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57795574-0c84-4997-84df-d68478cc5a82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:20.034394 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57795574-0c84-4997-84df-d68478cc5a82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:20.037486 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57795574-0c84-4997-84df-d68478cc5a82 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:20.046674 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-b1fbf051-13c4-4676-9bd2-07640763ffd0 None None] MFA Rules not processed for user `2dc6150d8d9e41b596246f282ab9ac34`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:41:20.047931 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-b1fbf051-13c4-4676-9bd2-07640763ffd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:20.067735 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 862/1731] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:41:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:41:20.069461 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 870/1732] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:41:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:41:20.072632 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57795574-0c84-4997-84df-d68478cc5a82 service neutron] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:20.096733 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57795574-0c84-4997-84df-d68478cc5a82 service neutron] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:20.102615 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49e3dc0-4636-4902-9caa-ceaa9fde7c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:20.103332 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49e3dc0-4636-4902-9caa-ceaa9fde7c7c admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:20.103646 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49e3dc0-4636-4902-9caa-ceaa9fde7c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:20.104186 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49e3dc0-4636-4902-9caa-ceaa9fde7c7c admin admin] PATH_INFO: `/v3/projects/7de4257a985e45d5aeea6b23c618f1dd/users/f6b3bd043e0644daa38ad0f9a095e9da/roles/3e32dbf75f9b41f5adb9fe59851267bb` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:20.106431 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49e3dc0-4636-4902-9caa-ceaa9fde7c7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7de4257a985e45d5aeea6b23c618f1dd, user_id=f6b3bd043e0644daa38ad0f9a095e9da, role_id=3e32dbf75f9b41f5adb9fe59851267bb)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:20.109626 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49e3dc0-4636-4902-9caa-ceaa9fde7c7c admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:20.127677 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 863/1733] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:41:20 2022] PUT /identity/v3/projects/7de4257a985e45d5aeea6b23c618f1dd/users/f6b3bd043e0644daa38ad0f9a095e9da/roles/3e32dbf75f9b41f5adb9fe59851267bb => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:41:20.139157 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f010ec2-5b5f-4ecd-b2fd-3b0f05b8e3ba None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:20.139668 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f010ec2-5b5f-4ecd-b2fd-3b0f05b8e3ba None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:20.140554 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f010ec2-5b5f-4ecd-b2fd-3b0f05b8e3ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:20.162180 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49e3dc0-4636-4902-9caa-ceaa9fde7c7c admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:20.164939 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-c49e3dc0-4636-4902-9caa-ceaa9fde7c7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:20.216555 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-4f010ec2-5b5f-4ecd-b2fd-3b0f05b8e3ba None None] MFA Rules not processed for user `f6b3bd043e0644daa38ad0f9a095e9da`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:41:20.222318 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-4f010ec2-5b5f-4ecd-b2fd-3b0f05b8e3ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:20.310461 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49e3dc0-4636-4902-9caa-ceaa9fde7c7c admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:20.316712 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b5021e-5d12-4d2a-9dcb-0c4a3551663c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:20.318318 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b5021e-5d12-4d2a-9dcb-0c4a3551663c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:20.319166 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b5021e-5d12-4d2a-9dcb-0c4a3551663c admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:20.319720 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b5021e-5d12-4d2a-9dcb-0c4a3551663c admin admin] PATH_INFO: `/v3/projects/d4f750d3133a4697a2f2698b57bbdd0f` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:20.322173 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b5021e-5d12-4d2a-9dcb-0c4a3551663c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4f750d3133a4697a2f2698b57bbdd0f)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:20.325235 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b5021e-5d12-4d2a-9dcb-0c4a3551663c admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:20.417167 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 871/1734] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:41:20 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:41:20.426567 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-f6b5021e-5d12-4d2a-9dcb-0c4a3551663c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4f750d3133a4697a2f2698b57bbdd0f', 'request_id': 'req-f6b5021e-5d12-4d2a-9dcb-0c4a3551663c'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:20.437177 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f010ec2-5b5f-4ecd-b2fd-3b0f05b8e3ba None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:20.438825 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-4f010ec2-5b5f-4ecd-b2fd-3b0f05b8e3ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:20.445265 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-f6b5021e-5d12-4d2a-9dcb-0c4a3551663c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4f750d3133a4697a2f2698b57bbdd0f', 'request_id': 'req-f6b5021e-5d12-4d2a-9dcb-0c4a3551663c'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:20.457970 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:20.460553 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-f6b5021e-5d12-4d2a-9dcb-0c4a3551663c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4f750d3133a4697a2f2698b57bbdd0f', 'request_id': 'req-f6b5021e-5d12-4d2a-9dcb-0c4a3551663c'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:20.499552 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-f6b5021e-5d12-4d2a-9dcb-0c4a3551663c admin admin] The token cache is being invalidate because project d4f750d3133a4697a2f2698b57bbdd0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:41:20.499866 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-f6b5021e-5d12-4d2a-9dcb-0c4a3551663c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:20.504770 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-f6b5021e-5d12-4d2a-9dcb-0c4a3551663c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:20.510359 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 864/1735] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Aug 2 21:41:20 2022] DELETE /identity/v3/projects/d4f750d3133a4697a2f2698b57bbdd0f => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:41:20.515229 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e662aa3-72c6-46be-a047-f2bc52751656 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:20.515504 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e662aa3-72c6-46be-a047-f2bc52751656 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:20.515780 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e662aa3-72c6-46be-a047-f2bc52751656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:20.564201 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-7e662aa3-72c6-46be-a047-f2bc52751656 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:41:20.566087 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-7e662aa3-72c6-46be-a047-f2bc52751656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:20.592709 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f010ec2-5b5f-4ecd-b2fd-3b0f05b8e3ba None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:20.660710 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:20.718250 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 865/1736] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:41:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:41:20.726498 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5327aea7-3748-4ccb-baf3-8f547fefcc54 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:20.727591 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5327aea7-3748-4ccb-baf3-8f547fefcc54 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:20.727887 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5327aea7-3748-4ccb-baf3-8f547fefcc54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:20.729443 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3d84ed-42e8-4c97-abab-d79cb9ecaa42 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '123eb76f95ee4e39905944da701c712d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:20.732847 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3d84ed-42e8-4c97-abab-d79cb9ecaa42 service cinder] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:20.733140 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3d84ed-42e8-4c97-abab-d79cb9ecaa42 service cinder] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:20.733421 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3d84ed-42e8-4c97-abab-d79cb9ecaa42 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:20.736626 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-4a3d84ed-42e8-4c97-abab-d79cb9ecaa42 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:20.772116 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-5327aea7-3748-4ccb-baf3-8f547fefcc54 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:41:20.774024 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-5327aea7-3748-4ccb-baf3-8f547fefcc54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:20.784741 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 866/1737] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:41:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:41:20.788742 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5327aea7-3748-4ccb-baf3-8f547fefcc54 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:20.800758 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5327aea7-3748-4ccb-baf3-8f547fefcc54 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:20.807083 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105f7bc9-a4cb-43d8-a170-5abba4297a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:20.808068 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105f7bc9-a4cb-43d8-a170-5abba4297a1e admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:20.808645 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105f7bc9-a4cb-43d8-a170-5abba4297a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:20.808997 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105f7bc9-a4cb-43d8-a170-5abba4297a1e admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:20.809871 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105f7bc9-a4cb-43d8-a170-5abba4297a1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:41:20.810613 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105f7bc9-a4cb-43d8-a170-5abba4297a1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:20.812588 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105f7bc9-a4cb-43d8-a170-5abba4297a1e admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:20.835894 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 867/1738] 10.222.0.70 () {58 vars in 1153 bytes} [Tue Aug 2 21:41:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:41:20.837729 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614f55f8-dd85-4fa3-b190-5af1a05e2b06 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:20.838095 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614f55f8-dd85-4fa3-b190-5af1a05e2b06 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:20.838532 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614f55f8-dd85-4fa3-b190-5af1a05e2b06 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:20.840571 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 868/1739] 10.222.0.70 () {54 vars in 912 bytes} [Tue Aug 2 21:41:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:41:20.842770 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614f55f8-dd85-4fa3-b190-5af1a05e2b06 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:20.861487 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614f55f8-dd85-4fa3-b190-5af1a05e2b06 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:20.868099 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c38c017-27d3-4681-8530-7b1c8da7795e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:20.868939 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c38c017-27d3-4681-8530-7b1c8da7795e admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:20.869607 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c38c017-27d3-4681-8530-7b1c8da7795e admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:20.869994 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c38c017-27d3-4681-8530-7b1c8da7795e admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:20.871495 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c38c017-27d3-4681-8530-7b1c8da7795e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:20.873797 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c38c017-27d3-4681-8530-7b1c8da7795e admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:20.939492 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3d84ed-42e8-4c97-abab-d79cb9ecaa42 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:20.941952 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3d84ed-42e8-4c97-abab-d79cb9ecaa42 service cinder] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:20.949923 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 869/1740] 10.222.0.70 () {60 vars in 1153 bytes} [Tue Aug 2 21:41:20 2022] POST /identity/v3/projects => generated 379 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:41:20.951845 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad8f735-cf7b-4757-9041-c5d1b88c4726 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:20.954468 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad8f735-cf7b-4757-9041-c5d1b88c4726 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:20.955882 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad8f735-cf7b-4757-9041-c5d1b88c4726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:20.985826 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 872/1741] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:41:20 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 549 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:41:20.990230 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3d84ed-42e8-4c97-abab-d79cb9ecaa42 service cinder] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:21.007394 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-4ad8f735-cf7b-4757-9041-c5d1b88c4726 None None] MFA Rules not processed for user `723f5f43572a493dae0349070a2adb5e`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:41:21.011221 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-4ad8f735-cf7b-4757-9041-c5d1b88c4726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:21.020050 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3d84ed-42e8-4c97-abab-d79cb9ecaa42 service cinder] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:21.165339 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 870/1742] 10.222.0.70 () {58 vars in 1009 bytes} [Tue Aug 2 21:41:20 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:41:21.167191 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad8f735-cf7b-4757-9041-c5d1b88c4726 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:21.169203 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-4ad8f735-cf7b-4757-9041-c5d1b88c4726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:21.213096 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08131135-1a2d-48d1-b9c1-e7eb3e9679a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:21.213740 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08131135-1a2d-48d1-b9c1-e7eb3e9679a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:21.214640 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08131135-1a2d-48d1-b9c1-e7eb3e9679a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:21.214947 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08131135-1a2d-48d1-b9c1-e7eb3e9679a3 admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:21.217167 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08131135-1a2d-48d1-b9c1-e7eb3e9679a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:21.225682 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08131135-1a2d-48d1-b9c1-e7eb3e9679a3 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:21.282736 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 873/1743] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 2 21:41:20 2022] POST /identity/v3/users => generated 290 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:41:21.284650 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08131135-1a2d-48d1-b9c1-e7eb3e9679a3 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:21.286626 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-08131135-1a2d-48d1-b9c1-e7eb3e9679a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:21.364708 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08131135-1a2d-48d1-b9c1-e7eb3e9679a3 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:21.375595 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad8f735-cf7b-4757-9041-c5d1b88c4726 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:21.376802 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c74a9c-93ab-4768-b4e0-f2920e078f8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '123eb76f95ee4e39905944da701c712d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:21.377484 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c74a9c-93ab-4768-b4e0-f2920e078f8b service cinder] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:21.377776 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c74a9c-93ab-4768-b4e0-f2920e078f8b service cinder] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:21.378052 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c74a9c-93ab-4768-b4e0-f2920e078f8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:21.380691 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-c8c74a9c-93ab-4768-b4e0-f2920e078f8b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:21.383141 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2208f5-de43-47d4-a178-fc33ad82357c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:21.383973 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2208f5-de43-47d4-a178-fc33ad82357c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:21.384278 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2208f5-de43-47d4-a178-fc33ad82357c admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:21.384743 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2208f5-de43-47d4-a178-fc33ad82357c admin admin] PATH_INFO: `/v3/projects/e6b67529e4424d9983fba6b3ec6681d6` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:21.386262 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2208f5-de43-47d4-a178-fc33ad82357c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6b67529e4424d9983fba6b3ec6681d6)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:21.388450 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2208f5-de43-47d4-a178-fc33ad82357c admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:21.390409 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:21.441040 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:21.489167 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-6e2208f5-de43-47d4-a178-fc33ad82357c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6b67529e4424d9983fba6b3ec6681d6', 'request_id': 'req-6e2208f5-de43-47d4-a178-fc33ad82357c'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:21.504833 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-6e2208f5-de43-47d4-a178-fc33ad82357c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6b67529e4424d9983fba6b3ec6681d6', 'request_id': 'req-6e2208f5-de43-47d4-a178-fc33ad82357c'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:21.512711 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c74a9c-93ab-4768-b4e0-f2920e078f8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:21.515871 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c74a9c-93ab-4768-b4e0-f2920e078f8b service cinder] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:21.516729 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-6e2208f5-de43-47d4-a178-fc33ad82357c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6b67529e4424d9983fba6b3ec6681d6', 'request_id': 'req-6e2208f5-de43-47d4-a178-fc33ad82357c'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:21.536512 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-6e2208f5-de43-47d4-a178-fc33ad82357c admin admin] The token cache is being invalidate because project e6b67529e4424d9983fba6b3ec6681d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:41:21.536809 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-6e2208f5-de43-47d4-a178-fc33ad82357c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:21.540393 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-6e2208f5-de43-47d4-a178-fc33ad82357c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:21.542678 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 874/1744] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:41:21 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:41:21.545767 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 871/1745] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Aug 2 21:41:21 2022] DELETE /identity/v3/projects/e6b67529e4424d9983fba6b3ec6681d6 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:41:21.546256 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c74a9c-93ab-4768-b4e0-f2920e078f8b service cinder] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:21.547109 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2208f5-de43-47d4-a178-fc33ad82357c admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:21.548265 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-6e2208f5-de43-47d4-a178-fc33ad82357c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:21.550806 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-c8c74a9c-93ab-4768-b4e0-f2920e078f8b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:21.597291 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c74a9c-93ab-4768-b4e0-f2920e078f8b service cinder] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:21.716663 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2208f5-de43-47d4-a178-fc33ad82357c admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:21.720441 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4af9b7-da48-4807-bb31-775c704aa532 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '723f5f43572a493dae0349070a2adb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:21.722185 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4af9b7-da48-4807-bb31-775c704aa532 service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:21.723164 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4af9b7-da48-4807-bb31-775c704aa532 service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:21.724317 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4af9b7-da48-4807-bb31-775c704aa532 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:21.729467 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-ff4af9b7-da48-4807-bb31-775c704aa532 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:21.732154 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4c905e-a2ef-4811-a10e-1e2bc8bfa0ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87dd5c1c5e854d4b96e0b7dad6aa3719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:21.733218 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4c905e-a2ef-4811-a10e-1e2bc8bfa0ab service nova] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:21.733510 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4c905e-a2ef-4811-a10e-1e2bc8bfa0ab service nova] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:21.733792 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4c905e-a2ef-4811-a10e-1e2bc8bfa0ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:21.735782 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-8b4c905e-a2ef-4811-a10e-1e2bc8bfa0ab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:21.749829 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4af9b7-da48-4807-bb31-775c704aa532 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:21.753661 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4af9b7-da48-4807-bb31-775c704aa532 service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:21.780403 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 875/1746] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:41:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:41:21.781565 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4af9b7-da48-4807-bb31-775c704aa532 service neutron] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:21.786975 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-ff4af9b7-da48-4807-bb31-775c704aa532 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:21.974010 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4af9b7-da48-4807-bb31-775c704aa532 service neutron] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:21.984191 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718833ae-0313-4662-bcc9-9ce217342374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:21.984862 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718833ae-0313-4662-bcc9-9ce217342374 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:21.985147 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718833ae-0313-4662-bcc9-9ce217342374 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:21.985450 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718833ae-0313-4662-bcc9-9ce217342374 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:21.986622 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718833ae-0313-4662-bcc9-9ce217342374 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:21.988510 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718833ae-0313-4662-bcc9-9ce217342374 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:22.026857 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 876/1747] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:41:21 2022] GET /identity/v3/roles => generated 1420 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:41:22.026857 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e058e0e2-347e-459a-b998-4f7057801941 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:22.026857 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e058e0e2-347e-459a-b998-4f7057801941 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:22.026857 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e058e0e2-347e-459a-b998-4f7057801941 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:22.027926 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 877/1748] 10.222.0.70 () {54 vars in 961 bytes} [Tue Aug 2 21:41:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:41:22.028736 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e058e0e2-347e-459a-b998-4f7057801941 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:22.041866 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-e058e0e2-347e-459a-b998-4f7057801941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:22.073095 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e058e0e2-347e-459a-b998-4f7057801941 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:22.081564 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502c35d1-50c5-4c05-9ccc-7537016c7c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:22.082499 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c35d1-50c5-4c05-9ccc-7537016c7c2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:22.082499 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c35d1-50c5-4c05-9ccc-7537016c7c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:22.082759 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c35d1-50c5-4c05-9ccc-7537016c7c2a admin admin] PATH_INFO: `/v3/users/3cfb968e5d3b4c50bf18ff7256c0f50e` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:22.085509 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502c35d1-50c5-4c05-9ccc-7537016c7c2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cfb968e5d3b4c50bf18ff7256c0f50e)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:22.087598 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502c35d1-50c5-4c05-9ccc-7537016c7c2a admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:22.150464 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4c905e-a2ef-4811-a10e-1e2bc8bfa0ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:22.158262 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4c905e-a2ef-4811-a10e-1e2bc8bfa0ab service nova] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:22.229310 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 872/1749] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:41:21 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 683 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:41:22.230219 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4c905e-a2ef-4811-a10e-1e2bc8bfa0ab service nova] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:22.252294 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-502c35d1-50c5-4c05-9ccc-7537016c7c2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cfb968e5d3b4c50bf18ff7256c0f50e'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:22.270730 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-502c35d1-50c5-4c05-9ccc-7537016c7c2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cfb968e5d3b4c50bf18ff7256c0f50e'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:22.274360 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:22.284336 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4c905e-a2ef-4811-a10e-1e2bc8bfa0ab service nova] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:22.311602 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1cc243-fedc-447b-8f73-f1f5c3ba23cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:22.312345 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1cc243-fedc-447b-8f73-f1f5c3ba23cc admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:22.312636 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1cc243-fedc-447b-8f73-f1f5c3ba23cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:22.313816 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1cc243-fedc-447b-8f73-f1f5c3ba23cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:22.313816 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1cc243-fedc-447b-8f73-f1f5c3ba23cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:22.315835 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1cc243-fedc-447b-8f73-f1f5c3ba23cc admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:22.326251 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-502c35d1-50c5-4c05-9ccc-7537016c7c2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cfb968e5d3b4c50bf18ff7256c0f50e'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:22.349308 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-502c35d1-50c5-4c05-9ccc-7537016c7c2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cfb968e5d3b4c50bf18ff7256c0f50e'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:22.351736 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-502c35d1-50c5-4c05-9ccc-7537016c7c2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cfb968e5d3b4c50bf18ff7256c0f50e'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:22.377270 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 873/1750] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:41:22 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:41:22.377270 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825ac37b-6226-4058-8004-19d6fa9aa272 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:22.377270 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825ac37b-6226-4058-8004-19d6fa9aa272 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:22.377270 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825ac37b-6226-4058-8004-19d6fa9aa272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:22.387660 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 878/1751] 10.222.0.70 () {58 vars in 1224 bytes} [Tue Aug 2 21:41:22 2022] DELETE /identity/v3/users/3cfb968e5d3b4c50bf18ff7256c0f50e => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:41:22.388041 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d802302-e3b8-415e-9237-295954ffd337 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:22.388343 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d802302-e3b8-415e-9237-295954ffd337 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:22.388621 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d802302-e3b8-415e-9237-295954ffd337 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:22.441440 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-4d802302-e3b8-415e-9237-295954ffd337 None None] MFA Rules not processed for user `54c59604553a491b9276bd45b3a2f6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:41:22.442802 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-4d802302-e3b8-415e-9237-295954ffd337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:22.446673 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-825ac37b-6226-4058-8004-19d6fa9aa272 None None] MFA Rules not processed for user `83fcd951771e42959506b70b0137003f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:41:22.452296 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-825ac37b-6226-4058-8004-19d6fa9aa272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:22.497980 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:22.634855 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 879/1752] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:41:22 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:41:22.634855 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d802302-e3b8-415e-9237-295954ffd337 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:22.634855 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-4d802302-e3b8-415e-9237-295954ffd337 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:22.720794 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 874/1753] 10.222.0.70 () {58 vars in 1058 bytes} [Tue Aug 2 21:41:22 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:41:22.722912 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825ac37b-6226-4058-8004-19d6fa9aa272 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:22.756339 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825ac37b-6226-4058-8004-19d6fa9aa272 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:22.781574 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc492d24-0c8a-4c48-9480-436587df0b3a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83fcd951771e42959506b70b0137003f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:22.782399 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc492d24-0c8a-4c48-9480-436587df0b3a service placement] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:22.782831 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc492d24-0c8a-4c48-9480-436587df0b3a service placement] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:22.783281 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc492d24-0c8a-4c48-9480-436587df0b3a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:22.789963 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-fc492d24-0c8a-4c48-9480-436587df0b3a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:22.809484 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d802302-e3b8-415e-9237-295954ffd337 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:22.811529 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc492d24-0c8a-4c48-9480-436587df0b3a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:22.813072 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc492d24-0c8a-4c48-9480-436587df0b3a service placement] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:22.832293 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b39b49a-c672-4893-bd91-1feda1baafa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:22.832998 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b39b49a-c672-4893-bd91-1feda1baafa9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:22.833278 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b39b49a-c672-4893-bd91-1feda1baafa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:22.833553 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b39b49a-c672-4893-bd91-1feda1baafa9 admin admin] PATH_INFO: `/v3/projects/5e7bdb0aeab94872b63cf854e9d4871a/users/218e53822b8442fe89ad848c9e6b70ce/roles/462e3381a85c42a9959201f9aa122f7c` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:22.852654 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 875/1754] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:41:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:41:22.876405 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b39b49a-c672-4893-bd91-1feda1baafa9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e7bdb0aeab94872b63cf854e9d4871a, user_id=218e53822b8442fe89ad848c9e6b70ce, role_id=462e3381a85c42a9959201f9aa122f7c)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:22.888061 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b39b49a-c672-4893-bd91-1feda1baafa9 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:22.919643 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 880/1755] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:41:22 2022] PUT /identity/v3/projects/5e7bdb0aeab94872b63cf854e9d4871a/users/218e53822b8442fe89ad848c9e6b70ce/roles/462e3381a85c42a9959201f9aa122f7c => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:41:22.934580 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5001966e-cc05-4d1e-acce-7613aaac75a1 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:22.934580 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5001966e-cc05-4d1e-acce-7613aaac75a1 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:22.935365 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5001966e-cc05-4d1e-acce-7613aaac75a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:23.006306 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-5001966e-cc05-4d1e-acce-7613aaac75a1 None None] MFA Rules not processed for user `218e53822b8442fe89ad848c9e6b70ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:41:23.007638 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-5001966e-cc05-4d1e-acce-7613aaac75a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:23.159846 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 876/1756] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:41:22 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:41:23.161168 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b39b49a-c672-4893-bd91-1feda1baafa9 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:23.347384 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b39b49a-c672-4893-bd91-1feda1baafa9 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:23.358879 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0483d22-0351-4b28-a9ea-7a18558ce1c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:23.359555 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0483d22-0351-4b28-a9ea-7a18558ce1c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:23.360262 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0483d22-0351-4b28-a9ea-7a18558ce1c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:23.362477 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0483d22-0351-4b28-a9ea-7a18558ce1c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:23.363320 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0483d22-0351-4b28-a9ea-7a18558ce1c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:23.367272 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0483d22-0351-4b28-a9ea-7a18558ce1c0 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:23.377189 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:23.424374 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 881/1757] 10.222.0.70 () {60 vars in 1153 bytes} [Tue Aug 2 21:41:23 2022] POST /identity/v3/projects => generated 379 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:41:23.428130 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5001966e-cc05-4d1e-acce-7613aaac75a1 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:23.454036 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5001966e-cc05-4d1e-acce-7613aaac75a1 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:23.459565 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0483d22-0351-4b28-a9ea-7a18558ce1c0 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:23.463082 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-c0483d22-0351-4b28-a9ea-7a18558ce1c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:23.657800 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2e2070-327e-4dcc-8789-17c477eb6c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:23.660582 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2e2070-327e-4dcc-8789-17c477eb6c65 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:23.661069 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2e2070-327e-4dcc-8789-17c477eb6c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:23.661950 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2e2070-327e-4dcc-8789-17c477eb6c65 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:23.676515 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2e2070-327e-4dcc-8789-17c477eb6c65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:23.681602 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2e2070-327e-4dcc-8789-17c477eb6c65 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:23.714249 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0483d22-0351-4b28-a9ea-7a18558ce1c0 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:23.737951 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de255a4-64fc-4c4e-8773-704c248984fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:23.738750 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de255a4-64fc-4c4e-8773-704c248984fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:23.739831 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 877/1758] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 2 21:41:23 2022] POST /identity/v3/users => generated 296 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:41:23.742698 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de255a4-64fc-4c4e-8773-704c248984fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:23.743107 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de255a4-64fc-4c4e-8773-704c248984fc admin admin] PATH_INFO: `/v3/projects/9a0ddee54cc84bac903e22b48e14fe87` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:23.743631 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2e2070-327e-4dcc-8789-17c477eb6c65 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:23.746681 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de255a4-64fc-4c4e-8773-704c248984fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a0ddee54cc84bac903e22b48e14fe87)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:23.748763 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de255a4-64fc-4c4e-8773-704c248984fc admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:23.813201 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2e2070-327e-4dcc-8789-17c477eb6c65 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:23.850739 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dfed22-ec1a-41d6-80ab-578bc70934cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:23.862571 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dfed22-ec1a-41d6-80ab-578bc70934cf admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:23.864423 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dfed22-ec1a-41d6-80ab-578bc70934cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:23.866877 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dfed22-ec1a-41d6-80ab-578bc70934cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:23.867307 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dfed22-ec1a-41d6-80ab-578bc70934cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:23.873801 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dfed22-ec1a-41d6-80ab-578bc70934cf admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:23.916371 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 878/1759] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:41:23 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 21:41:23.921369 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dfed22-ec1a-41d6-80ab-578bc70934cf admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:23.951386 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dfed22-ec1a-41d6-80ab-578bc70934cf admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:23.954634 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-2de255a4-64fc-4c4e-8773-704c248984fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a0ddee54cc84bac903e22b48e14fe87', 'request_id': 'req-2de255a4-64fc-4c4e-8773-704c248984fc'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:23.959608 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:23.969214 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-2de255a4-64fc-4c4e-8773-704c248984fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a0ddee54cc84bac903e22b48e14fe87', 'request_id': 'req-2de255a4-64fc-4c4e-8773-704c248984fc'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:24.006748 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-2de255a4-64fc-4c4e-8773-704c248984fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a0ddee54cc84bac903e22b48e14fe87', 'request_id': 'req-2de255a4-64fc-4c4e-8773-704c248984fc'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:24.026576 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-2de255a4-64fc-4c4e-8773-704c248984fc admin admin] The token cache is being invalidate because project 9a0ddee54cc84bac903e22b48e14fe87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:41:24.027210 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-2de255a4-64fc-4c4e-8773-704c248984fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:24.028495 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-2de255a4-64fc-4c4e-8773-704c248984fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:24.036587 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 882/1760] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Aug 2 21:41:23 2022] DELETE /identity/v3/projects/9a0ddee54cc84bac903e22b48e14fe87 => generated 0 bytes in 572 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:41:24.038663 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc77c613-777d-4fe3-ae35-ea47ab9c72f1 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:24.039213 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc77c613-777d-4fe3-ae35-ea47ab9c72f1 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:24.039648 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc77c613-777d-4fe3-ae35-ea47ab9c72f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:24.113184 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-bc77c613-777d-4fe3-ae35-ea47ab9c72f1 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:41:24.114324 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-bc77c613-777d-4fe3-ae35-ea47ab9c72f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:24.203622 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452e0de7-b28f-4543-bbc3-b452ff2a7780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:24.204794 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452e0de7-b28f-4543-bbc3-b452ff2a7780 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:24.205265 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452e0de7-b28f-4543-bbc3-b452ff2a7780 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:24.209291 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452e0de7-b28f-4543-bbc3-b452ff2a7780 admin admin] PATH_INFO: `/v3/projects/0352e4cba7444d19acee80247be4aa63/users/fd21d13773e94b94a3629b7365d92996/roles/3e32dbf75f9b41f5adb9fe59851267bb` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:24.265494 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452e0de7-b28f-4543-bbc3-b452ff2a7780 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0352e4cba7444d19acee80247be4aa63, user_id=fd21d13773e94b94a3629b7365d92996, role_id=3e32dbf75f9b41f5adb9fe59851267bb)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:24.271274 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452e0de7-b28f-4543-bbc3-b452ff2a7780 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:24.329276 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 879/1761] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:41:23 2022] PUT /identity/v3/projects/0352e4cba7444d19acee80247be4aa63/users/fd21d13773e94b94a3629b7365d92996/roles/3e32dbf75f9b41f5adb9fe59851267bb => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:41:24.333152 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e29730-d3a7-4bba-a362-d98c86a484ac None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:24.333705 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e29730-d3a7-4bba-a362-d98c86a484ac None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:24.334920 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e29730-d3a7-4bba-a362-d98c86a484ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:24.378069 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-87e29730-d3a7-4bba-a362-d98c86a484ac None None] MFA Rules not processed for user `05fc0253234e42e7acbcc2f0959ac0db`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:41:24.380883 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-87e29730-d3a7-4bba-a362-d98c86a484ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:24.382334 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 883/1762] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:41:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:41:24.383262 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc77c613-777d-4fe3-ae35-ea47ab9c72f1 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:24.386385 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-bc77c613-777d-4fe3-ae35-ea47ab9c72f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:24.414312 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc77c613-777d-4fe3-ae35-ea47ab9c72f1 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:24.457503 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:24.534933 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 880/1763] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:41:24 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:41:24.534933 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8558628-f53c-4c23-bd3f-374b198a8919 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:24.534933 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8558628-f53c-4c23-bd3f-374b198a8919 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:24.534933 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8558628-f53c-4c23-bd3f-374b198a8919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:24.573426 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8c2dac-8f96-4595-8c31-7183ae569414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:24.575153 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8c2dac-8f96-4595-8c31-7183ae569414 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:24.576137 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8c2dac-8f96-4595-8c31-7183ae569414 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:24.576597 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8c2dac-8f96-4595-8c31-7183ae569414 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:24.580001 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8c2dac-8f96-4595-8c31-7183ae569414 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:24.592073 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-e8558628-f53c-4c23-bd3f-374b198a8919 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:41:24.592073 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-e8558628-f53c-4c23-bd3f-374b198a8919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:24.594301 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8c2dac-8f96-4595-8c31-7183ae569414 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:24.610775 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 881/1764] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:41:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:41:24.615006 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8558628-f53c-4c23-bd3f-374b198a8919 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:24.623066 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 884/1765] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:41:24 2022] GET /identity/v3/roles => generated 1420 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:41:24.624494 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8c2dac-8f96-4595-8c31-7183ae569414 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:24.636833 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8558628-f53c-4c23-bd3f-374b198a8919 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:24.646505 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cdb70b-fadf-4337-82f1-8e4b3b8ea31d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:24.647250 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cdb70b-fadf-4337-82f1-8e4b3b8ea31d admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:24.647434 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cdb70b-fadf-4337-82f1-8e4b3b8ea31d admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:24.647717 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cdb70b-fadf-4337-82f1-8e4b3b8ea31d admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:24.648459 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cdb70b-fadf-4337-82f1-8e4b3b8ea31d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:41:24.648771 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cdb70b-fadf-4337-82f1-8e4b3b8ea31d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:24.650089 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8c2dac-8f96-4595-8c31-7183ae569414 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:24.653125 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cdb70b-fadf-4337-82f1-8e4b3b8ea31d admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:24.663091 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f47d39-4b3f-494b-aaa3-3c4d52f05996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:24.664147 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f47d39-4b3f-494b-aaa3-3c4d52f05996 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:24.664815 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f47d39-4b3f-494b-aaa3-3c4d52f05996 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:24.665307 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f47d39-4b3f-494b-aaa3-3c4d52f05996 admin admin] PATH_INFO: `/v3/projects/0352e4cba7444d19acee80247be4aa63/users/fd21d13773e94b94a3629b7365d92996/roles/3e32dbf75f9b41f5adb9fe59851267bb` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:24.671100 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f47d39-4b3f-494b-aaa3-3c4d52f05996 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0352e4cba7444d19acee80247be4aa63, user_id=fd21d13773e94b94a3629b7365d92996, role_id=3e32dbf75f9b41f5adb9fe59851267bb)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:24.678708 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f47d39-4b3f-494b-aaa3-3c4d52f05996 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:24.681600 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 882/1766] 10.222.0.70 () {58 vars in 1153 bytes} [Tue Aug 2 21:41:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:41:24.686396 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cdb70b-fadf-4337-82f1-8e4b3b8ea31d admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:24.714574 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cdb70b-fadf-4337-82f1-8e4b3b8ea31d admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:24.725809 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 885/1767] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:41:24 2022] PUT /identity/v3/projects/0352e4cba7444d19acee80247be4aa63/users/fd21d13773e94b94a3629b7365d92996/roles/3e32dbf75f9b41f5adb9fe59851267bb => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:41:24.727350 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e02e56-eded-4c98-a416-073e05b34281 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:24.727641 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e02e56-eded-4c98-a416-073e05b34281 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:24.727919 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e02e56-eded-4c98-a416-073e05b34281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:24.793851 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-73e02e56-eded-4c98-a416-073e05b34281 None None] MFA Rules not processed for user `fd21d13773e94b94a3629b7365d92996`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:41:24.795091 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-73e02e56-eded-4c98-a416-073e05b34281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:24.886989 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22fa2ba-965b-44ee-98fb-6eb2cfbd2594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:24.887620 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22fa2ba-965b-44ee-98fb-6eb2cfbd2594 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:24.888063 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22fa2ba-965b-44ee-98fb-6eb2cfbd2594 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:24.889813 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22fa2ba-965b-44ee-98fb-6eb2cfbd2594 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:24.890538 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22fa2ba-965b-44ee-98fb-6eb2cfbd2594 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:24.892508 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22fa2ba-965b-44ee-98fb-6eb2cfbd2594 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:24.953517 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:24.967634 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 883/1768] 10.222.0.70 () {60 vars in 1153 bytes} [Tue Aug 2 21:41:24 2022] POST /identity/v3/projects => generated 381 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:41:24.969174 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964ad7ad-4acd-4bae-af4f-d089cb30445c None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:24.971765 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964ad7ad-4acd-4bae-af4f-d089cb30445c None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:24.971960 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964ad7ad-4acd-4bae-af4f-d089cb30445c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:24.991926 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 886/1769] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:41:24 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:41:24.992806 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e02e56-eded-4c98-a416-073e05b34281 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:25.020939 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e02e56-eded-4c98-a416-073e05b34281 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:25.024344 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-964ad7ad-4acd-4bae-af4f-d089cb30445c None None] MFA Rules not processed for user `3081e110cdd94b8aa51f7bb237aec635`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:41:25.026484 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-964ad7ad-4acd-4bae-af4f-d089cb30445c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:25.202730 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8824c83-be36-4fc6-ab93-ef7c99c9cf75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:25.203372 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8824c83-be36-4fc6-ab93-ef7c99c9cf75 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:25.203657 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8824c83-be36-4fc6-ab93-ef7c99c9cf75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:25.203933 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8824c83-be36-4fc6-ab93-ef7c99c9cf75 admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:25.204636 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8824c83-be36-4fc6-ab93-ef7c99c9cf75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:25.208206 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8824c83-be36-4fc6-ab93-ef7c99c9cf75 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:25.214772 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 884/1770] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:41:24 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:41:25.215867 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964ad7ad-4acd-4bae-af4f-d089cb30445c None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:25.219688 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-964ad7ad-4acd-4bae-af4f-d089cb30445c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:25.264674 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 887/1771] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 2 21:41:24 2022] POST /identity/v3/users => generated 291 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:41:25.269020 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8824c83-be36-4fc6-ab93-ef7c99c9cf75 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:25.301730 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8824c83-be36-4fc6-ab93-ef7c99c9cf75 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:25.319991 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e970c23a-34b0-4756-8620-ea66217a3457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:25.320720 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e970c23a-34b0-4756-8620-ea66217a3457 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:25.321005 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e970c23a-34b0-4756-8620-ea66217a3457 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:25.321280 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e970c23a-34b0-4756-8620-ea66217a3457 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:25.321986 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e970c23a-34b0-4756-8620-ea66217a3457 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:25.323610 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e970c23a-34b0-4756-8620-ea66217a3457 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:25.394075 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 888/1772] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:41:25 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 21:41:25.400293 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e970c23a-34b0-4756-8620-ea66217a3457 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:25.412378 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964ad7ad-4acd-4bae-af4f-d089cb30445c None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:25.421187 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3431e42-b7f1-449f-88c9-bd72a0df2cec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '123eb76f95ee4e39905944da701c712d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:25.422587 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3431e42-b7f1-449f-88c9-bd72a0df2cec service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:25.423014 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3431e42-b7f1-449f-88c9-bd72a0df2cec service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:25.425780 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3431e42-b7f1-449f-88c9-bd72a0df2cec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:25.430040 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:25.448444 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e970c23a-34b0-4756-8620-ea66217a3457 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:25.451016 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-f3431e42-b7f1-449f-88c9-bd72a0df2cec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:25.466473 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cee2380-c447-4afa-be52-304bb8f3473b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:25.467446 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee2380-c447-4afa-be52-304bb8f3473b admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:25.467879 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee2380-c447-4afa-be52-304bb8f3473b admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:25.468264 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cee2380-c447-4afa-be52-304bb8f3473b admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:25.469173 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cee2380-c447-4afa-be52-304bb8f3473b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:25.471791 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cee2380-c447-4afa-be52-304bb8f3473b admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:25.504157 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 889/1773] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:41:25 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:41:25.508370 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cee2380-c447-4afa-be52-304bb8f3473b admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:25.600762 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cee2380-c447-4afa-be52-304bb8f3473b admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:25.623429 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8be874e-948e-4664-ab15-382fe41c4d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:25.624117 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8be874e-948e-4664-ab15-382fe41c4d9e admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:25.626867 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8be874e-948e-4664-ab15-382fe41c4d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:25.627349 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8be874e-948e-4664-ab15-382fe41c4d9e admin admin] PATH_INFO: `/v3/projects/7aab1489affe418196a894ffd038c498/users/078539430c724398a321c77ce1afc205/roles/462e3381a85c42a9959201f9aa122f7c` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:25.693955 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8be874e-948e-4664-ab15-382fe41c4d9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7aab1489affe418196a894ffd038c498, user_id=078539430c724398a321c77ce1afc205, role_id=462e3381a85c42a9959201f9aa122f7c)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:25.696794 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8be874e-948e-4664-ab15-382fe41c4d9e admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:25.733498 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3431e42-b7f1-449f-88c9-bd72a0df2cec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:25.735714 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3431e42-b7f1-449f-88c9-bd72a0df2cec service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:25.766599 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 890/1774] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:41:25 2022] PUT /identity/v3/projects/7aab1489affe418196a894ffd038c498/users/078539430c724398a321c77ce1afc205/roles/462e3381a85c42a9959201f9aa122f7c => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:41:25.768703 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caee116-a087-40fb-9b5f-339f9618fab3 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:25.768998 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caee116-a087-40fb-9b5f-339f9618fab3 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:25.769277 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caee116-a087-40fb-9b5f-339f9618fab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:25.808481 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 885/1775] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:41:25 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 593 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:41:25.822973 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-2caee116-a087-40fb-9b5f-339f9618fab3 None None] MFA Rules not processed for user `078539430c724398a321c77ce1afc205`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:41:25.828956 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-2caee116-a087-40fb-9b5f-339f9618fab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:25.982120 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 891/1776] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:41:25 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:41:25.985102 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3431e42-b7f1-449f-88c9-bd72a0df2cec service cinder] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:26.004886 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3431e42-b7f1-449f-88c9-bd72a0df2cec service cinder] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:26.218125 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babd4552-7279-4b9d-a672-e86c53a1e72f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:26.218988 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd4552-7279-4b9d-a672-e86c53a1e72f admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:26.219511 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd4552-7279-4b9d-a672-e86c53a1e72f admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:26.219941 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd4552-7279-4b9d-a672-e86c53a1e72f admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:26.225198 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babd4552-7279-4b9d-a672-e86c53a1e72f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:26.227328 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babd4552-7279-4b9d-a672-e86c53a1e72f admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:26.244119 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:26.316276 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 886/1777] 10.222.0.70 () {60 vars in 1153 bytes} [Tue Aug 2 21:41:25 2022] POST /identity/v3/projects => generated 381 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 21:41:26.316538 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caee116-a087-40fb-9b5f-339f9618fab3 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:26.335429 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caee116-a087-40fb-9b5f-339f9618fab3 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:26.488752 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322e1ffa-901c-46df-834c-946889e18372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:26.489429 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322e1ffa-901c-46df-834c-946889e18372 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:26.489606 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322e1ffa-901c-46df-834c-946889e18372 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:26.492285 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322e1ffa-901c-46df-834c-946889e18372 admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:26.504904 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322e1ffa-901c-46df-834c-946889e18372 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:26.509291 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322e1ffa-901c-46df-834c-946889e18372 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:26.585911 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 892/1778] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 2 21:41:26 2022] POST /identity/v3/users => generated 297 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:41:26.590106 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babd4552-7279-4b9d-a672-e86c53a1e72f admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:26.602904 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babd4552-7279-4b9d-a672-e86c53a1e72f admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:26.618118 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc84f177-394e-4501-af39-bea209125ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:26.618913 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc84f177-394e-4501-af39-bea209125ef9 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:26.619267 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc84f177-394e-4501-af39-bea209125ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:26.626536 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc84f177-394e-4501-af39-bea209125ef9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:26.626536 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc84f177-394e-4501-af39-bea209125ef9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:26.626536 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc84f177-394e-4501-af39-bea209125ef9 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:26.641942 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 887/1779] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:41:26 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:41:26.645875 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322e1ffa-901c-46df-834c-946889e18372 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:26.666668 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322e1ffa-901c-46df-834c-946889e18372 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:26.680607 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8003943-fa25-4ac4-a44b-04b2cfa81714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:26.681929 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8003943-fa25-4ac4-a44b-04b2cfa81714 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:26.684181 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8003943-fa25-4ac4-a44b-04b2cfa81714 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:26.684730 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8003943-fa25-4ac4-a44b-04b2cfa81714 admin admin] PATH_INFO: `/v3/projects/0056bb94171d4dd4a9b2a0c5f18a7397/users/7e42feb3b5d543f6b18c376ea349d316/roles/3e32dbf75f9b41f5adb9fe59851267bb` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:26.741766 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8003943-fa25-4ac4-a44b-04b2cfa81714 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0056bb94171d4dd4a9b2a0c5f18a7397, user_id=7e42feb3b5d543f6b18c376ea349d316, role_id=3e32dbf75f9b41f5adb9fe59851267bb)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:26.755996 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8003943-fa25-4ac4-a44b-04b2cfa81714 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:26.842242 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 893/1780] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:41:26 2022] PUT /identity/v3/projects/0056bb94171d4dd4a9b2a0c5f18a7397/users/7e42feb3b5d543f6b18c376ea349d316/roles/3e32dbf75f9b41f5adb9fe59851267bb => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:41:26.843663 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc84f177-394e-4501-af39-bea209125ef9 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:26.863692 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc84f177-394e-4501-af39-bea209125ef9 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:27.213119 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197c313d-c717-44ca-95b3-a8e61aecd352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:27.214560 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197c313d-c717-44ca-95b3-a8e61aecd352 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:27.215026 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197c313d-c717-44ca-95b3-a8e61aecd352 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:27.215854 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197c313d-c717-44ca-95b3-a8e61aecd352 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:27.217522 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197c313d-c717-44ca-95b3-a8e61aecd352 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:27.224869 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197c313d-c717-44ca-95b3-a8e61aecd352 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:27.245544 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8003943-fa25-4ac4-a44b-04b2cfa81714 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:27.247039 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 888/1781] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:41:26 2022] GET /identity/v3/roles => generated 1420 bytes in 404 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:41:27.261974 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8003943-fa25-4ac4-a44b-04b2cfa81714 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:27.301651 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f12571c-3cb1-4426-9133-3988ba67a9a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:27.304564 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f12571c-3cb1-4426-9133-3988ba67a9a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:27.306198 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f12571c-3cb1-4426-9133-3988ba67a9a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:27.306486 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f12571c-3cb1-4426-9133-3988ba67a9a1 admin admin] PATH_INFO: `/v3/projects/0056bb94171d4dd4a9b2a0c5f18a7397/users/7e42feb3b5d543f6b18c376ea349d316/roles/3e32dbf75f9b41f5adb9fe59851267bb` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:27.320115 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f12571c-3cb1-4426-9133-3988ba67a9a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0056bb94171d4dd4a9b2a0c5f18a7397, user_id=7e42feb3b5d543f6b18c376ea349d316, role_id=3e32dbf75f9b41f5adb9fe59851267bb)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:27.336609 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f12571c-3cb1-4426-9133-3988ba67a9a1 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:27.408334 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 894/1782] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:41:27 2022] PUT /identity/v3/projects/0056bb94171d4dd4a9b2a0c5f18a7397/users/7e42feb3b5d543f6b18c376ea349d316/roles/3e32dbf75f9b41f5adb9fe59851267bb => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:41:27.418322 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efae714-a5f9-4027-950b-4e73785ab307 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:27.418621 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efae714-a5f9-4027-950b-4e73785ab307 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:27.418912 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efae714-a5f9-4027-950b-4e73785ab307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:27.576509 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-4efae714-a5f9-4027-950b-4e73785ab307 None None] MFA Rules not processed for user `7e42feb3b5d543f6b18c376ea349d316`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:41:27.577790 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-4efae714-a5f9-4027-950b-4e73785ab307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:27.810312 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 889/1783] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:41:27 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 401 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:41:27.957155 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f12571c-3cb1-4426-9133-3988ba67a9a1 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:27.983968 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:28.070117 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efae714-a5f9-4027-950b-4e73785ab307 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:28.073537 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-4efae714-a5f9-4027-950b-4e73785ab307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:28.207479 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f12571c-3cb1-4426-9133-3988ba67a9a1 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:28.224292 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c7beb7-8002-4320-bd89-c711d62e902f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '123eb76f95ee4e39905944da701c712d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:28.225185 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c7beb7-8002-4320-bd89-c711d62e902f service cinder] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:28.225612 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c7beb7-8002-4320-bd89-c711d62e902f service cinder] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:28.226075 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c7beb7-8002-4320-bd89-c711d62e902f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:28.270503 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4efae714-a5f9-4027-950b-4e73785ab307 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:28.273407 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c7beb7-8002-4320-bd89-c711d62e902f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:28.277809 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e24d343-6374-482d-b800-ae09e67f52e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '123eb76f95ee4e39905944da701c712d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:28.279001 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e24d343-6374-482d-b800-ae09e67f52e6 service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:28.279512 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e24d343-6374-482d-b800-ae09e67f52e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:28.281895 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e24d343-6374-482d-b800-ae09e67f52e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:28.302452 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c7beb7-8002-4320-bd89-c711d62e902f service cinder] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:28.303509 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:28.376655 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 895/1784] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:41:27 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:41:28.483796 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e24d343-6374-482d-b800-ae09e67f52e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:28.490799 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e24d343-6374-482d-b800-ae09e67f52e6 service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:28.498081 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f4bddf-0c94-4ae4-b5ee-843715f1b717 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:28.498373 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f4bddf-0c94-4ae4-b5ee-843715f1b717 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:28.498656 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f4bddf-0c94-4ae4-b5ee-843715f1b717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:28.565510 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 890/1785] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:41:28 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 21:41:28.758708 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-e9f4bddf-0c94-4ae4-b5ee-843715f1b717 None None] MFA Rules not processed for user `6be7b2bcfebd45389ca289c34fbabc3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:41:28.791925 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-e9f4bddf-0c94-4ae4-b5ee-843715f1b717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:28.835104 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e24d343-6374-482d-b800-ae09e67f52e6 service cinder] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:28.849702 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e24d343-6374-482d-b800-ae09e67f52e6 service cinder] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:28.856512 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17cdf20-4ac5-4c65-931c-71bc0dab3380 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '123eb76f95ee4e39905944da701c712d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:28.857154 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17cdf20-4ac5-4c65-931c-71bc0dab3380 service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:28.857534 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17cdf20-4ac5-4c65-931c-71bc0dab3380 service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:28.857810 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17cdf20-4ac5-4c65-931c-71bc0dab3380 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:28.971199 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17cdf20-4ac5-4c65-931c-71bc0dab3380 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:28.973098 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17cdf20-4ac5-4c65-931c-71bc0dab3380 service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:29.017357 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 891/1786] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:41:28 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 21:41:29.128210 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 896/1787] 10.222.0.70 () {58 vars in 1009 bytes} [Tue Aug 2 21:41:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 631 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:41:29.558375 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17cdf20-4ac5-4c65-931c-71bc0dab3380 service cinder] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:29.560669 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-a17cdf20-4ac5-4c65-931c-71bc0dab3380 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:29.863614 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17cdf20-4ac5-4c65-931c-71bc0dab3380 service cinder] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:29.890080 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fd14dc-e737-4f55-b52f-4d05b81c082e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee7ebf40212465aac997b461a2d10fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:29.893070 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fd14dc-e737-4f55-b52f-4d05b81c082e service swift] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:29.893533 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fd14dc-e737-4f55-b52f-4d05b81c082e service swift] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:29.894077 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fd14dc-e737-4f55-b52f-4d05b81c082e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:29.925795 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fd14dc-e737-4f55-b52f-4d05b81c082e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:29.933067 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fd14dc-e737-4f55-b52f-4d05b81c082e service swift] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:29.993908 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 892/1788] 10.222.0.70 () {60 vars in 1384 bytes} [Tue Aug 2 21:41:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 02 21:41:30.338013 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f4bddf-0c94-4ae4-b5ee-843715f1b717 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:30.340029 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-e9f4bddf-0c94-4ae4-b5ee-843715f1b717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:30.517276 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f4bddf-0c94-4ae4-b5ee-843715f1b717 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:30.523683 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd9aefc-0e61-4ff4-b6dc-64954b3b0fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:30.526462 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd9aefc-0e61-4ff4-b6dc-64954b3b0fe1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:30.527131 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd9aefc-0e61-4ff4-b6dc-64954b3b0fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:30.527562 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd9aefc-0e61-4ff4-b6dc-64954b3b0fe1 admin admin] PATH_INFO: `/v3/users/fa71c189b1c24c97beb00bdce2872287` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:30.529078 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd9aefc-0e61-4ff4-b6dc-64954b3b0fe1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa71c189b1c24c97beb00bdce2872287)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:30.531871 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd9aefc-0e61-4ff4-b6dc-64954b3b0fe1 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:30.621134 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:30.723842 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-3dd9aefc-0e61-4ff4-b6dc-64954b3b0fe1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa71c189b1c24c97beb00bdce2872287'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:30.782169 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-3dd9aefc-0e61-4ff4-b6dc-64954b3b0fe1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa71c189b1c24c97beb00bdce2872287'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:30.853988 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-3dd9aefc-0e61-4ff4-b6dc-64954b3b0fe1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa71c189b1c24c97beb00bdce2872287'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:30.889038 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-3dd9aefc-0e61-4ff4-b6dc-64954b3b0fe1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa71c189b1c24c97beb00bdce2872287'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:30.890141 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-3dd9aefc-0e61-4ff4-b6dc-64954b3b0fe1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa71c189b1c24c97beb00bdce2872287'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:30.950356 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 897/1789] 10.222.0.70 () {58 vars in 1224 bytes} [Tue Aug 2 21:41:30 2022] DELETE /identity/v3/users/fa71c189b1c24c97beb00bdce2872287 => generated 0 bytes in 610 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:41:30.951988 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe95e644-81cb-4387-b5d9-ae9217ad4c9b None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:30.952522 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe95e644-81cb-4387-b5d9-ae9217ad4c9b None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:30.952847 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe95e644-81cb-4387-b5d9-ae9217ad4c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:31.028858 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-fe95e644-81cb-4387-b5d9-ae9217ad4c9b None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:41:31.040593 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-fe95e644-81cb-4387-b5d9-ae9217ad4c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:31.072351 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:31.194321 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 893/1790] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:41:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:41:31.222471 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd9aefc-0e61-4ff4-b6dc-64954b3b0fe1 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:31.224565 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-3dd9aefc-0e61-4ff4-b6dc-64954b3b0fe1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:31.515006 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd9aefc-0e61-4ff4-b6dc-64954b3b0fe1 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:31.533593 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21eb61d-7280-4d9a-9b19-afa69d3a42ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '723f5f43572a493dae0349070a2adb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:31.534908 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21eb61d-7280-4d9a-9b19-afa69d3a42ff service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:31.537289 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21eb61d-7280-4d9a-9b19-afa69d3a42ff service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:31.539572 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21eb61d-7280-4d9a-9b19-afa69d3a42ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:31.583748 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21eb61d-7280-4d9a-9b19-afa69d3a42ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:31.588012 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21eb61d-7280-4d9a-9b19-afa69d3a42ff service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:31.678350 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 898/1791] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:41:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:41:32.855314 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe95e644-81cb-4387-b5d9-ae9217ad4c9b None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:32.856963 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-fe95e644-81cb-4387-b5d9-ae9217ad4c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:32.882348 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe95e644-81cb-4387-b5d9-ae9217ad4c9b None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:32.913059 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d146d168-7751-4baf-b0dc-fab9a691ee4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:32.913829 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d146d168-7751-4baf-b0dc-fab9a691ee4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:32.914431 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d146d168-7751-4baf-b0dc-fab9a691ee4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:32.914790 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d146d168-7751-4baf-b0dc-fab9a691ee4b admin admin] PATH_INFO: `/v3/users/078539430c724398a321c77ce1afc205` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:32.916457 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d146d168-7751-4baf-b0dc-fab9a691ee4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=078539430c724398a321c77ce1afc205)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:32.918509 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d146d168-7751-4baf-b0dc-fab9a691ee4b admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:33.037895 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-d146d168-7751-4baf-b0dc-fab9a691ee4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '078539430c724398a321c77ce1afc205'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:33.054635 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-d146d168-7751-4baf-b0dc-fab9a691ee4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '078539430c724398a321c77ce1afc205'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:33.106855 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-d146d168-7751-4baf-b0dc-fab9a691ee4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '078539430c724398a321c77ce1afc205'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:33.107626 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-d146d168-7751-4baf-b0dc-fab9a691ee4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '078539430c724398a321c77ce1afc205'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:33.122952 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-d146d168-7751-4baf-b0dc-fab9a691ee4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '078539430c724398a321c77ce1afc205'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:33.148936 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 894/1792] 10.222.0.70 () {58 vars in 1224 bytes} [Tue Aug 2 21:41:32 2022] DELETE /identity/v3/users/078539430c724398a321c77ce1afc205 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:41:33.153247 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a222e3-6fab-4f51-9cb4-299190b67712 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:33.154739 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a222e3-6fab-4f51-9cb4-299190b67712 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:33.155179 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a222e3-6fab-4f51-9cb4-299190b67712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:33.209311 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-b5a222e3-6fab-4f51-9cb4-299190b67712 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:41:33.213540 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-b5a222e3-6fab-4f51-9cb4-299190b67712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:33.433449 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 899/1793] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:41:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:41:33.575234 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d146d168-7751-4baf-b0dc-fab9a691ee4b admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:33.577724 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-d146d168-7751-4baf-b0dc-fab9a691ee4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:33.819375 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d146d168-7751-4baf-b0dc-fab9a691ee4b admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:33.827541 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fd845b-ca52-4a30-98e2-313da56111fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '723f5f43572a493dae0349070a2adb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:33.830438 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd845b-ca52-4a30-98e2-313da56111fc service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:33.832045 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd845b-ca52-4a30-98e2-313da56111fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:33.833555 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fd845b-ca52-4a30-98e2-313da56111fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:33.866961 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fd845b-ca52-4a30-98e2-313da56111fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:33.868469 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fd845b-ca52-4a30-98e2-313da56111fc service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:33.908097 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 895/1794] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:41:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:41:34.158778 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767fde74-cc4a-4b35-a487-5e7b6fb7f0d0 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:34.159390 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767fde74-cc4a-4b35-a487-5e7b6fb7f0d0 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:34.159390 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767fde74-cc4a-4b35-a487-5e7b6fb7f0d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:34.215083 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-767fde74-cc4a-4b35-a487-5e7b6fb7f0d0 None None] MFA Rules not processed for user `723f5f43572a493dae0349070a2adb5e`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:41:34.217144 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-767fde74-cc4a-4b35-a487-5e7b6fb7f0d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:34.228516 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 900/1795] 10.222.0.47 () {58 vars in 1015 bytes} [Tue Aug 2 21:41:34 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:41:34.256857 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fd845b-ca52-4a30-98e2-313da56111fc service neutron] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:34.258490 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-c3fd845b-ca52-4a30-98e2-313da56111fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:34.281117 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fd845b-ca52-4a30-98e2-313da56111fc service neutron] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:34.292609 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446974b3-ba22-4431-8c23-ffc484dcbc81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:34.294887 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446974b3-ba22-4431-8c23-ffc484dcbc81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:34.297330 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446974b3-ba22-4431-8c23-ffc484dcbc81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:34.299196 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446974b3-ba22-4431-8c23-ffc484dcbc81 admin admin] PATH_INFO: `/v3/projects/62a6e8fdbb72410c8a263492e1f2613c` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:34.305317 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446974b3-ba22-4431-8c23-ffc484dcbc81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62a6e8fdbb72410c8a263492e1f2613c)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:34.306533 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767fde74-cc4a-4b35-a487-5e7b6fb7f0d0 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:34.307982 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-767fde74-cc4a-4b35-a487-5e7b6fb7f0d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:34.314450 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446974b3-ba22-4431-8c23-ffc484dcbc81 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:34.337528 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767fde74-cc4a-4b35-a487-5e7b6fb7f0d0 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:34.357128 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed83efa-3b8c-440b-8b8c-27d7c45c7311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:34.357803 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed83efa-3b8c-440b-8b8c-27d7c45c7311 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:34.358191 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed83efa-3b8c-440b-8b8c-27d7c45c7311 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:34.358458 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed83efa-3b8c-440b-8b8c-27d7c45c7311 admin admin] PATH_INFO: `/v3/users/218e53822b8442fe89ad848c9e6b70ce` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:34.360610 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed83efa-3b8c-440b-8b8c-27d7c45c7311 admin admin] RBAC: Authorizing `identity:delete_user(user_id=218e53822b8442fe89ad848c9e6b70ce)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:34.362605 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed83efa-3b8c-440b-8b8c-27d7c45c7311 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:34.379658 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:34.451694 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-446974b3-ba22-4431-8c23-ffc484dcbc81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62a6e8fdbb72410c8a263492e1f2613c', 'request_id': 'req-446974b3-ba22-4431-8c23-ffc484dcbc81'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:34.475381 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-446974b3-ba22-4431-8c23-ffc484dcbc81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62a6e8fdbb72410c8a263492e1f2613c', 'request_id': 'req-446974b3-ba22-4431-8c23-ffc484dcbc81'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:34.486947 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:34.498092 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-446974b3-ba22-4431-8c23-ffc484dcbc81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62a6e8fdbb72410c8a263492e1f2613c', 'request_id': 'req-446974b3-ba22-4431-8c23-ffc484dcbc81'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:34.516411 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-5ed83efa-3b8c-440b-8b8c-27d7c45c7311 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '218e53822b8442fe89ad848c9e6b70ce'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:34.526097 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-446974b3-ba22-4431-8c23-ffc484dcbc81 admin admin] The token cache is being invalidate because project 62a6e8fdbb72410c8a263492e1f2613c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:41:34.526097 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-446974b3-ba22-4431-8c23-ffc484dcbc81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:34.529063 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-446974b3-ba22-4431-8c23-ffc484dcbc81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:34.534691 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 896/1796] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Aug 2 21:41:34 2022] DELETE /identity/v3/projects/62a6e8fdbb72410c8a263492e1f2613c => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:41:34.536088 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446974b3-ba22-4431-8c23-ffc484dcbc81 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:34.541946 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-5ed83efa-3b8c-440b-8b8c-27d7c45c7311 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '218e53822b8442fe89ad848c9e6b70ce'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:34.542289 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-446974b3-ba22-4431-8c23-ffc484dcbc81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:34.571872 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-5ed83efa-3b8c-440b-8b8c-27d7c45c7311 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '218e53822b8442fe89ad848c9e6b70ce'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:34.625149 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-5ed83efa-3b8c-440b-8b8c-27d7c45c7311 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '218e53822b8442fe89ad848c9e6b70ce'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:34.626207 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-5ed83efa-3b8c-440b-8b8c-27d7c45c7311 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '218e53822b8442fe89ad848c9e6b70ce'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:34.648328 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 901/1797] 10.222.0.70 () {58 vars in 1224 bytes} [Tue Aug 2 21:41:34 2022] DELETE /identity/v3/users/218e53822b8442fe89ad848c9e6b70ce => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:41:34.649625 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed83efa-3b8c-440b-8b8c-27d7c45c7311 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:34.654566 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-5ed83efa-3b8c-440b-8b8c-27d7c45c7311 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:34.745493 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446974b3-ba22-4431-8c23-ffc484dcbc81 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:34.863609 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b131df33-3821-473a-b575-f649361ccd69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '723f5f43572a493dae0349070a2adb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:34.863609 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b131df33-3821-473a-b575-f649361ccd69 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:34.863862 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b131df33-3821-473a-b575-f649361ccd69 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:34.865946 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b131df33-3821-473a-b575-f649361ccd69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:34.870219 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-b131df33-3821-473a-b575-f649361ccd69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:34.899325 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed83efa-3b8c-440b-8b8c-27d7c45c7311 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:34.900849 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b131df33-3821-473a-b575-f649361ccd69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:34.902835 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b131df33-3821-473a-b575-f649361ccd69 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:34.909954 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c8f97c-e89a-4246-9004-b02c8a007465 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '723f5f43572a493dae0349070a2adb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:34.913376 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c8f97c-e89a-4246-9004-b02c8a007465 service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:34.914064 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c8f97c-e89a-4246-9004-b02c8a007465 service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:34.914449 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c8f97c-e89a-4246-9004-b02c8a007465 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:34.921772 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 897/1798] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:41:34 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:41:34.922735 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b131df33-3821-473a-b575-f649361ccd69 service neutron] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:34.924671 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-b131df33-3821-473a-b575-f649361ccd69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:34.940245 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c8f97c-e89a-4246-9004-b02c8a007465 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:34.942485 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c8f97c-e89a-4246-9004-b02c8a007465 service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:34.961717 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 902/1799] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:41:34 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:41:34.963384 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc04bcd-abbd-4035-87ad-23e20c308693 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:34.963731 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc04bcd-abbd-4035-87ad-23e20c308693 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:34.964017 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc04bcd-abbd-4035-87ad-23e20c308693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:35.036153 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-7fc04bcd-abbd-4035-87ad-23e20c308693 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:41:35.042968 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-7fc04bcd-abbd-4035-87ad-23e20c308693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:35.127902 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b131df33-3821-473a-b575-f649361ccd69 service neutron] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:35.140958 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04565a8-aae3-4576-9dc5-7e7a45494ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:35.142047 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04565a8-aae3-4576-9dc5-7e7a45494ccc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:35.143177 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04565a8-aae3-4576-9dc5-7e7a45494ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:35.143685 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04565a8-aae3-4576-9dc5-7e7a45494ccc admin admin] PATH_INFO: `/v3/users/f6b3bd043e0644daa38ad0f9a095e9da` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:35.145351 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04565a8-aae3-4576-9dc5-7e7a45494ccc admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6b3bd043e0644daa38ad0f9a095e9da)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:35.147923 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04565a8-aae3-4576-9dc5-7e7a45494ccc admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:35.174181 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:35.240101 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-d04565a8-aae3-4576-9dc5-7e7a45494ccc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6b3bd043e0644daa38ad0f9a095e9da'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:35.264704 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-d04565a8-aae3-4576-9dc5-7e7a45494ccc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6b3bd043e0644daa38ad0f9a095e9da'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:35.298437 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 903/1800] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:41:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:41:35.300255 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc04bcd-abbd-4035-87ad-23e20c308693 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:35.301617 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-7fc04bcd-abbd-4035-87ad-23e20c308693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:35.301925 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-d04565a8-aae3-4576-9dc5-7e7a45494ccc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6b3bd043e0644daa38ad0f9a095e9da'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:35.302679 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-d04565a8-aae3-4576-9dc5-7e7a45494ccc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6b3bd043e0644daa38ad0f9a095e9da'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:35.318363 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-d04565a8-aae3-4576-9dc5-7e7a45494ccc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6b3bd043e0644daa38ad0f9a095e9da'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:35.336970 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 898/1801] 10.222.0.70 () {58 vars in 1224 bytes} [Tue Aug 2 21:41:34 2022] DELETE /identity/v3/users/f6b3bd043e0644daa38ad0f9a095e9da => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:41:35.344036 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc04bcd-abbd-4035-87ad-23e20c308693 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:35.368713 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04565a8-aae3-4576-9dc5-7e7a45494ccc admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:35.370688 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-d04565a8-aae3-4576-9dc5-7e7a45494ccc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:35.493647 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a267e5-681f-4e62-af2a-a001669e0fbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '723f5f43572a493dae0349070a2adb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:35.494201 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a267e5-681f-4e62-af2a-a001669e0fbd service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:35.495475 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a267e5-681f-4e62-af2a-a001669e0fbd service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:35.495754 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a267e5-681f-4e62-af2a-a001669e0fbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:35.504639 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-b4a267e5-681f-4e62-af2a-a001669e0fbd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:35.523329 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04565a8-aae3-4576-9dc5-7e7a45494ccc admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:35.529032 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a267e5-681f-4e62-af2a-a001669e0fbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:35.533062 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a267e5-681f-4e62-af2a-a001669e0fbd service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:35.535421 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e8ec56-1d4d-4a15-9a24-0a7b4237f872 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '723f5f43572a493dae0349070a2adb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:35.536098 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e8ec56-1d4d-4a15-9a24-0a7b4237f872 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:35.536464 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e8ec56-1d4d-4a15-9a24-0a7b4237f872 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:35.536745 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e8ec56-1d4d-4a15-9a24-0a7b4237f872 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:35.543002 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:35.547134 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-34e8ec56-1d4d-4a15-9a24-0a7b4237f872 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:35.563364 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 904/1802] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:41:35 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:41:35.737082 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e8ec56-1d4d-4a15-9a24-0a7b4237f872 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:35.744800 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e8ec56-1d4d-4a15-9a24-0a7b4237f872 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:35.786864 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 899/1803] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:41:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:41:36.433468 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a267e5-681f-4e62-af2a-a001669e0fbd service neutron] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:36.437936 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-b4a267e5-681f-4e62-af2a-a001669e0fbd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:36.501282 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a267e5-681f-4e62-af2a-a001669e0fbd service neutron] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:36.543167 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe33999-ffd1-416e-bf95-821e1742c44a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:36.544030 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe33999-ffd1-416e-bf95-821e1742c44a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:36.544493 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe33999-ffd1-416e-bf95-821e1742c44a admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:36.545951 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe33999-ffd1-416e-bf95-821e1742c44a admin admin] PATH_INFO: `/v3/projects/7aab1489affe418196a894ffd038c498` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:36.551086 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe33999-ffd1-416e-bf95-821e1742c44a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7aab1489affe418196a894ffd038c498)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:36.553376 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe33999-ffd1-416e-bf95-821e1742c44a admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:36.806368 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-abe33999-ffd1-416e-bf95-821e1742c44a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7aab1489affe418196a894ffd038c498', 'request_id': 'req-abe33999-ffd1-416e-bf95-821e1742c44a'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:36.853338 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-abe33999-ffd1-416e-bf95-821e1742c44a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7aab1489affe418196a894ffd038c498', 'request_id': 'req-abe33999-ffd1-416e-bf95-821e1742c44a'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:36.883457 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-abe33999-ffd1-416e-bf95-821e1742c44a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7aab1489affe418196a894ffd038c498', 'request_id': 'req-abe33999-ffd1-416e-bf95-821e1742c44a'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:36.908981 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-abe33999-ffd1-416e-bf95-821e1742c44a admin admin] The token cache is being invalidate because project 7aab1489affe418196a894ffd038c498 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:41:36.909305 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-abe33999-ffd1-416e-bf95-821e1742c44a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:36.911873 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-abe33999-ffd1-416e-bf95-821e1742c44a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:36.916259 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 905/1804] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Aug 2 21:41:36 2022] DELETE /identity/v3/projects/7aab1489affe418196a894ffd038c498 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:41:36.918411 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e8ec56-1d4d-4a15-9a24-0a7b4237f872 service neutron] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:36.947100 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e8ec56-1d4d-4a15-9a24-0a7b4237f872 service neutron] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:37.082911 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:37.147435 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79b26ba-dfc9-4dfb-8b3c-abadaf3a7f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:37.149535 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79b26ba-dfc9-4dfb-8b3c-abadaf3a7f52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:37.150845 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79b26ba-dfc9-4dfb-8b3c-abadaf3a7f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:37.151146 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79b26ba-dfc9-4dfb-8b3c-abadaf3a7f52 admin admin] PATH_INFO: `/v3/users/7e42feb3b5d543f6b18c376ea349d316` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:37.152598 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79b26ba-dfc9-4dfb-8b3c-abadaf3a7f52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e42feb3b5d543f6b18c376ea349d316)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:37.155364 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79b26ba-dfc9-4dfb-8b3c-abadaf3a7f52 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:37.254355 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-f79b26ba-dfc9-4dfb-8b3c-abadaf3a7f52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e42feb3b5d543f6b18c376ea349d316'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:37.269737 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-f79b26ba-dfc9-4dfb-8b3c-abadaf3a7f52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e42feb3b5d543f6b18c376ea349d316'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:37.290997 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-f79b26ba-dfc9-4dfb-8b3c-abadaf3a7f52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e42feb3b5d543f6b18c376ea349d316'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:37.291656 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-f79b26ba-dfc9-4dfb-8b3c-abadaf3a7f52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e42feb3b5d543f6b18c376ea349d316'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:37.304201 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-f79b26ba-dfc9-4dfb-8b3c-abadaf3a7f52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e42feb3b5d543f6b18c376ea349d316'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:37.346347 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 900/1805] 10.222.0.70 () {58 vars in 1224 bytes} [Tue Aug 2 21:41:36 2022] DELETE /identity/v3/users/7e42feb3b5d543f6b18c376ea349d316 => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:41:38.019432 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d583ca61-adc1-4339-90da-84df93d0d20a None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:38.020019 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d583ca61-adc1-4339-90da-84df93d0d20a None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:38.020263 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d583ca61-adc1-4339-90da-84df93d0d20a None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:38.022223 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 906/1806] 10.222.0.70 () {54 vars in 921 bytes} [Tue Aug 2 21:41:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:41:38.061556 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa94b58f-c416-4846-9d14-aef23611ec9d None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:38.062047 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa94b58f-c416-4846-9d14-aef23611ec9d None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:38.062262 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa94b58f-c416-4846-9d14-aef23611ec9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:38.105542 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-aa94b58f-c416-4846-9d14-aef23611ec9d None None] MFA Rules not processed for user `87dd5c1c5e854d4b96e0b7dad6aa3719`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:41:38.106814 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-aa94b58f-c416-4846-9d14-aef23611ec9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:38.329398 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 901/1807] 10.222.0.70 () {58 vars in 1018 bytes} [Tue Aug 2 21:41:38 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:41:38.967184 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d583ca61-adc1-4339-90da-84df93d0d20a None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:38.970602 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-d583ca61-adc1-4339-90da-84df93d0d20a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:39.198563 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa94b58f-c416-4846-9d14-aef23611ec9d None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:39.208103 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-aa94b58f-c416-4846-9d14-aef23611ec9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:39.242887 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa94b58f-c416-4846-9d14-aef23611ec9d None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:39.267989 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c02611-d07c-4031-b83f-3887979145ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87dd5c1c5e854d4b96e0b7dad6aa3719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:39.268560 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d583ca61-adc1-4339-90da-84df93d0d20a None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:39.271501 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c02611-d07c-4031-b83f-3887979145ba service nova] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:39.271958 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c02611-d07c-4031-b83f-3887979145ba service nova] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:39.272408 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c02611-d07c-4031-b83f-3887979145ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:39.281980 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524e063c-9545-4d26-8846-97fc63ba1426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:39.282969 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524e063c-9545-4d26-8846-97fc63ba1426 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:39.283591 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524e063c-9545-4d26-8846-97fc63ba1426 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:39.284038 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524e063c-9545-4d26-8846-97fc63ba1426 admin admin] PATH_INFO: `/v3/projects/0056bb94171d4dd4a9b2a0c5f18a7397` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:39.285607 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524e063c-9545-4d26-8846-97fc63ba1426 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0056bb94171d4dd4a9b2a0c5f18a7397)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:39.293003 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524e063c-9545-4d26-8846-97fc63ba1426 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:39.324699 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c02611-d07c-4031-b83f-3887979145ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:39.329927 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c02611-d07c-4031-b83f-3887979145ba service nova] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:39.354604 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 902/1808] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:41:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:41:39.355881 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c02611-d07c-4031-b83f-3887979145ba service nova] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:39.365226 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-31c02611-d07c-4031-b83f-3887979145ba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:39.398072 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c02611-d07c-4031-b83f-3887979145ba service nova] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:39.408481 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a7240b-0e95-4da1-bb45-6ab0f8973442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:39.409151 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a7240b-0e95-4da1-bb45-6ab0f8973442 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:39.409942 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a7240b-0e95-4da1-bb45-6ab0f8973442 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:39.409942 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a7240b-0e95-4da1-bb45-6ab0f8973442 admin admin] PATH_INFO: `/v3/projects/7de4257a985e45d5aeea6b23c618f1dd` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:39.419249 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a7240b-0e95-4da1-bb45-6ab0f8973442 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7de4257a985e45d5aeea6b23c618f1dd)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:39.421462 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a7240b-0e95-4da1-bb45-6ab0f8973442 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:39.502951 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:39.526387 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-524e063c-9545-4d26-8846-97fc63ba1426 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0056bb94171d4dd4a9b2a0c5f18a7397', 'request_id': 'req-524e063c-9545-4d26-8846-97fc63ba1426'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:39.535207 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-43a7240b-0e95-4da1-bb45-6ab0f8973442 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7de4257a985e45d5aeea6b23c618f1dd', 'request_id': 'req-43a7240b-0e95-4da1-bb45-6ab0f8973442'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:39.556494 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-524e063c-9545-4d26-8846-97fc63ba1426 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0056bb94171d4dd4a9b2a0c5f18a7397', 'request_id': 'req-524e063c-9545-4d26-8846-97fc63ba1426'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:39.557407 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-43a7240b-0e95-4da1-bb45-6ab0f8973442 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7de4257a985e45d5aeea6b23c618f1dd', 'request_id': 'req-43a7240b-0e95-4da1-bb45-6ab0f8973442'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:39.566580 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-43a7240b-0e95-4da1-bb45-6ab0f8973442 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7de4257a985e45d5aeea6b23c618f1dd', 'request_id': 'req-43a7240b-0e95-4da1-bb45-6ab0f8973442'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:39.592575 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-524e063c-9545-4d26-8846-97fc63ba1426 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0056bb94171d4dd4a9b2a0c5f18a7397', 'request_id': 'req-524e063c-9545-4d26-8846-97fc63ba1426'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:39.603078 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-43a7240b-0e95-4da1-bb45-6ab0f8973442 admin admin] The token cache is being invalidate because project 7de4257a985e45d5aeea6b23c618f1dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:41:39.603380 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-43a7240b-0e95-4da1-bb45-6ab0f8973442 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:39.617034 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-43a7240b-0e95-4da1-bb45-6ab0f8973442 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:39.618758 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-524e063c-9545-4d26-8846-97fc63ba1426 admin admin] The token cache is being invalidate because project 0056bb94171d4dd4a9b2a0c5f18a7397 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:41:39.618902 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 903/1809] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Aug 2 21:41:39 2022] DELETE /identity/v3/projects/7de4257a985e45d5aeea6b23c618f1dd => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:41:39.619330 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-524e063c-9545-4d26-8846-97fc63ba1426 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:39.626679 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566ac381-4d9a-4c8e-9d3f-c815f5fd5535 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:39.627219 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566ac381-4d9a-4c8e-9d3f-c815f5fd5535 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:39.627551 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566ac381-4d9a-4c8e-9d3f-c815f5fd5535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:39.637508 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-524e063c-9545-4d26-8846-97fc63ba1426 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:39.646178 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 907/1810] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Aug 2 21:41:38 2022] DELETE /identity/v3/projects/0056bb94171d4dd4a9b2a0c5f18a7397 => generated 0 bytes in 675 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:41:39.649418 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39dfd36-974e-455e-82d1-23340f6702db None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:39.649728 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39dfd36-974e-455e-82d1-23340f6702db None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:39.650016 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39dfd36-974e-455e-82d1-23340f6702db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:39.670913 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-566ac381-4d9a-4c8e-9d3f-c815f5fd5535 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:41:39.676536 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-566ac381-4d9a-4c8e-9d3f-c815f5fd5535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:39.751809 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-b39dfd36-974e-455e-82d1-23340f6702db None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:41:39.760420 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-b39dfd36-974e-455e-82d1-23340f6702db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:39.786429 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:39.831215 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 904/1811] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:41:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:41:39.832775 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533a3dff-efc2-48c9-b959-717d52989632 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:39.833075 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533a3dff-efc2-48c9-b959-717d52989632 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:39.833350 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533a3dff-efc2-48c9-b959-717d52989632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:39.880818 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-533a3dff-efc2-48c9-b959-717d52989632 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:41:39.883584 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-533a3dff-efc2-48c9-b959-717d52989632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:39.904429 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 905/1812] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:41:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:41:39.910125 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533a3dff-efc2-48c9-b959-717d52989632 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:39.925229 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 908/1813] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:41:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:41:39.926787 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe5478-318a-4d9a-ba34-6a380bb98ae2 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:39.927076 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe5478-318a-4d9a-ba34-6a380bb98ae2 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:39.927357 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fe5478-318a-4d9a-ba34-6a380bb98ae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:39.931154 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533a3dff-efc2-48c9-b959-717d52989632 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:39.946608 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d1b7ec-0fc0-415d-855b-a026eee48431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:39.947379 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d1b7ec-0fc0-415d-855b-a026eee48431 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:39.947734 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d1b7ec-0fc0-415d-855b-a026eee48431 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:39.948015 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d1b7ec-0fc0-415d-855b-a026eee48431 admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:39.951734 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d1b7ec-0fc0-415d-855b-a026eee48431 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:41:39.951870 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d1b7ec-0fc0-415d-855b-a026eee48431 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:39.955475 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d1b7ec-0fc0-415d-855b-a026eee48431 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:39.962175 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-20fe5478-318a-4d9a-ba34-6a380bb98ae2 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:41:39.964979 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-20fe5478-318a-4d9a-ba34-6a380bb98ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:39.988068 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 909/1814] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:41:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:41:39.992048 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 906/1815] 10.222.0.70 () {58 vars in 1153 bytes} [Tue Aug 2 21:41:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:41:39.997491 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d1b7ec-0fc0-415d-855b-a026eee48431 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:40.003297 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fe5478-318a-4d9a-ba34-6a380bb98ae2 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:40.020080 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d1b7ec-0fc0-415d-855b-a026eee48431 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:40.023093 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fe5478-318a-4d9a-ba34-6a380bb98ae2 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:40.028506 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc3b8ce-1294-4b11-b810-524e01b86a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:40.029144 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc3b8ce-1294-4b11-b810-524e01b86a27 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:40.029353 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590f869f-61e7-4a12-bdc6-04e0d121d596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:40.029503 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc3b8ce-1294-4b11-b810-524e01b86a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:40.029683 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc3b8ce-1294-4b11-b810-524e01b86a27 admin admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:40.030020 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590f869f-61e7-4a12-bdc6-04e0d121d596 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:40.030453 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc3b8ce-1294-4b11-b810-524e01b86a27 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:41:40.030828 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590f869f-61e7-4a12-bdc6-04e0d121d596 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:40.030930 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc3b8ce-1294-4b11-b810-524e01b86a27 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:40.031115 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590f869f-61e7-4a12-bdc6-04e0d121d596 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:40.031801 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590f869f-61e7-4a12-bdc6-04e0d121d596 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:40.032767 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc3b8ce-1294-4b11-b810-524e01b86a27 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:40.034840 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590f869f-61e7-4a12-bdc6-04e0d121d596 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:40.051849 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 910/1816] 10.222.0.70 () {58 vars in 1153 bytes} [Tue Aug 2 21:41:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:41:40.056920 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc3b8ce-1294-4b11-b810-524e01b86a27 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:40.106112 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc3b8ce-1294-4b11-b810-524e01b86a27 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:40.115589 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f274cb66-96f7-409c-b0c1-00a2e6f329c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:40.116222 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f274cb66-96f7-409c-b0c1-00a2e6f329c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:40.116526 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f274cb66-96f7-409c-b0c1-00a2e6f329c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:40.116810 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f274cb66-96f7-409c-b0c1-00a2e6f329c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:40.117476 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f274cb66-96f7-409c-b0c1-00a2e6f329c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:40.119407 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f274cb66-96f7-409c-b0c1-00a2e6f329c7 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:40.151981 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 907/1817] 10.222.0.70 () {60 vars in 1153 bytes} [Tue Aug 2 21:41:39 2022] POST /identity/v3/projects => generated 385 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:41:40.152962 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590f869f-61e7-4a12-bdc6-04e0d121d596 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:40.189866 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 911/1818] 10.222.0.70 () {60 vars in 1153 bytes} [Tue Aug 2 21:41:40 2022] POST /identity/v3/projects => generated 385 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:41:40.197638 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f274cb66-96f7-409c-b0c1-00a2e6f329c7 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:40.299063 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f274cb66-96f7-409c-b0c1-00a2e6f329c7 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:40.306610 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a6b966-8204-4a7a-8a4a-8af2f8e49505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:40.307283 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a6b966-8204-4a7a-8a4a-8af2f8e49505 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:40.307599 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a6b966-8204-4a7a-8a4a-8af2f8e49505 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:40.307880 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a6b966-8204-4a7a-8a4a-8af2f8e49505 admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:40.308901 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a6b966-8204-4a7a-8a4a-8af2f8e49505 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:40.312011 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a6b966-8204-4a7a-8a4a-8af2f8e49505 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:40.359908 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 912/1819] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 2 21:41:40 2022] POST /identity/v3/users => generated 293 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:41:40.361912 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590f869f-61e7-4a12-bdc6-04e0d121d596 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:40.362395 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a6b966-8204-4a7a-8a4a-8af2f8e49505 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:40.375187 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a6b966-8204-4a7a-8a4a-8af2f8e49505 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:40.378349 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52563c8f-512c-4d3d-b2bb-985986c801a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:40.379238 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52563c8f-512c-4d3d-b2bb-985986c801a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:40.379668 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52563c8f-512c-4d3d-b2bb-985986c801a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:40.380057 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52563c8f-512c-4d3d-b2bb-985986c801a9 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:40.380803 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52563c8f-512c-4d3d-b2bb-985986c801a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:40.381077 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865f31bd-1220-4356-9c1b-dfeeb0f85d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:40.381749 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865f31bd-1220-4356-9c1b-dfeeb0f85d5d admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:40.382044 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865f31bd-1220-4356-9c1b-dfeeb0f85d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:40.382326 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865f31bd-1220-4356-9c1b-dfeeb0f85d5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:40.382951 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52563c8f-512c-4d3d-b2bb-985986c801a9 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:40.383402 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865f31bd-1220-4356-9c1b-dfeeb0f85d5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:40.385197 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865f31bd-1220-4356-9c1b-dfeeb0f85d5d admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:40.419931 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 913/1820] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:41:40 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 21:41:40.426235 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865f31bd-1220-4356-9c1b-dfeeb0f85d5d admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:40.438935 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 908/1821] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 2 21:41:40 2022] POST /identity/v3/users => generated 293 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:41:40.444891 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52563c8f-512c-4d3d-b2bb-985986c801a9 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:40.448872 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865f31bd-1220-4356-9c1b-dfeeb0f85d5d admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:40.464271 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0405ab1-8918-457a-a4bb-a8f4d3bf9ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:40.464957 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0405ab1-8918-457a-a4bb-a8f4d3bf9ac7 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:40.466798 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0405ab1-8918-457a-a4bb-a8f4d3bf9ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:40.467308 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0405ab1-8918-457a-a4bb-a8f4d3bf9ac7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:40.468054 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0405ab1-8918-457a-a4bb-a8f4d3bf9ac7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:40.470141 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0405ab1-8918-457a-a4bb-a8f4d3bf9ac7 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:40.486259 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52563c8f-512c-4d3d-b2bb-985986c801a9 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:40.496286 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 914/1822] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:41:40 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:41:40.500632 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0405ab1-8918-457a-a4bb-a8f4d3bf9ac7 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:40.503293 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1272d1ad-8f4f-406a-a34a-24f1ba12dc9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:40.504087 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1272d1ad-8f4f-406a-a34a-24f1ba12dc9d admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:40.504452 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1272d1ad-8f4f-406a-a34a-24f1ba12dc9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:40.505924 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1272d1ad-8f4f-406a-a34a-24f1ba12dc9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:40.505924 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1272d1ad-8f4f-406a-a34a-24f1ba12dc9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:40.508956 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1272d1ad-8f4f-406a-a34a-24f1ba12dc9d admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:40.511539 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:40.521336 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0405ab1-8918-457a-a4bb-a8f4d3bf9ac7 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:40.527552 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 909/1823] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:41:40 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:41:40.531745 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1272d1ad-8f4f-406a-a34a-24f1ba12dc9d admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:40.547263 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9519d012-733a-4ddc-9843-d8255b732064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:40.547263 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9519d012-733a-4ddc-9843-d8255b732064 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:40.547263 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9519d012-733a-4ddc-9843-d8255b732064 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:40.547263 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9519d012-733a-4ddc-9843-d8255b732064 admin admin] PATH_INFO: `/v3/projects/ec70eeb388d045d5b80043eac221d5a9/users/6846595d53a54aaf9cd2f4d0dcd8e429/roles/462e3381a85c42a9959201f9aa122f7c` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:40.550687 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1272d1ad-8f4f-406a-a34a-24f1ba12dc9d admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:40.559740 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16f0871-d054-4557-acbd-952aa0eccef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:40.561225 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16f0871-d054-4557-acbd-952aa0eccef9 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:40.561519 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16f0871-d054-4557-acbd-952aa0eccef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:40.561803 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16f0871-d054-4557-acbd-952aa0eccef9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:40.562577 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16f0871-d054-4557-acbd-952aa0eccef9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:40.565748 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16f0871-d054-4557-acbd-952aa0eccef9 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:40.574680 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9519d012-733a-4ddc-9843-d8255b732064 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec70eeb388d045d5b80043eac221d5a9, user_id=6846595d53a54aaf9cd2f4d0dcd8e429, role_id=462e3381a85c42a9959201f9aa122f7c)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:40.579480 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 910/1824] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:41:40 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:41:40.580870 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9519d012-733a-4ddc-9843-d8255b732064 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:40.584589 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16f0871-d054-4557-acbd-952aa0eccef9 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:40.604299 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16f0871-d054-4557-acbd-952aa0eccef9 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:40.606080 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 915/1825] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:41:40 2022] PUT /identity/v3/projects/ec70eeb388d045d5b80043eac221d5a9/users/6846595d53a54aaf9cd2f4d0dcd8e429/roles/462e3381a85c42a9959201f9aa122f7c => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:41:40.616278 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea76d50-109f-461d-be80-47dc93d0d3d1 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:40.616818 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea76d50-109f-461d-be80-47dc93d0d3d1 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:40.617167 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea76d50-109f-461d-be80-47dc93d0d3d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:40.688711 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-3ea76d50-109f-461d-be80-47dc93d0d3d1 None None] MFA Rules not processed for user `6846595d53a54aaf9cd2f4d0dcd8e429`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:41:40.696294 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-3ea76d50-109f-461d-be80-47dc93d0d3d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:40.707795 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:40.781106 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2080ba60-ab87-497f-9806-bd8996d7557f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:40.783236 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2080ba60-ab87-497f-9806-bd8996d7557f admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:40.785740 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2080ba60-ab87-497f-9806-bd8996d7557f admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:40.786045 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2080ba60-ab87-497f-9806-bd8996d7557f admin admin] PATH_INFO: `/v3/projects/67c9b194ceba49399144070a64f3199a/users/e9be8069c1314cc48fde279b53453df2/roles/462e3381a85c42a9959201f9aa122f7c` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:40.820936 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2080ba60-ab87-497f-9806-bd8996d7557f admin admin] RBAC: Authorizing `identity:create_grant(project_id=67c9b194ceba49399144070a64f3199a, user_id=e9be8069c1314cc48fde279b53453df2, role_id=462e3381a85c42a9959201f9aa122f7c)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:40.825987 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2080ba60-ab87-497f-9806-bd8996d7557f admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:40.864519 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 911/1826] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:41:40 2022] PUT /identity/v3/projects/67c9b194ceba49399144070a64f3199a/users/e9be8069c1314cc48fde279b53453df2/roles/462e3381a85c42a9959201f9aa122f7c => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:41:40.869770 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14957d33-16c9-49db-988c-d783b71e1fa3 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:40.870055 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14957d33-16c9-49db-988c-d783b71e1fa3 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:40.870311 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14957d33-16c9-49db-988c-d783b71e1fa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:40.870825 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 916/1827] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:41:40 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:41:40.881035 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea76d50-109f-461d-be80-47dc93d0d3d1 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:40.882696 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-3ea76d50-109f-461d-be80-47dc93d0d3d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:40.993507 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-14957d33-16c9-49db-988c-d783b71e1fa3 None None] MFA Rules not processed for user `e9be8069c1314cc48fde279b53453df2`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:41:40.995502 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-14957d33-16c9-49db-988c-d783b71e1fa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:41.107435 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea76d50-109f-461d-be80-47dc93d0d3d1 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:41.247656 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 912/1828] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:41:40 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 380 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:41:41.249331 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14957d33-16c9-49db-988c-d783b71e1fa3 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:41.272819 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7baf5a7-16b1-4af8-979f-1fd62aa51e5c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '123eb76f95ee4e39905944da701c712d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:41.273660 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7baf5a7-16b1-4af8-979f-1fd62aa51e5c service cinder] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:41.274102 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7baf5a7-16b1-4af8-979f-1fd62aa51e5c service cinder] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:41.274511 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7baf5a7-16b1-4af8-979f-1fd62aa51e5c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:41.423446 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7baf5a7-16b1-4af8-979f-1fd62aa51e5c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:41.425020 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7baf5a7-16b1-4af8-979f-1fd62aa51e5c service cinder] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:41.445671 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 917/1829] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:41:40 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 565 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:41:41.453574 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14957d33-16c9-49db-988c-d783b71e1fa3 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:41.464931 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368b1b50-125b-48ed-b991-d44df7d86fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:41.465779 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368b1b50-125b-48ed-b991-d44df7d86fd5 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:41.466132 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368b1b50-125b-48ed-b991-d44df7d86fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:41.466548 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368b1b50-125b-48ed-b991-d44df7d86fd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:41.467113 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368b1b50-125b-48ed-b991-d44df7d86fd5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:41.470456 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368b1b50-125b-48ed-b991-d44df7d86fd5 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:41.481164 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7baf5a7-16b1-4af8-979f-1fd62aa51e5c service cinder] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:41.487320 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:41.497122 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7baf5a7-16b1-4af8-979f-1fd62aa51e5c service cinder] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:41.513006 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0a0318-2dff-40b5-a483-3809df1d09ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:41.513684 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0a0318-2dff-40b5-a483-3809df1d09ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:41.513966 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0a0318-2dff-40b5-a483-3809df1d09ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:41.514264 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0a0318-2dff-40b5-a483-3809df1d09ff admin admin] PATH_INFO: `/v3/users/6846595d53a54aaf9cd2f4d0dcd8e429` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:41.517115 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0a0318-2dff-40b5-a483-3809df1d09ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=6846595d53a54aaf9cd2f4d0dcd8e429)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:41.519584 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0a0318-2dff-40b5-a483-3809df1d09ff admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:41.543504 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:41.562550 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 913/1830] 10.222.0.70 () {60 vars in 1153 bytes} [Tue Aug 2 21:41:41 2022] POST /identity/v3/projects => generated 385 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:41:41.563913 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368b1b50-125b-48ed-b991-d44df7d86fd5 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:41.636767 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-4c0a0318-2dff-40b5-a483-3809df1d09ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6846595d53a54aaf9cd2f4d0dcd8e429'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:41.657499 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-4c0a0318-2dff-40b5-a483-3809df1d09ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6846595d53a54aaf9cd2f4d0dcd8e429'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:41.676019 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-4c0a0318-2dff-40b5-a483-3809df1d09ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6846595d53a54aaf9cd2f4d0dcd8e429'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:41.694017 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-4c0a0318-2dff-40b5-a483-3809df1d09ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6846595d53a54aaf9cd2f4d0dcd8e429'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:41.695269 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-4c0a0318-2dff-40b5-a483-3809df1d09ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6846595d53a54aaf9cd2f4d0dcd8e429'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:41.720264 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 918/1831] 10.222.0.70 () {58 vars in 1224 bytes} [Tue Aug 2 21:41:41 2022] DELETE /identity/v3/users/6846595d53a54aaf9cd2f4d0dcd8e429 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:41:41.720264 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0348509e-cee5-485b-b03b-a7776fd4a910 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:41.720264 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0348509e-cee5-485b-b03b-a7776fd4a910 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:41.720264 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0348509e-cee5-485b-b03b-a7776fd4a910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:41.729552 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368b1b50-125b-48ed-b991-d44df7d86fd5 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:41.757317 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-0348509e-cee5-485b-b03b-a7776fd4a910 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:41:41.763221 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-0348509e-cee5-485b-b03b-a7776fd4a910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:41.889858 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 919/1832] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:41:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:41:41.916164 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185c840f-aecb-4940-98aa-26c3f0db4015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:41.917860 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185c840f-aecb-4940-98aa-26c3f0db4015 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:41.919107 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185c840f-aecb-4940-98aa-26c3f0db4015 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:41.919594 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185c840f-aecb-4940-98aa-26c3f0db4015 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:41.921628 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185c840f-aecb-4940-98aa-26c3f0db4015 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:41.932991 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185c840f-aecb-4940-98aa-26c3f0db4015 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:41.939718 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0348509e-cee5-485b-b03b-a7776fd4a910 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:41.941143 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-0348509e-cee5-485b-b03b-a7776fd4a910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:41.974646 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 914/1833] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 2 21:41:41 2022] POST /identity/v3/users => generated 299 bytes in 411 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:41:41.980519 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185c840f-aecb-4940-98aa-26c3f0db4015 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:41.982643 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-185c840f-aecb-4940-98aa-26c3f0db4015 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:42.003207 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185c840f-aecb-4940-98aa-26c3f0db4015 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:42.011074 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636ba9b1-f7b3-477e-98f0-e20c432e045d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:42.012050 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636ba9b1-f7b3-477e-98f0-e20c432e045d admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:42.012598 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636ba9b1-f7b3-477e-98f0-e20c432e045d admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:42.013034 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636ba9b1-f7b3-477e-98f0-e20c432e045d admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:42.015216 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636ba9b1-f7b3-477e-98f0-e20c432e045d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:42.017035 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636ba9b1-f7b3-477e-98f0-e20c432e045d admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:42.036719 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 915/1834] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:41:41 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:41:42.038580 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf5428-6d36-4108-83df-8656bb7c8b94 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:42.038876 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf5428-6d36-4108-83df-8656bb7c8b94 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:42.039157 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edf5428-6d36-4108-83df-8656bb7c8b94 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:42.041911 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 916/1835] 10.222.0.70 () {54 vars in 921 bytes} [Tue Aug 2 21:41:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:41:42.042850 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edf5428-6d36-4108-83df-8656bb7c8b94 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:42.055492 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0348509e-cee5-485b-b03b-a7776fd4a910 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:42.059885 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edf5428-6d36-4108-83df-8656bb7c8b94 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:42.060906 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c1c479-3942-46ed-b686-6f94af59830a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '723f5f43572a493dae0349070a2adb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:42.062209 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c1c479-3942-46ed-b686-6f94af59830a service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:42.062209 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c1c479-3942-46ed-b686-6f94af59830a service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:42.062209 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c1c479-3942-46ed-b686-6f94af59830a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:42.070269 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c91012-6ef8-4113-969f-b60884ed690a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:42.072553 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c91012-6ef8-4113-969f-b60884ed690a admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:42.072838 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c91012-6ef8-4113-969f-b60884ed690a admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:42.073116 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c91012-6ef8-4113-969f-b60884ed690a admin admin] PATH_INFO: `/v3/projects/00f3c3f1c74544b3a01debf728b69f6e/users/3e51d2cce1fe4a91b3b3cb1eb0c5d818/roles/3e32dbf75f9b41f5adb9fe59851267bb` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:42.077153 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c1c479-3942-46ed-b686-6f94af59830a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:42.078690 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c1c479-3942-46ed-b686-6f94af59830a service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:42.094725 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 920/1836] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:41:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 21:41:42.103564 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c91012-6ef8-4113-969f-b60884ed690a admin admin] RBAC: Authorizing `identity:create_grant(project_id=00f3c3f1c74544b3a01debf728b69f6e, user_id=3e51d2cce1fe4a91b3b3cb1eb0c5d818, role_id=3e32dbf75f9b41f5adb9fe59851267bb)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:42.106601 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c91012-6ef8-4113-969f-b60884ed690a admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:42.110076 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc25f9da-1838-48b6-954f-b24799456333 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:42.110374 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc25f9da-1838-48b6-954f-b24799456333 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:42.110656 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc25f9da-1838-48b6-954f-b24799456333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:42.127883 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 917/1837] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:41:42 2022] PUT /identity/v3/projects/00f3c3f1c74544b3a01debf728b69f6e/users/3e51d2cce1fe4a91b3b3cb1eb0c5d818/roles/3e32dbf75f9b41f5adb9fe59851267bb => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:41:42.133848 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c91012-6ef8-4113-969f-b60884ed690a admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:42.139168 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-bc25f9da-1838-48b6-954f-b24799456333 None None] MFA Rules not processed for user `87dd5c1c5e854d4b96e0b7dad6aa3719`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:41:42.141056 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-bc25f9da-1838-48b6-954f-b24799456333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:42.178518 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:42.199454 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:42.218893 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c91012-6ef8-4113-969f-b60884ed690a admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:42.229348 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e826bca9-7ccc-4e2d-957c-2cfef30a1210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:42.230336 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e826bca9-7ccc-4e2d-957c-2cfef30a1210 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:42.230905 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e826bca9-7ccc-4e2d-957c-2cfef30a1210 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:42.231188 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e826bca9-7ccc-4e2d-957c-2cfef30a1210 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:42.232018 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e826bca9-7ccc-4e2d-957c-2cfef30a1210 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:42.234175 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e826bca9-7ccc-4e2d-957c-2cfef30a1210 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:42.243890 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 921/1838] 10.222.0.70 () {58 vars in 1018 bytes} [Tue Aug 2 21:41:42 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:41:42.246725 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 918/1839] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:41:42 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:41:42.251038 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc25f9da-1838-48b6-954f-b24799456333 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:42.261849 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc25f9da-1838-48b6-954f-b24799456333 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:42.267163 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf88407e-2068-46ee-9e82-c9133c912673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:42.268459 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf88407e-2068-46ee-9e82-c9133c912673 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:42.268749 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf88407e-2068-46ee-9e82-c9133c912673 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:42.269030 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf88407e-2068-46ee-9e82-c9133c912673 admin admin] PATH_INFO: `/v3/projects/00f3c3f1c74544b3a01debf728b69f6e/users/3e51d2cce1fe4a91b3b3cb1eb0c5d818/roles/3e32dbf75f9b41f5adb9fe59851267bb` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:42.271047 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf88407e-2068-46ee-9e82-c9133c912673 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00f3c3f1c74544b3a01debf728b69f6e, user_id=3e51d2cce1fe4a91b3b3cb1eb0c5d818, role_id=3e32dbf75f9b41f5adb9fe59851267bb)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:42.273880 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf88407e-2068-46ee-9e82-c9133c912673 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:42.287590 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 922/1840] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:41:42 2022] PUT /identity/v3/projects/00f3c3f1c74544b3a01debf728b69f6e/users/3e51d2cce1fe4a91b3b3cb1eb0c5d818/roles/3e32dbf75f9b41f5adb9fe59851267bb => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:41:42.299031 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee8e480-db8a-44c4-bd04-843870a85120 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:42.299329 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee8e480-db8a-44c4-bd04-843870a85120 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:42.299618 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee8e480-db8a-44c4-bd04-843870a85120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:42.332289 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-eee8e480-db8a-44c4-bd04-843870a85120 None None] MFA Rules not processed for user `3e51d2cce1fe4a91b3b3cb1eb0c5d818`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:41:42.333641 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-eee8e480-db8a-44c4-bd04-843870a85120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:42.430805 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 919/1841] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:41:42 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:41:42.432717 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf88407e-2068-46ee-9e82-c9133c912673 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:42.436900 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-bf88407e-2068-46ee-9e82-c9133c912673 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:42.535720 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf88407e-2068-46ee-9e82-c9133c912673 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:42.540547 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98fc949-1f0b-427f-a612-466ce102439f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '123eb76f95ee4e39905944da701c712d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:42.541272 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98fc949-1f0b-427f-a612-466ce102439f service cinder] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:42.541797 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98fc949-1f0b-427f-a612-466ce102439f service cinder] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:42.542266 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98fc949-1f0b-427f-a612-466ce102439f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:42.554071 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98fc949-1f0b-427f-a612-466ce102439f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:42.555872 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98fc949-1f0b-427f-a612-466ce102439f service cinder] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:42.570265 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 923/1842] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:41:42 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:41:42.798364 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee8e480-db8a-44c4-bd04-843870a85120 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:42.800035 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-eee8e480-db8a-44c4-bd04-843870a85120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:42.880568 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98fc949-1f0b-427f-a612-466ce102439f service cinder] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:42.882033 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-e98fc949-1f0b-427f-a612-466ce102439f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:42.985122 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee8e480-db8a-44c4-bd04-843870a85120 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:43.012084 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492e9a4f-a2f8-41b2-a705-0e08274f197d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87dd5c1c5e854d4b96e0b7dad6aa3719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:43.012897 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492e9a4f-a2f8-41b2-a705-0e08274f197d service nova] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:43.013282 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492e9a4f-a2f8-41b2-a705-0e08274f197d service nova] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:43.013617 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98fc949-1f0b-427f-a612-466ce102439f service cinder] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:43.013826 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492e9a4f-a2f8-41b2-a705-0e08274f197d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:43.028841 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bf8ea0-cc31-46ae-8aa1-fc7e4147cdc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:43.029513 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bf8ea0-cc31-46ae-8aa1-fc7e4147cdc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:43.029798 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bf8ea0-cc31-46ae-8aa1-fc7e4147cdc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:43.030081 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bf8ea0-cc31-46ae-8aa1-fc7e4147cdc1 admin admin] PATH_INFO: `/v3/projects/ec70eeb388d045d5b80043eac221d5a9` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:43.031280 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bf8ea0-cc31-46ae-8aa1-fc7e4147cdc1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec70eeb388d045d5b80043eac221d5a9)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:43.033296 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bf8ea0-cc31-46ae-8aa1-fc7e4147cdc1 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:43.036154 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492e9a4f-a2f8-41b2-a705-0e08274f197d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:43.037832 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492e9a4f-a2f8-41b2-a705-0e08274f197d service nova] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:43.061007 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 920/1843] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:41:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:41:43.128431 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-17bf8ea0-cc31-46ae-8aa1-fc7e4147cdc1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec70eeb388d045d5b80043eac221d5a9', 'request_id': 'req-17bf8ea0-cc31-46ae-8aa1-fc7e4147cdc1'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:43.133030 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:43.137028 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-17bf8ea0-cc31-46ae-8aa1-fc7e4147cdc1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec70eeb388d045d5b80043eac221d5a9', 'request_id': 'req-17bf8ea0-cc31-46ae-8aa1-fc7e4147cdc1'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:43.152281 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-17bf8ea0-cc31-46ae-8aa1-fc7e4147cdc1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec70eeb388d045d5b80043eac221d5a9', 'request_id': 'req-17bf8ea0-cc31-46ae-8aa1-fc7e4147cdc1'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:43.169434 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-17bf8ea0-cc31-46ae-8aa1-fc7e4147cdc1 admin admin] The token cache is being invalidate because project ec70eeb388d045d5b80043eac221d5a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:41:43.169928 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-17bf8ea0-cc31-46ae-8aa1-fc7e4147cdc1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:43.170993 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-17bf8ea0-cc31-46ae-8aa1-fc7e4147cdc1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:43.173353 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 924/1844] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Aug 2 21:41:42 2022] DELETE /identity/v3/projects/ec70eeb388d045d5b80043eac221d5a9 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:41:43.178927 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6044024e-48b7-4376-8f76-5d72890f1a3b None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:43.179211 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6044024e-48b7-4376-8f76-5d72890f1a3b None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:43.179491 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6044024e-48b7-4376-8f76-5d72890f1a3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:43.225168 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-6044024e-48b7-4376-8f76-5d72890f1a3b None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:41:43.226841 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-6044024e-48b7-4376-8f76-5d72890f1a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:43.315744 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:43.332381 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 921/1845] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:41:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:41:43.342375 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77830d9f-d860-489a-9b3a-90ccaff95565 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:43.342749 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77830d9f-d860-489a-9b3a-90ccaff95565 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:43.344941 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77830d9f-d860-489a-9b3a-90ccaff95565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:43.373473 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-77830d9f-d860-489a-9b3a-90ccaff95565 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:41:43.374854 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-77830d9f-d860-489a-9b3a-90ccaff95565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:43.385447 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 925/1846] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:41:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:41:43.390545 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6044024e-48b7-4376-8f76-5d72890f1a3b None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:43.402179 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6044024e-48b7-4376-8f76-5d72890f1a3b None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:43.408672 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc2b18e-fd61-48d7-902c-90c92d093117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:43.409419 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc2b18e-fd61-48d7-902c-90c92d093117 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:43.409786 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc2b18e-fd61-48d7-902c-90c92d093117 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:43.410128 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc2b18e-fd61-48d7-902c-90c92d093117 admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:43.410904 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc2b18e-fd61-48d7-902c-90c92d093117 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:41:43.411273 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc2b18e-fd61-48d7-902c-90c92d093117 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:43.413159 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc2b18e-fd61-48d7-902c-90c92d093117 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:43.423076 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77830d9f-d860-489a-9b3a-90ccaff95565 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:43.425181 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-77830d9f-d860-489a-9b3a-90ccaff95565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:43.433577 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 922/1847] 10.222.0.70 () {58 vars in 1153 bytes} [Tue Aug 2 21:41:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:41:43.433577 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc2b18e-fd61-48d7-902c-90c92d093117 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:43.440040 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77830d9f-d860-489a-9b3a-90ccaff95565 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:43.444504 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc2b18e-fd61-48d7-902c-90c92d093117 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:43.446054 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a76212-d50f-495f-9ba0-3489a730ffbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:43.446682 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a76212-d50f-495f-9ba0-3489a730ffbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:43.447009 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a76212-d50f-495f-9ba0-3489a730ffbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:43.447930 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a76212-d50f-495f-9ba0-3489a730ffbf admin admin] PATH_INFO: `/v3/projects/5e7bdb0aeab94872b63cf854e9d4871a` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:43.448743 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a76212-d50f-495f-9ba0-3489a730ffbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e7bdb0aeab94872b63cf854e9d4871a)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:43.451400 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74eb772-e2bc-48d8-aea2-e8c527813752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:43.451557 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a76212-d50f-495f-9ba0-3489a730ffbf admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:43.452351 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74eb772-e2bc-48d8-aea2-e8c527813752 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:43.452583 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74eb772-e2bc-48d8-aea2-e8c527813752 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:43.452867 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74eb772-e2bc-48d8-aea2-e8c527813752 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:43.454088 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74eb772-e2bc-48d8-aea2-e8c527813752 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:43.456263 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74eb772-e2bc-48d8-aea2-e8c527813752 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:43.519790 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 923/1848] 10.222.0.70 () {60 vars in 1153 bytes} [Tue Aug 2 21:41:43 2022] POST /identity/v3/projects => generated 361 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:41:43.520978 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74eb772-e2bc-48d8-aea2-e8c527813752 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:43.525361 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-b74eb772-e2bc-48d8-aea2-e8c527813752 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:43.538020 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-17a76212-d50f-495f-9ba0-3489a730ffbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e7bdb0aeab94872b63cf854e9d4871a', 'request_id': 'req-17a76212-d50f-495f-9ba0-3489a730ffbf'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:43.545975 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-17a76212-d50f-495f-9ba0-3489a730ffbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e7bdb0aeab94872b63cf854e9d4871a', 'request_id': 'req-17a76212-d50f-495f-9ba0-3489a730ffbf'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:43.559936 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-17a76212-d50f-495f-9ba0-3489a730ffbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e7bdb0aeab94872b63cf854e9d4871a', 'request_id': 'req-17a76212-d50f-495f-9ba0-3489a730ffbf'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:43.579567 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-17a76212-d50f-495f-9ba0-3489a730ffbf admin admin] The token cache is being invalidate because project 5e7bdb0aeab94872b63cf854e9d4871a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:41:43.580691 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-17a76212-d50f-495f-9ba0-3489a730ffbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:43.581467 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-17a76212-d50f-495f-9ba0-3489a730ffbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:43.589799 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 926/1849] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Aug 2 21:41:43 2022] DELETE /identity/v3/projects/5e7bdb0aeab94872b63cf854e9d4871a => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:41:43.590950 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a76212-d50f-495f-9ba0-3489a730ffbf admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:43.592984 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-17a76212-d50f-495f-9ba0-3489a730ffbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:43.658639 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74eb772-e2bc-48d8-aea2-e8c527813752 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:43.665764 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f68319f-cad7-47b3-98bf-5c9203a06456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:43.666910 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f68319f-cad7-47b3-98bf-5c9203a06456 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:43.667347 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f68319f-cad7-47b3-98bf-5c9203a06456 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:43.667849 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f68319f-cad7-47b3-98bf-5c9203a06456 admin admin] PATH_INFO: `/v3/users/e9be8069c1314cc48fde279b53453df2` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:43.669512 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f68319f-cad7-47b3-98bf-5c9203a06456 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9be8069c1314cc48fde279b53453df2)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:43.671837 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f68319f-cad7-47b3-98bf-5c9203a06456 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:43.691887 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a76212-d50f-495f-9ba0-3489a730ffbf admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:43.698386 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845eb1c3-4890-4135-b9de-6366eb95f7f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:43.699882 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845eb1c3-4890-4135-b9de-6366eb95f7f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:43.699882 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845eb1c3-4890-4135-b9de-6366eb95f7f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:43.699882 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845eb1c3-4890-4135-b9de-6366eb95f7f2 admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:43.700763 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845eb1c3-4890-4135-b9de-6366eb95f7f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:43.703442 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845eb1c3-4890-4135-b9de-6366eb95f7f2 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:43.732852 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 927/1850] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 2 21:41:43 2022] POST /identity/v3/users => generated 281 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:41:43.733948 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845eb1c3-4890-4135-b9de-6366eb95f7f2 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:43.736837 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-845eb1c3-4890-4135-b9de-6366eb95f7f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:43.753628 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845eb1c3-4890-4135-b9de-6366eb95f7f2 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:43.764056 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42fcd36-e5e7-4d56-92d4-8e4f6feb07ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:43.765095 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42fcd36-e5e7-4d56-92d4-8e4f6feb07ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:43.765796 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42fcd36-e5e7-4d56-92d4-8e4f6feb07ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:43.766008 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42fcd36-e5e7-4d56-92d4-8e4f6feb07ff admin admin] PATH_INFO: `/v3/users/fd21d13773e94b94a3629b7365d92996` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:43.767601 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42fcd36-e5e7-4d56-92d4-8e4f6feb07ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd21d13773e94b94a3629b7365d92996)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:43.769643 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42fcd36-e5e7-4d56-92d4-8e4f6feb07ff admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:43.778870 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-4f68319f-cad7-47b3-98bf-5c9203a06456 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9be8069c1314cc48fde279b53453df2'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:43.808386 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-4f68319f-cad7-47b3-98bf-5c9203a06456 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9be8069c1314cc48fde279b53453df2'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:43.834887 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-4f68319f-cad7-47b3-98bf-5c9203a06456 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9be8069c1314cc48fde279b53453df2'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:43.836427 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-4f68319f-cad7-47b3-98bf-5c9203a06456 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9be8069c1314cc48fde279b53453df2'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:43.846844 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:DELETE=15,keystone:SELECT=80,keystone:INSERT=5 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:43.849819 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-4f68319f-cad7-47b3-98bf-5c9203a06456 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9be8069c1314cc48fde279b53453df2'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:43.850678 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-f42fcd36-e5e7-4d56-92d4-8e4f6feb07ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd21d13773e94b94a3629b7365d92996'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:43.857126 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 924/1851] 10.222.0.70 () {58 vars in 1224 bytes} [Tue Aug 2 21:41:43 2022] DELETE /identity/v3/users/e9be8069c1314cc48fde279b53453df2 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:41:43.857993 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f68319f-cad7-47b3-98bf-5c9203a06456 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:43.859564 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-4f68319f-cad7-47b3-98bf-5c9203a06456 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:43.863032 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-f42fcd36-e5e7-4d56-92d4-8e4f6feb07ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd21d13773e94b94a3629b7365d92996'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:43.882231 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-f42fcd36-e5e7-4d56-92d4-8e4f6feb07ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd21d13773e94b94a3629b7365d92996'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:43.890724 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-f42fcd36-e5e7-4d56-92d4-8e4f6feb07ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd21d13773e94b94a3629b7365d92996'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:43.892559 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-f42fcd36-e5e7-4d56-92d4-8e4f6feb07ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd21d13773e94b94a3629b7365d92996'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:43.901837 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 928/1852] 10.222.0.70 () {58 vars in 1224 bytes} [Tue Aug 2 21:41:43 2022] DELETE /identity/v3/users/fd21d13773e94b94a3629b7365d92996 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:41:43.903140 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e0c374-9cb1-413a-a5a6-8771a6a1f641 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:43.903532 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e0c374-9cb1-413a-a5a6-8771a6a1f641 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:43.904058 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e0c374-9cb1-413a-a5a6-8771a6a1f641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:43.917349 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:43.933272 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-85e0c374-9cb1-413a-a5a6-8771a6a1f641 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:41:43.934679 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-85e0c374-9cb1-413a-a5a6-8771a6a1f641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:43.946232 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f68319f-cad7-47b3-98bf-5c9203a06456 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:44.039039 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea19502-597c-4c62-b34f-7fcd95995154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:44.039714 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea19502-597c-4c62-b34f-7fcd95995154 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:44.039944 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea19502-597c-4c62-b34f-7fcd95995154 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:44.040270 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea19502-597c-4c62-b34f-7fcd95995154 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:44.041232 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea19502-597c-4c62-b34f-7fcd95995154 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:44.042850 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea19502-597c-4c62-b34f-7fcd95995154 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:44.056273 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 925/1853] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:41:43 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:41:44.059243 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea19502-597c-4c62-b34f-7fcd95995154 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:44.061896 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-aea19502-597c-4c62-b34f-7fcd95995154 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:44.077668 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea19502-597c-4c62-b34f-7fcd95995154 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:44.079664 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 929/1854] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:41:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:41:44.082267 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674285fd-72d6-4f3d-8281-db3ba95557a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:44.082902 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674285fd-72d6-4f3d-8281-db3ba95557a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:44.083189 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674285fd-72d6-4f3d-8281-db3ba95557a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:44.083466 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674285fd-72d6-4f3d-8281-db3ba95557a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:44.085853 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674285fd-72d6-4f3d-8281-db3ba95557a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:44.087448 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674285fd-72d6-4f3d-8281-db3ba95557a3 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:44.100310 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 926/1855] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:41:44 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 21:41:44.104206 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e0c374-9cb1-413a-a5a6-8771a6a1f641 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:44.115767 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e0c374-9cb1-413a-a5a6-8771a6a1f641 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:44.126681 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4540915a-aca4-4334-a013-80d1c8b97102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:44.127369 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4540915a-aca4-4334-a013-80d1c8b97102 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:44.127931 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4540915a-aca4-4334-a013-80d1c8b97102 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:44.129228 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674285fd-72d6-4f3d-8281-db3ba95557a3 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:44.130915 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-674285fd-72d6-4f3d-8281-db3ba95557a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:44.136766 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4540915a-aca4-4334-a013-80d1c8b97102 admin admin] PATH_INFO: `/v3/projects/fc0b3b32b11a4cdc8283d92bbd062070/users/7549d06283a3467d816b621c7753ac9d/roles/462e3381a85c42a9959201f9aa122f7c` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:44.162577 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4540915a-aca4-4334-a013-80d1c8b97102 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc0b3b32b11a4cdc8283d92bbd062070, user_id=7549d06283a3467d816b621c7753ac9d, role_id=462e3381a85c42a9959201f9aa122f7c)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:44.168353 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4540915a-aca4-4334-a013-80d1c8b97102 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:44.229242 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674285fd-72d6-4f3d-8281-db3ba95557a3 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:44.237526 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 930/1856] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:41:44 2022] PUT /identity/v3/projects/fc0b3b32b11a4cdc8283d92bbd062070/users/7549d06283a3467d816b621c7753ac9d/roles/462e3381a85c42a9959201f9aa122f7c => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:41:44.247569 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcad93e-378c-4ea9-92fd-39fed5244780 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:44.247941 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcad93e-378c-4ea9-92fd-39fed5244780 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:44.248847 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcad93e-378c-4ea9-92fd-39fed5244780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:44.288638 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-ebcad93e-378c-4ea9-92fd-39fed5244780 None None] MFA Rules not processed for user `7549d06283a3467d816b621c7753ac9d`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:41:44.289934 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-ebcad93e-378c-4ea9-92fd-39fed5244780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:44.297271 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f210975-4027-4116-8440-97b6725d1384 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '723f5f43572a493dae0349070a2adb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:44.298337 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f210975-4027-4116-8440-97b6725d1384 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:44.299359 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f210975-4027-4116-8440-97b6725d1384 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:44.300274 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f210975-4027-4116-8440-97b6725d1384 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:44.358412 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:44.394627 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f210975-4027-4116-8440-97b6725d1384 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:44.396640 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f210975-4027-4116-8440-97b6725d1384 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:44.408954 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 927/1857] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:41:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 21:41:44.425954 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 931/1858] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:41:44 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:41:44.462314 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f210975-4027-4116-8440-97b6725d1384 service neutron] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:44.463769 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-0f210975-4027-4116-8440-97b6725d1384 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:44.524135 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcad93e-378c-4ea9-92fd-39fed5244780 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:44.525725 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-ebcad93e-378c-4ea9-92fd-39fed5244780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:44.553741 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcad93e-378c-4ea9-92fd-39fed5244780 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:44.566438 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db2c4b2-c291-4b1b-8fe7-706ff69c80b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:44.567301 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db2c4b2-c291-4b1b-8fe7-706ff69c80b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:44.568137 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db2c4b2-c291-4b1b-8fe7-706ff69c80b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:44.568717 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db2c4b2-c291-4b1b-8fe7-706ff69c80b5 admin admin] PATH_INFO: `/v3/projects/0352e4cba7444d19acee80247be4aa63` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:44.572855 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db2c4b2-c291-4b1b-8fe7-706ff69c80b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0352e4cba7444d19acee80247be4aa63)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:44.577440 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db2c4b2-c291-4b1b-8fe7-706ff69c80b5 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:44.578798 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f210975-4027-4116-8440-97b6725d1384 service neutron] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:44.592921 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf72792-018e-4496-afed-b41fa777fcb1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '123eb76f95ee4e39905944da701c712d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:44.593667 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf72792-018e-4496-afed-b41fa777fcb1 service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:44.594051 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf72792-018e-4496-afed-b41fa777fcb1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:44.594441 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf72792-018e-4496-afed-b41fa777fcb1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:44.617559 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf72792-018e-4496-afed-b41fa777fcb1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:44.619590 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf72792-018e-4496-afed-b41fa777fcb1 service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:44.634176 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:44.637329 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 928/1859] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:41:44 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:41:44.655880 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf72792-018e-4496-afed-b41fa777fcb1 service cinder] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:44.668520 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf72792-018e-4496-afed-b41fa777fcb1 service cinder] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:44.669768 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-1db2c4b2-c291-4b1b-8fe7-706ff69c80b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0352e4cba7444d19acee80247be4aa63', 'request_id': 'req-1db2c4b2-c291-4b1b-8fe7-706ff69c80b5'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:44.677744 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-1db2c4b2-c291-4b1b-8fe7-706ff69c80b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0352e4cba7444d19acee80247be4aa63', 'request_id': 'req-1db2c4b2-c291-4b1b-8fe7-706ff69c80b5'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:44.687693 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-1db2c4b2-c291-4b1b-8fe7-706ff69c80b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0352e4cba7444d19acee80247be4aa63', 'request_id': 'req-1db2c4b2-c291-4b1b-8fe7-706ff69c80b5'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:44.703437 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-1db2c4b2-c291-4b1b-8fe7-706ff69c80b5 admin admin] The token cache is being invalidate because project 0352e4cba7444d19acee80247be4aa63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:41:44.703736 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-1db2c4b2-c291-4b1b-8fe7-706ff69c80b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:44.704465 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-1db2c4b2-c291-4b1b-8fe7-706ff69c80b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:44.707102 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 932/1860] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Aug 2 21:41:44 2022] DELETE /identity/v3/projects/0352e4cba7444d19acee80247be4aa63 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:41:44.711886 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535897e8-8bd2-4684-94c0-9f8f553954dd None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:44.712184 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535897e8-8bd2-4684-94c0-9f8f553954dd None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:44.712504 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535897e8-8bd2-4684-94c0-9f8f553954dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:44.734794 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-535897e8-8bd2-4684-94c0-9f8f553954dd None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:41:44.736596 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-535897e8-8bd2-4684-94c0-9f8f553954dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:44.763573 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568b719b-5d25-4ee6-9f40-01ff6a362ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:44.764372 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568b719b-5d25-4ee6-9f40-01ff6a362ce7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:44.764765 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568b719b-5d25-4ee6-9f40-01ff6a362ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:44.765143 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568b719b-5d25-4ee6-9f40-01ff6a362ce7 admin admin] PATH_INFO: `/v3/users/7549d06283a3467d816b621c7753ac9d` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:44.767896 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568b719b-5d25-4ee6-9f40-01ff6a362ce7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7549d06283a3467d816b621c7753ac9d)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:44.773945 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568b719b-5d25-4ee6-9f40-01ff6a362ce7 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:44.831542 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 933/1861] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:41:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:41:44.838149 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535897e8-8bd2-4684-94c0-9f8f553954dd None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:44.838149 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-535897e8-8bd2-4684-94c0-9f8f553954dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:44.861861 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535897e8-8bd2-4684-94c0-9f8f553954dd None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:44.874395 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-568b719b-5d25-4ee6-9f40-01ff6a362ce7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7549d06283a3467d816b621c7753ac9d'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:44.884499 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042725c3-06d9-4d0c-ade2-6741582b9d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:44.885492 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042725c3-06d9-4d0c-ade2-6741582b9d91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:44.886065 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042725c3-06d9-4d0c-ade2-6741582b9d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:44.886431 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042725c3-06d9-4d0c-ade2-6741582b9d91 admin admin] PATH_INFO: `/v3/projects/67c9b194ceba49399144070a64f3199a` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:44.888133 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042725c3-06d9-4d0c-ade2-6741582b9d91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=67c9b194ceba49399144070a64f3199a)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:44.889308 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-568b719b-5d25-4ee6-9f40-01ff6a362ce7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7549d06283a3467d816b621c7753ac9d'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:44.891292 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042725c3-06d9-4d0c-ade2-6741582b9d91 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:44.907457 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-568b719b-5d25-4ee6-9f40-01ff6a362ce7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7549d06283a3467d816b621c7753ac9d'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:44.908739 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-568b719b-5d25-4ee6-9f40-01ff6a362ce7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7549d06283a3467d816b621c7753ac9d'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:44.918345 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-568b719b-5d25-4ee6-9f40-01ff6a362ce7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7549d06283a3467d816b621c7753ac9d'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:44.920604 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:44.928431 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 929/1862] 10.222.0.70 () {58 vars in 1224 bytes} [Tue Aug 2 21:41:44 2022] DELETE /identity/v3/users/7549d06283a3467d816b621c7753ac9d => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:41:44.931728 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80512597-3f35-4388-9a76-a85813bc8f61 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:44.932831 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80512597-3f35-4388-9a76-a85813bc8f61 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:44.933617 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80512597-3f35-4388-9a76-a85813bc8f61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:44.965900 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-80512597-3f35-4388-9a76-a85813bc8f61 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:41:44.967608 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-80512597-3f35-4388-9a76-a85813bc8f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:44.969587 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-042725c3-06d9-4d0c-ade2-6741582b9d91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67c9b194ceba49399144070a64f3199a', 'request_id': 'req-042725c3-06d9-4d0c-ade2-6741582b9d91'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:44.978366 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-042725c3-06d9-4d0c-ade2-6741582b9d91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67c9b194ceba49399144070a64f3199a', 'request_id': 'req-042725c3-06d9-4d0c-ade2-6741582b9d91'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:44.991798 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-042725c3-06d9-4d0c-ade2-6741582b9d91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67c9b194ceba49399144070a64f3199a', 'request_id': 'req-042725c3-06d9-4d0c-ade2-6741582b9d91'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:45.011294 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-042725c3-06d9-4d0c-ade2-6741582b9d91 admin admin] The token cache is being invalidate because project 67c9b194ceba49399144070a64f3199a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:41:45.012531 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-042725c3-06d9-4d0c-ade2-6741582b9d91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:45.013623 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-042725c3-06d9-4d0c-ade2-6741582b9d91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:45.019690 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 934/1863] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Aug 2 21:41:44 2022] DELETE /identity/v3/projects/67c9b194ceba49399144070a64f3199a => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:41:45.019690 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a656a7c6-6ca4-46f6-b6a9-379e5974a8f5 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:45.020506 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a656a7c6-6ca4-46f6-b6a9-379e5974a8f5 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:45.020810 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a656a7c6-6ca4-46f6-b6a9-379e5974a8f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:45.051826 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-a656a7c6-6ca4-46f6-b6a9-379e5974a8f5 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:41:45.052981 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 930/1864] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:41:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:41:45.053768 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-a656a7c6-6ca4-46f6-b6a9-379e5974a8f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:45.053878 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80512597-3f35-4388-9a76-a85813bc8f61 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:45.056017 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-80512597-3f35-4388-9a76-a85813bc8f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:45.065208 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 935/1865] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:41:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:41:45.066435 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a656a7c6-6ca4-46f6-b6a9-379e5974a8f5 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:45.073600 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80512597-3f35-4388-9a76-a85813bc8f61 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:45.079629 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82a63b8-bb6c-4f07-88ba-b0cb8002c34a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:45.081073 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82a63b8-bb6c-4f07-88ba-b0cb8002c34a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:45.081356 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82a63b8-bb6c-4f07-88ba-b0cb8002c34a admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:45.081629 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82a63b8-bb6c-4f07-88ba-b0cb8002c34a admin admin] PATH_INFO: `/v3/users/3e51d2cce1fe4a91b3b3cb1eb0c5d818` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:45.082888 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82a63b8-bb6c-4f07-88ba-b0cb8002c34a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e51d2cce1fe4a91b3b3cb1eb0c5d818)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:45.084871 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a656a7c6-6ca4-46f6-b6a9-379e5974a8f5 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:45.085366 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82a63b8-bb6c-4f07-88ba-b0cb8002c34a admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:45.094374 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84fa2a4-e231-4133-b6c8-b6abb98b1428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:45.096519 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84fa2a4-e231-4133-b6c8-b6abb98b1428 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:45.097048 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84fa2a4-e231-4133-b6c8-b6abb98b1428 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:45.097530 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84fa2a4-e231-4133-b6c8-b6abb98b1428 admin admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:45.098643 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84fa2a4-e231-4133-b6c8-b6abb98b1428 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:41:45.099225 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84fa2a4-e231-4133-b6c8-b6abb98b1428 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:45.103475 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84fa2a4-e231-4133-b6c8-b6abb98b1428 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:45.125784 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 936/1866] 10.222.0.70 () {58 vars in 1153 bytes} [Tue Aug 2 21:41:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:41:45.127390 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84fa2a4-e231-4133-b6c8-b6abb98b1428 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:45.132483 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-a84fa2a4-e231-4133-b6c8-b6abb98b1428 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:45.160373 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-d82a63b8-bb6c-4f07-88ba-b0cb8002c34a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e51d2cce1fe4a91b3b3cb1eb0c5d818'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:45.165729 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:45.175183 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-d82a63b8-bb6c-4f07-88ba-b0cb8002c34a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e51d2cce1fe4a91b3b3cb1eb0c5d818'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:45.218964 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-d82a63b8-bb6c-4f07-88ba-b0cb8002c34a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e51d2cce1fe4a91b3b3cb1eb0c5d818'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:45.219976 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-d82a63b8-bb6c-4f07-88ba-b0cb8002c34a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e51d2cce1fe4a91b3b3cb1eb0c5d818'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:45.226542 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84fa2a4-e231-4133-b6c8-b6abb98b1428 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:45.229019 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-d82a63b8-bb6c-4f07-88ba-b0cb8002c34a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e51d2cce1fe4a91b3b3cb1eb0c5d818'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:45.244332 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3c7180-a691-45c6-9636-90f74a632cbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '723f5f43572a493dae0349070a2adb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:45.244332 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3c7180-a691-45c6-9636-90f74a632cbb service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:45.244332 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3c7180-a691-45c6-9636-90f74a632cbb service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:45.244332 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3c7180-a691-45c6-9636-90f74a632cbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:45.244790 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-3c3c7180-a691-45c6-9636-90f74a632cbb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:45.244875 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 931/1867] 10.222.0.70 () {58 vars in 1224 bytes} [Tue Aug 2 21:41:45 2022] DELETE /identity/v3/users/3e51d2cce1fe4a91b3b3cb1eb0c5d818 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:41:45.244875 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82a63b8-bb6c-4f07-88ba-b0cb8002c34a admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:45.245527 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-d82a63b8-bb6c-4f07-88ba-b0cb8002c34a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:45.262161 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3c7180-a691-45c6-9636-90f74a632cbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:45.264002 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3c7180-a691-45c6-9636-90f74a632cbb service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:45.276421 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 937/1868] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:41:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:41:45.336914 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82a63b8-bb6c-4f07-88ba-b0cb8002c34a admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:45.346770 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad8606e-cba3-4f74-9246-0dc9112933c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:45.348044 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad8606e-cba3-4f74-9246-0dc9112933c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:45.348673 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad8606e-cba3-4f74-9246-0dc9112933c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:45.349256 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad8606e-cba3-4f74-9246-0dc9112933c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:45.350657 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad8606e-cba3-4f74-9246-0dc9112933c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:45.355138 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad8606e-cba3-4f74-9246-0dc9112933c9 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:45.385348 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:45.417270 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 932/1869] 10.222.0.70 () {60 vars in 1153 bytes} [Tue Aug 2 21:41:45 2022] POST /identity/v3/projects => generated 399 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:41:45.424803 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3c7180-a691-45c6-9636-90f74a632cbb service neutron] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:45.450831 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3c7180-a691-45c6-9636-90f74a632cbb service neutron] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:45.563215 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b75521-e2ce-4305-80fa-3d72b5162d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:45.564048 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b75521-e2ce-4305-80fa-3d72b5162d4d admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:45.564988 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b75521-e2ce-4305-80fa-3d72b5162d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:45.565369 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b75521-e2ce-4305-80fa-3d72b5162d4d admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:45.566148 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b75521-e2ce-4305-80fa-3d72b5162d4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:45.568545 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b75521-e2ce-4305-80fa-3d72b5162d4d admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:45.596785 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 938/1870] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 2 21:41:45 2022] POST /identity/v3/users => generated 300 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:41:45.600863 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad8606e-cba3-4f74-9246-0dc9112933c9 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:45.613640 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad8606e-cba3-4f74-9246-0dc9112933c9 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:45.618815 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529c7512-664d-48da-83ce-0f397f8a946e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:45.619830 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529c7512-664d-48da-83ce-0f397f8a946e admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:45.620303 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529c7512-664d-48da-83ce-0f397f8a946e admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:45.620591 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529c7512-664d-48da-83ce-0f397f8a946e admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:45.621584 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529c7512-664d-48da-83ce-0f397f8a946e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:45.622922 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529c7512-664d-48da-83ce-0f397f8a946e admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:45.690561 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b75521-e2ce-4305-80fa-3d72b5162d4d admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:45.693126 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 933/1871] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:41:45 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 21:41:45.708973 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b75521-e2ce-4305-80fa-3d72b5162d4d admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:45.714987 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac9335d-6012-4aa9-8016-0170b6233aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:45.716168 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac9335d-6012-4aa9-8016-0170b6233aac admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:45.716511 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac9335d-6012-4aa9-8016-0170b6233aac admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:45.716792 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac9335d-6012-4aa9-8016-0170b6233aac admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:45.717506 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac9335d-6012-4aa9-8016-0170b6233aac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:45.719791 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac9335d-6012-4aa9-8016-0170b6233aac admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:45.738509 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 939/1872] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:41:45 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:41:45.739831 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529c7512-664d-48da-83ce-0f397f8a946e admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:45.758913 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529c7512-664d-48da-83ce-0f397f8a946e admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:45.769731 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1337c19-7003-43dd-be23-e6795bbc9da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:45.770689 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1337c19-7003-43dd-be23-e6795bbc9da1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:45.770986 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1337c19-7003-43dd-be23-e6795bbc9da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:45.771335 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1337c19-7003-43dd-be23-e6795bbc9da1 admin admin] PATH_INFO: `/v3/projects/3a277aa7d5f04ccab8f1fef6273768cc/users/dc4019b3f0f5492f90728825f318c597/roles/462e3381a85c42a9959201f9aa122f7c` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:45.800591 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1337c19-7003-43dd-be23-e6795bbc9da1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a277aa7d5f04ccab8f1fef6273768cc, user_id=dc4019b3f0f5492f90728825f318c597, role_id=462e3381a85c42a9959201f9aa122f7c)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:45.805390 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1337c19-7003-43dd-be23-e6795bbc9da1 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:45.836390 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 934/1873] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:41:45 2022] PUT /identity/v3/projects/3a277aa7d5f04ccab8f1fef6273768cc/users/dc4019b3f0f5492f90728825f318c597/roles/462e3381a85c42a9959201f9aa122f7c => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:41:45.850145 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b836b1-2bb8-474f-a430-c83a52d98ad8 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:45.850449 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b836b1-2bb8-474f-a430-c83a52d98ad8 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:45.854981 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b836b1-2bb8-474f-a430-c83a52d98ad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:45.896689 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-c9b836b1-2bb8-474f-a430-c83a52d98ad8 None None] MFA Rules not processed for user `dc4019b3f0f5492f90728825f318c597`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:41:45.899233 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-c9b836b1-2bb8-474f-a430-c83a52d98ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:46.024724 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1337c19-7003-43dd-be23-e6795bbc9da1 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:46.030300 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 940/1874] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:41:45 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:41:46.141158 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b836b1-2bb8-474f-a430-c83a52d98ad8 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:46.143476 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-c9b836b1-2bb8-474f-a430-c83a52d98ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:46.189557 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1337c19-7003-43dd-be23-e6795bbc9da1 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:46.199735 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:46.202589 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1cd8bb-fd7e-4e2e-aad4-fea349ec0d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:46.204329 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1cd8bb-fd7e-4e2e-aad4-fea349ec0d54 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:46.204329 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1cd8bb-fd7e-4e2e-aad4-fea349ec0d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:46.204329 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1cd8bb-fd7e-4e2e-aad4-fea349ec0d54 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:46.204569 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1cd8bb-fd7e-4e2e-aad4-fea349ec0d54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:46.209824 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1cd8bb-fd7e-4e2e-aad4-fea349ec0d54 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:46.273574 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 935/1875] 10.222.0.70 () {60 vars in 1153 bytes} [Tue Aug 2 21:41:46 2022] POST /identity/v3/projects => generated 401 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:41:46.274393 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1cd8bb-fd7e-4e2e-aad4-fea349ec0d54 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:46.298024 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b836b1-2bb8-474f-a430-c83a52d98ad8 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:46.372167 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1cd8bb-fd7e-4e2e-aad4-fea349ec0d54 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:46.381723 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef96a323-caa7-492a-9060-b1b7fbd80a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:46.382382 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef96a323-caa7-492a-9060-b1b7fbd80a20 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:46.382668 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef96a323-caa7-492a-9060-b1b7fbd80a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:46.384309 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef96a323-caa7-492a-9060-b1b7fbd80a20 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:46.384966 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef96a323-caa7-492a-9060-b1b7fbd80a20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:46.387098 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef96a323-caa7-492a-9060-b1b7fbd80a20 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:46.416612 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e837d1c3-0d04-4c6c-996f-034b714f87ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:46.418114 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e837d1c3-0d04-4c6c-996f-034b714f87ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:46.418114 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e837d1c3-0d04-4c6c-996f-034b714f87ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:46.418114 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e837d1c3-0d04-4c6c-996f-034b714f87ed admin admin] PATH_INFO: `/v3/projects/00f3c3f1c74544b3a01debf728b69f6e` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:46.421899 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e837d1c3-0d04-4c6c-996f-034b714f87ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=00f3c3f1c74544b3a01debf728b69f6e)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:46.421899 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e837d1c3-0d04-4c6c-996f-034b714f87ed admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:46.449255 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 936/1876] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 2 21:41:46 2022] POST /identity/v3/users => generated 307 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:41:46.450175 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef96a323-caa7-492a-9060-b1b7fbd80a20 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:46.454423 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-ef96a323-caa7-492a-9060-b1b7fbd80a20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:46.470150 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef96a323-caa7-492a-9060-b1b7fbd80a20 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:46.485329 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-e837d1c3-0d04-4c6c-996f-034b714f87ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00f3c3f1c74544b3a01debf728b69f6e', 'request_id': 'req-e837d1c3-0d04-4c6c-996f-034b714f87ed'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:46.492534 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-e837d1c3-0d04-4c6c-996f-034b714f87ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00f3c3f1c74544b3a01debf728b69f6e', 'request_id': 'req-e837d1c3-0d04-4c6c-996f-034b714f87ed'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:46.516601 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:46.519272 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-e837d1c3-0d04-4c6c-996f-034b714f87ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00f3c3f1c74544b3a01debf728b69f6e', 'request_id': 'req-e837d1c3-0d04-4c6c-996f-034b714f87ed'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:46.531756 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-e837d1c3-0d04-4c6c-996f-034b714f87ed admin admin] The token cache is being invalidate because project 00f3c3f1c74544b3a01debf728b69f6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:41:46.532051 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-e837d1c3-0d04-4c6c-996f-034b714f87ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:46.533023 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-e837d1c3-0d04-4c6c-996f-034b714f87ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:46.534743 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 941/1877] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Aug 2 21:41:46 2022] DELETE /identity/v3/projects/00f3c3f1c74544b3a01debf728b69f6e => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:41:46.542957 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e837d1c3-0d04-4c6c-996f-034b714f87ed admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:46.544396 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-e837d1c3-0d04-4c6c-996f-034b714f87ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:46.547105 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2803c6-e569-4470-af33-4afd11cb1286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:46.548069 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2803c6-e569-4470-af33-4afd11cb1286 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:46.548655 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2803c6-e569-4470-af33-4afd11cb1286 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:46.548964 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2803c6-e569-4470-af33-4afd11cb1286 admin admin] PATH_INFO: `/v3/projects/fc0b3b32b11a4cdc8283d92bbd062070` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:46.550241 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2803c6-e569-4470-af33-4afd11cb1286 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc0b3b32b11a4cdc8283d92bbd062070)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:46.552454 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2803c6-e569-4470-af33-4afd11cb1286 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:46.558560 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e837d1c3-0d04-4c6c-996f-034b714f87ed admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:46.565073 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c989ee28-5083-418b-99af-33261c43107e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:46.565704 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c989ee28-5083-418b-99af-33261c43107e admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:46.565991 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c989ee28-5083-418b-99af-33261c43107e admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:46.566268 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c989ee28-5083-418b-99af-33261c43107e admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:46.566969 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c989ee28-5083-418b-99af-33261c43107e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:46.568648 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c989ee28-5083-418b-99af-33261c43107e admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:46.579521 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 942/1878] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:41:46 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:41:46.584575 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f48164-91d4-4500-9749-be5ceca75688 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:46.585281 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f48164-91d4-4500-9749-be5ceca75688 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:46.585281 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f48164-91d4-4500-9749-be5ceca75688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:46.610651 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-c0f48164-91d4-4500-9749-be5ceca75688 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:41:46.610830 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ac2803c6-e569-4470-af33-4afd11cb1286 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc0b3b32b11a4cdc8283d92bbd062070', 'request_id': 'req-ac2803c6-e569-4470-af33-4afd11cb1286'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:46.611894 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-c0f48164-91d4-4500-9749-be5ceca75688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:46.619822 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ac2803c6-e569-4470-af33-4afd11cb1286 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc0b3b32b11a4cdc8283d92bbd062070', 'request_id': 'req-ac2803c6-e569-4470-af33-4afd11cb1286'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:46.629427 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ac2803c6-e569-4470-af33-4afd11cb1286 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc0b3b32b11a4cdc8283d92bbd062070', 'request_id': 'req-ac2803c6-e569-4470-af33-4afd11cb1286'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:46.642845 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ac2803c6-e569-4470-af33-4afd11cb1286 admin admin] The token cache is being invalidate because project fc0b3b32b11a4cdc8283d92bbd062070 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:41:46.643149 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ac2803c6-e569-4470-af33-4afd11cb1286 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:46.643831 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ac2803c6-e569-4470-af33-4afd11cb1286 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:46.648887 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 937/1879] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Aug 2 21:41:46 2022] DELETE /identity/v3/projects/fc0b3b32b11a4cdc8283d92bbd062070 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:41:46.650048 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2803c6-e569-4470-af33-4afd11cb1286 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:46.651228 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-ac2803c6-e569-4470-af33-4afd11cb1286 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:46.669764 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:46.693294 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 943/1880] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:41:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:41:46.694777 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1050dbfb-cf7d-47e0-9293-b5a522231748 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:46.695068 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1050dbfb-cf7d-47e0-9293-b5a522231748 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:46.695346 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1050dbfb-cf7d-47e0-9293-b5a522231748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:46.722063 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-1050dbfb-cf7d-47e0-9293-b5a522231748 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:41:46.723294 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-1050dbfb-cf7d-47e0-9293-b5a522231748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:46.732858 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 944/1881] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:41:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:41:46.734677 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef18fda6-bd3e-499c-a64e-9926f2667699 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:46.734677 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef18fda6-bd3e-499c-a64e-9926f2667699 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:46.734973 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef18fda6-bd3e-499c-a64e-9926f2667699 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:46.756053 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2803c6-e569-4470-af33-4afd11cb1286 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:46.761665 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd39438f-e873-4381-bcbc-e382364c8f77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:46.762443 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd39438f-e873-4381-bcbc-e382364c8f77 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:46.762855 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd39438f-e873-4381-bcbc-e382364c8f77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:46.763208 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd39438f-e873-4381-bcbc-e382364c8f77 admin admin] PATH_INFO: `/v3/projects/bc1d78ba772340d4a2f7e262af816a51/users/b2066b09420f4fc8a7a148e02e4a1a28/roles/3e32dbf75f9b41f5adb9fe59851267bb` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:46.769721 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-ef18fda6-bd3e-499c-a64e-9926f2667699 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:41:46.770608 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-ef18fda6-bd3e-499c-a64e-9926f2667699 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:46.793896 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 945/1882] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:41:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:41:46.793896 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d857be5-0542-47c4-b0a6-8e65c6434bd1 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:46.793896 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d857be5-0542-47c4-b0a6-8e65c6434bd1 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:46.794892 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd39438f-e873-4381-bcbc-e382364c8f77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc1d78ba772340d4a2f7e262af816a51, user_id=b2066b09420f4fc8a7a148e02e4a1a28, role_id=3e32dbf75f9b41f5adb9fe59851267bb)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:46.794975 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d857be5-0542-47c4-b0a6-8e65c6434bd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:46.796999 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd39438f-e873-4381-bcbc-e382364c8f77 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:46.819403 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 938/1883] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:41:46 2022] PUT /identity/v3/projects/bc1d78ba772340d4a2f7e262af816a51/users/b2066b09420f4fc8a7a148e02e4a1a28/roles/3e32dbf75f9b41f5adb9fe59851267bb => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:41:46.820646 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd39438f-e873-4381-bcbc-e382364c8f77 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:46.832600 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-6d857be5-0542-47c4-b0a6-8e65c6434bd1 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:41:46.833827 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-6d857be5-0542-47c4-b0a6-8e65c6434bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:46.889865 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:46.907605 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 946/1884] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:41:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:41:46.910056 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd39438f-e873-4381-bcbc-e382364c8f77 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:46.913294 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d857be5-0542-47c4-b0a6-8e65c6434bd1 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:46.917485 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c7c397-062e-486c-a1a1-2dc907c2d5fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:46.918414 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c7c397-062e-486c-a1a1-2dc907c2d5fa admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:46.918781 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c7c397-062e-486c-a1a1-2dc907c2d5fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:46.919242 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c7c397-062e-486c-a1a1-2dc907c2d5fa admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:46.920174 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c7c397-062e-486c-a1a1-2dc907c2d5fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:41:46.920720 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c7c397-062e-486c-a1a1-2dc907c2d5fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:46.922748 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c7c397-062e-486c-a1a1-2dc907c2d5fa admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:46.925366 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d857be5-0542-47c4-b0a6-8e65c6434bd1 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:46.931064 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe1dfa8-4712-4d97-bb22-849eca149d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:46.931692 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe1dfa8-4712-4d97-bb22-849eca149d57 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:46.931982 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe1dfa8-4712-4d97-bb22-849eca149d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:46.932295 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe1dfa8-4712-4d97-bb22-849eca149d57 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:46.933716 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe1dfa8-4712-4d97-bb22-849eca149d57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:46.935427 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe1dfa8-4712-4d97-bb22-849eca149d57 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:46.947454 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 939/1885] 10.222.0.70 () {58 vars in 1153 bytes} [Tue Aug 2 21:41:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:41:46.947454 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c7c397-062e-486c-a1a1-2dc907c2d5fa admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:46.948600 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 947/1886] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:41:46 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:41:46.949893 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe1dfa8-4712-4d97-bb22-849eca149d57 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:46.961181 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe1dfa8-4712-4d97-bb22-849eca149d57 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:46.965273 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c7c397-062e-486c-a1a1-2dc907c2d5fa admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:46.966248 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceeda37-1593-4b10-9a52-6e6a150ecf59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:46.966875 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceeda37-1593-4b10-9a52-6e6a150ecf59 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:46.967161 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceeda37-1593-4b10-9a52-6e6a150ecf59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:46.967444 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceeda37-1593-4b10-9a52-6e6a150ecf59 admin admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:46.968115 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceeda37-1593-4b10-9a52-6e6a150ecf59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:46.970308 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceeda37-1593-4b10-9a52-6e6a150ecf59 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:46.975615 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2119f53d-ed81-4bb0-acc0-d5b307dccabe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:46.976689 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2119f53d-ed81-4bb0-acc0-d5b307dccabe admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:46.976689 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2119f53d-ed81-4bb0-acc0-d5b307dccabe admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:46.976876 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2119f53d-ed81-4bb0-acc0-d5b307dccabe admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:46.977615 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2119f53d-ed81-4bb0-acc0-d5b307dccabe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:41:46.977966 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2119f53d-ed81-4bb0-acc0-d5b307dccabe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:46.980407 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2119f53d-ed81-4bb0-acc0-d5b307dccabe admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:46.998717 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 940/1887] 10.222.0.70 () {58 vars in 1153 bytes} [Tue Aug 2 21:41:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:41:46.999623 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2119f53d-ed81-4bb0-acc0-d5b307dccabe admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:47.012314 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2119f53d-ed81-4bb0-acc0-d5b307dccabe admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:47.014653 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 948/1888] 10.222.0.70 () {60 vars in 1153 bytes} [Tue Aug 2 21:41:46 2022] POST /identity/v3/projects => generated 385 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:41:47.016294 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceeda37-1593-4b10-9a52-6e6a150ecf59 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:47.020644 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9134121-b43b-4431-a773-d2f98287b3c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:47.021548 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9134121-b43b-4431-a773-d2f98287b3c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:47.021934 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9134121-b43b-4431-a773-d2f98287b3c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:47.022375 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9134121-b43b-4431-a773-d2f98287b3c4 admin admin] PATH_INFO: `/v3/projects/bc1d78ba772340d4a2f7e262af816a51/users/b2066b09420f4fc8a7a148e02e4a1a28/roles/3e32dbf75f9b41f5adb9fe59851267bb` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:47.026049 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9134121-b43b-4431-a773-d2f98287b3c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc1d78ba772340d4a2f7e262af816a51, user_id=b2066b09420f4fc8a7a148e02e4a1a28, role_id=3e32dbf75f9b41f5adb9fe59851267bb)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:47.029087 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9134121-b43b-4431-a773-d2f98287b3c4 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:47.043222 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 941/1889] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:41:46 2022] PUT /identity/v3/projects/bc1d78ba772340d4a2f7e262af816a51/users/b2066b09420f4fc8a7a148e02e4a1a28/roles/3e32dbf75f9b41f5adb9fe59851267bb => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:41:47.044440 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9134121-b43b-4431-a773-d2f98287b3c4 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:47.091811 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceeda37-1593-4b10-9a52-6e6a150ecf59 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:47.134304 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9134121-b43b-4431-a773-d2f98287b3c4 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:47.140387 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a64e5c-52d2-42b0-ba99-55ddd4a512b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:47.141441 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a64e5c-52d2-42b0-ba99-55ddd4a512b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:47.141830 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a64e5c-52d2-42b0-ba99-55ddd4a512b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:47.142664 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a64e5c-52d2-42b0-ba99-55ddd4a512b9 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:47.143780 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a64e5c-52d2-42b0-ba99-55ddd4a512b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:47.146702 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a64e5c-52d2-42b0-ba99-55ddd4a512b9 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:47.150095 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:47.160445 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aab854-1304-4c9d-8d14-aa9219b5ebf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:47.162424 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aab854-1304-4c9d-8d14-aa9219b5ebf0 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:47.162936 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aab854-1304-4c9d-8d14-aa9219b5ebf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:47.163668 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aab854-1304-4c9d-8d14-aa9219b5ebf0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:47.164525 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98aab854-1304-4c9d-8d14-aa9219b5ebf0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:47.167280 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98aab854-1304-4c9d-8d14-aa9219b5ebf0 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:47.179039 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 942/1890] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 2 21:41:47 2022] POST /identity/v3/users => generated 293 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:41:47.180547 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d44652-8ec2-4a0f-a93f-d38ac2a7d0aa None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:47.180839 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d44652-8ec2-4a0f-a93f-d38ac2a7d0aa None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:47.182560 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d44652-8ec2-4a0f-a93f-d38ac2a7d0aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:47.226640 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-b8d44652-8ec2-4a0f-a93f-d38ac2a7d0aa None None] MFA Rules not processed for user `b2066b09420f4fc8a7a148e02e4a1a28`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:41:47.228324 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-b8d44652-8ec2-4a0f-a93f-d38ac2a7d0aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:47.238780 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 949/1891] 10.222.0.70 () {60 vars in 1153 bytes} [Tue Aug 2 21:41:47 2022] POST /identity/v3/projects => generated 373 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:41:47.243824 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aab854-1304-4c9d-8d14-aa9219b5ebf0 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:47.371837 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 943/1892] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:41:47 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:41:47.373520 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d44652-8ec2-4a0f-a93f-d38ac2a7d0aa None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:47.380900 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aab854-1304-4c9d-8d14-aa9219b5ebf0 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:47.388194 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94875cca-9010-4453-a24b-01719af4116c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:47.389239 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94875cca-9010-4453-a24b-01719af4116c admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:47.389679 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94875cca-9010-4453-a24b-01719af4116c admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:47.390144 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94875cca-9010-4453-a24b-01719af4116c admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:47.391077 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94875cca-9010-4453-a24b-01719af4116c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:47.393569 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94875cca-9010-4453-a24b-01719af4116c admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:47.397151 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d44652-8ec2-4a0f-a93f-d38ac2a7d0aa None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:47.402879 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d12656-692c-43d5-8531-e1a8da40edd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:47.403845 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d12656-692c-43d5-8531-e1a8da40edd1 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:47.404536 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d12656-692c-43d5-8531-e1a8da40edd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:47.405487 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d12656-692c-43d5-8531-e1a8da40edd1 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:47.406502 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d12656-692c-43d5-8531-e1a8da40edd1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:47.407665 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 950/1893] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:41:47 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:41:47.408857 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94875cca-9010-4453-a24b-01719af4116c admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:47.411169 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-94875cca-9010-4453-a24b-01719af4116c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:47.411306 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d12656-692c-43d5-8531-e1a8da40edd1 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:47.444963 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 944/1894] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 2 21:41:47 2022] POST /identity/v3/users => generated 287 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:41:47.446063 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d12656-692c-43d5-8531-e1a8da40edd1 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:47.459303 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d12656-692c-43d5-8531-e1a8da40edd1 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:47.465225 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971e579e-235c-47f3-a78e-6c02e017b02b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:47.466189 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971e579e-235c-47f3-a78e-6c02e017b02b admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:47.466478 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971e579e-235c-47f3-a78e-6c02e017b02b admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:47.466793 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971e579e-235c-47f3-a78e-6c02e017b02b admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:47.467522 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971e579e-235c-47f3-a78e-6c02e017b02b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:47.470011 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971e579e-235c-47f3-a78e-6c02e017b02b admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:47.486785 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 945/1895] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:41:47 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:41:47.488509 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971e579e-235c-47f3-a78e-6c02e017b02b admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:47.490621 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94875cca-9010-4453-a24b-01719af4116c admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:47.495045 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25e9b15-f54f-4c3d-ade4-811efb8be047 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '123eb76f95ee4e39905944da701c712d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:47.495815 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25e9b15-f54f-4c3d-ade4-811efb8be047 service cinder] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:47.496209 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25e9b15-f54f-4c3d-ade4-811efb8be047 service cinder] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:47.496404 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:47.496567 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25e9b15-f54f-4c3d-ade4-811efb8be047 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:47.506134 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971e579e-235c-47f3-a78e-6c02e017b02b admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:47.513377 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b6e438-70f5-4639-ba7c-cf47bb86297b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:47.514166 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b6e438-70f5-4639-ba7c-cf47bb86297b admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:47.514518 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b6e438-70f5-4639-ba7c-cf47bb86297b admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:47.514862 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b6e438-70f5-4639-ba7c-cf47bb86297b admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:47.515633 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b6e438-70f5-4639-ba7c-cf47bb86297b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:47.519372 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b6e438-70f5-4639-ba7c-cf47bb86297b admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:47.542046 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 946/1896] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:41:47 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:41:47.542919 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b6e438-70f5-4639-ba7c-cf47bb86297b admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:47.562267 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b6e438-70f5-4639-ba7c-cf47bb86297b admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:47.567853 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5dad4b-6404-433b-83cb-57e3fda5df18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:47.569091 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5dad4b-6404-433b-83cb-57e3fda5df18 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:47.569381 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5dad4b-6404-433b-83cb-57e3fda5df18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:47.569662 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5dad4b-6404-433b-83cb-57e3fda5df18 admin admin] PATH_INFO: `/v3/projects/952635bee0c24defabb834f1556535c4/users/34757acdd2e14796b0b471d2fc228c7d/roles/462e3381a85c42a9959201f9aa122f7c` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:47.590756 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5dad4b-6404-433b-83cb-57e3fda5df18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=952635bee0c24defabb834f1556535c4, user_id=34757acdd2e14796b0b471d2fc228c7d, role_id=462e3381a85c42a9959201f9aa122f7c)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:47.594527 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5dad4b-6404-433b-83cb-57e3fda5df18 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:47.623091 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 947/1897] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:41:47 2022] PUT /identity/v3/projects/952635bee0c24defabb834f1556535c4/users/34757acdd2e14796b0b471d2fc228c7d/roles/462e3381a85c42a9959201f9aa122f7c => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:41:47.628272 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25e9b15-f54f-4c3d-ade4-811efb8be047 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:47.629748 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25e9b15-f54f-4c3d-ade4-811efb8be047 service cinder] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:47.638799 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5dad4b-6404-433b-83cb-57e3fda5df18 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:47.640637 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 951/1898] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:41:47 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:41:47.642485 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041e5a02-68d9-4e82-aa75-05756cdd614e None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:47.642739 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041e5a02-68d9-4e82-aa75-05756cdd614e None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:47.643113 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041e5a02-68d9-4e82-aa75-05756cdd614e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:47.677137 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-041e5a02-68d9-4e82-aa75-05756cdd614e None None] MFA Rules not processed for user `34757acdd2e14796b0b471d2fc228c7d`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:41:47.679083 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-041e5a02-68d9-4e82-aa75-05756cdd614e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:47.695064 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:47.790748 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5dad4b-6404-433b-83cb-57e3fda5df18 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:47.802396 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 952/1899] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:41:47 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:41:47.803765 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041e5a02-68d9-4e82-aa75-05756cdd614e None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:47.806067 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55db4923-3ff6-499b-9524-9dbffa52d21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:47.808961 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55db4923-3ff6-499b-9524-9dbffa52d21b admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:47.809256 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55db4923-3ff6-499b-9524-9dbffa52d21b admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:47.809542 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55db4923-3ff6-499b-9524-9dbffa52d21b admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:47.810258 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55db4923-3ff6-499b-9524-9dbffa52d21b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:47.812589 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55db4923-3ff6-499b-9524-9dbffa52d21b admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:47.829561 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 948/1900] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:41:47 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:41:47.833570 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55db4923-3ff6-499b-9524-9dbffa52d21b admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:47.859887 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55db4923-3ff6-499b-9524-9dbffa52d21b admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:47.865440 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb5dcc4-cc6f-492f-9dd2-0ea54fb437d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:47.866054 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb5dcc4-cc6f-492f-9dd2-0ea54fb437d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:47.866338 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb5dcc4-cc6f-492f-9dd2-0ea54fb437d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:47.866616 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb5dcc4-cc6f-492f-9dd2-0ea54fb437d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:47.867280 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb5dcc4-cc6f-492f-9dd2-0ea54fb437d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:47.869271 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb5dcc4-cc6f-492f-9dd2-0ea54fb437d1 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:47.871794 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041e5a02-68d9-4e82-aa75-05756cdd614e None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:47.875397 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd0de34-d1b2-4e52-9d62-a0e8efd83d44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '123eb76f95ee4e39905944da701c712d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:47.876018 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd0de34-d1b2-4e52-9d62-a0e8efd83d44 service cinder] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:47.876400 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd0de34-d1b2-4e52-9d62-a0e8efd83d44 service cinder] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:47.876732 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd0de34-d1b2-4e52-9d62-a0e8efd83d44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:47.878493 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-1cd0de34-d1b2-4e52-9d62-a0e8efd83d44 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:47.900321 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 949/1901] 10.222.0.70 () {60 vars in 1153 bytes} [Tue Aug 2 21:41:47 2022] POST /identity/v3/projects => generated 385 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:41:47.900321 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb5dcc4-cc6f-492f-9dd2-0ea54fb437d1 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:47.942817 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd0de34-d1b2-4e52-9d62-a0e8efd83d44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:47.944276 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd0de34-d1b2-4e52-9d62-a0e8efd83d44 service cinder] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:47.953160 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 953/1902] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:41:47 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:41:47.953957 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd0de34-d1b2-4e52-9d62-a0e8efd83d44 service cinder] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:47.962018 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb5dcc4-cc6f-492f-9dd2-0ea54fb437d1 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:47.963994 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd0de34-d1b2-4e52-9d62-a0e8efd83d44 service cinder] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:47.967860 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2584f3-8dd9-4af5-8541-baefb78b3b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:47.968581 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2584f3-8dd9-4af5-8541-baefb78b3b84 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:47.968683 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6db32a-754b-4623-8344-53941389a415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:47.968859 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2584f3-8dd9-4af5-8541-baefb78b3b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:47.969237 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2584f3-8dd9-4af5-8541-baefb78b3b84 admin admin] PATH_INFO: `/v3/projects/cdf0c2f942254083a61dbd3936a2d4ed/users/e61888271eb24116b73d146dadd7dcb6/roles/462e3381a85c42a9959201f9aa122f7c` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:47.969394 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6db32a-754b-4623-8344-53941389a415 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:47.969650 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6db32a-754b-4623-8344-53941389a415 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:47.969933 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6db32a-754b-4623-8344-53941389a415 admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:47.971125 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6db32a-754b-4623-8344-53941389a415 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:47.973056 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6db32a-754b-4623-8344-53941389a415 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:47.991066 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2584f3-8dd9-4af5-8541-baefb78b3b84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdf0c2f942254083a61dbd3936a2d4ed, user_id=e61888271eb24116b73d146dadd7dcb6, role_id=462e3381a85c42a9959201f9aa122f7c)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:47.993953 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2584f3-8dd9-4af5-8541-baefb78b3b84 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:48.003385 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 954/1903] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 2 21:41:47 2022] POST /identity/v3/users => generated 299 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:41:48.007040 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6db32a-754b-4623-8344-53941389a415 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:48.018682 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 950/1904] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:41:47 2022] PUT /identity/v3/projects/cdf0c2f942254083a61dbd3936a2d4ed/users/e61888271eb24116b73d146dadd7dcb6/roles/462e3381a85c42a9959201f9aa122f7c => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:41:48.020901 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6db32a-754b-4623-8344-53941389a415 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:48.024185 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00417c04-7734-4d9e-ad12-f1421b8b0c7f None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:48.024511 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00417c04-7734-4d9e-ad12-f1421b8b0c7f None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:48.024838 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00417c04-7734-4d9e-ad12-f1421b8b0c7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:48.045506 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-00417c04-7734-4d9e-ad12-f1421b8b0c7f None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:41:48.046746 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-00417c04-7734-4d9e-ad12-f1421b8b0c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:48.068604 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:48.091127 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:48.113310 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae8c3d4-87fd-4fb9-b4bd-82cb6a954294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:48.113967 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae8c3d4-87fd-4fb9-b4bd-82cb6a954294 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:48.114302 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae8c3d4-87fd-4fb9-b4bd-82cb6a954294 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:48.114613 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae8c3d4-87fd-4fb9-b4bd-82cb6a954294 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:48.115393 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae8c3d4-87fd-4fb9-b4bd-82cb6a954294 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:48.117921 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae8c3d4-87fd-4fb9-b4bd-82cb6a954294 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:48.124087 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 951/1905] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:41:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:41:48.133353 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 955/1906] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:41:48 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:41:48.137785 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00417c04-7734-4d9e-ad12-f1421b8b0c7f None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:48.138091 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae8c3d4-87fd-4fb9-b4bd-82cb6a954294 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:48.139936 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-0ae8c3d4-87fd-4fb9-b4bd-82cb6a954294 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:48.156487 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00417c04-7734-4d9e-ad12-f1421b8b0c7f None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:48.163450 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366deefe-ad7a-4fcf-bb90-4b7a64730d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:48.164160 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366deefe-ad7a-4fcf-bb90-4b7a64730d19 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:48.164564 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366deefe-ad7a-4fcf-bb90-4b7a64730d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:48.165543 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366deefe-ad7a-4fcf-bb90-4b7a64730d19 admin admin] PATH_INFO: `/v3/projects/8f8b49d66e194eb0a383e4c06039fc31/users/0e5be80135e14b8b923a032906ad5c6f/roles/3e32dbf75f9b41f5adb9fe59851267bb` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:48.210235 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366deefe-ad7a-4fcf-bb90-4b7a64730d19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f8b49d66e194eb0a383e4c06039fc31, user_id=0e5be80135e14b8b923a032906ad5c6f, role_id=3e32dbf75f9b41f5adb9fe59851267bb)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:48.213733 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366deefe-ad7a-4fcf-bb90-4b7a64730d19 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:48.221889 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae8c3d4-87fd-4fb9-b4bd-82cb6a954294 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:48.226316 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d137226-df47-4305-b06d-964962c4f057 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '723f5f43572a493dae0349070a2adb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:48.226861 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d137226-df47-4305-b06d-964962c4f057 service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:48.227149 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d137226-df47-4305-b06d-964962c4f057 service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:48.227437 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d137226-df47-4305-b06d-964962c4f057 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:48.235289 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 952/1907] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:41:48 2022] PUT /identity/v3/projects/8f8b49d66e194eb0a383e4c06039fc31/users/0e5be80135e14b8b923a032906ad5c6f/roles/3e32dbf75f9b41f5adb9fe59851267bb => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:41:48.241716 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366deefe-ad7a-4fcf-bb90-4b7a64730d19 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:48.251938 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d137226-df47-4305-b06d-964962c4f057 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:48.253790 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d137226-df47-4305-b06d-964962c4f057 service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:48.269163 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 956/1908] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:41:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:41:48.379035 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366deefe-ad7a-4fcf-bb90-4b7a64730d19 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:48.387887 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3f660f-18ee-4977-bf35-1039117e903e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:48.388614 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3f660f-18ee-4977-bf35-1039117e903e admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:48.388946 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3f660f-18ee-4977-bf35-1039117e903e admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:48.390278 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3f660f-18ee-4977-bf35-1039117e903e admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:48.391049 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3f660f-18ee-4977-bf35-1039117e903e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:48.397040 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3f660f-18ee-4977-bf35-1039117e903e admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:48.421344 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 953/1909] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:41:48 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:41:48.426145 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d137226-df47-4305-b06d-964962c4f057 service neutron] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:48.438352 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d137226-df47-4305-b06d-964962c4f057 service neutron] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:48.444176 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaea4a8-7b0f-41ee-8fe6-021a37712e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:48.445031 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaea4a8-7b0f-41ee-8fe6-021a37712e61 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:48.445344 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaea4a8-7b0f-41ee-8fe6-021a37712e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:48.445508 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaea4a8-7b0f-41ee-8fe6-021a37712e61 admin admin] PATH_INFO: `/v3/projects/8f8b49d66e194eb0a383e4c06039fc31/users/0e5be80135e14b8b923a032906ad5c6f/roles/3e32dbf75f9b41f5adb9fe59851267bb` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:48.447854 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaea4a8-7b0f-41ee-8fe6-021a37712e61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f8b49d66e194eb0a383e4c06039fc31, user_id=0e5be80135e14b8b923a032906ad5c6f, role_id=3e32dbf75f9b41f5adb9fe59851267bb)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:48.450732 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaea4a8-7b0f-41ee-8fe6-021a37712e61 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:48.463785 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 957/1910] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:41:48 2022] PUT /identity/v3/projects/8f8b49d66e194eb0a383e4c06039fc31/users/0e5be80135e14b8b923a032906ad5c6f/roles/3e32dbf75f9b41f5adb9fe59851267bb => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:41:48.476292 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b380551c-e721-487b-b0cf-ff700f77de5e None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:48.476292 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b380551c-e721-487b-b0cf-ff700f77de5e None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:48.476600 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b380551c-e721-487b-b0cf-ff700f77de5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:48.550251 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-b380551c-e721-487b-b0cf-ff700f77de5e None None] MFA Rules not processed for user `0e5be80135e14b8b923a032906ad5c6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:41:48.554106 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-b380551c-e721-487b-b0cf-ff700f77de5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:48.657428 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 954/1911] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:41:48 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:41:48.667426 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaea4a8-7b0f-41ee-8fe6-021a37712e61 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:48.738649 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaea4a8-7b0f-41ee-8fe6-021a37712e61 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:48.742386 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe19f8f6-49a6-45ca-bced-071d66f2e6fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '123eb76f95ee4e39905944da701c712d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:48.743048 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe19f8f6-49a6-45ca-bced-071d66f2e6fc service cinder] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:48.743315 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe19f8f6-49a6-45ca-bced-071d66f2e6fc service cinder] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:48.743982 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe19f8f6-49a6-45ca-bced-071d66f2e6fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:48.863172 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe19f8f6-49a6-45ca-bced-071d66f2e6fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:48.865480 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe19f8f6-49a6-45ca-bced-071d66f2e6fc service cinder] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:48.882198 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 958/1912] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:41:48 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:41:48.963017 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83920d1-0c9f-4aa1-8710-afd96ed0acfc None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:48.963461 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83920d1-0c9f-4aa1-8710-afd96ed0acfc None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:48.963837 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83920d1-0c9f-4aa1-8710-afd96ed0acfc None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:48.965586 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 955/1913] 10.222.0.70 () {54 vars in 921 bytes} [Tue Aug 2 21:41:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:41:49.009037 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f56476c-7d32-4975-aa1a-4591e5936ec1 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:49.010730 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f56476c-7d32-4975-aa1a-4591e5936ec1 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:49.010730 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f56476c-7d32-4975-aa1a-4591e5936ec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:49.057358 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-4f56476c-7d32-4975-aa1a-4591e5936ec1 None None] MFA Rules not processed for user `87dd5c1c5e854d4b96e0b7dad6aa3719`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:41:49.058799 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-4f56476c-7d32-4975-aa1a-4591e5936ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:49.114085 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:49.211062 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 959/1914] 10.222.0.70 () {58 vars in 1018 bytes} [Tue Aug 2 21:41:49 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:41:49.252145 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83920d1-0c9f-4aa1-8710-afd96ed0acfc None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:49.254869 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-e83920d1-0c9f-4aa1-8710-afd96ed0acfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:49.306474 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83920d1-0c9f-4aa1-8710-afd96ed0acfc None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:49.318436 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69be28d2-06b9-49e8-a3d6-d05d7ed0b8b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87dd5c1c5e854d4b96e0b7dad6aa3719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:49.319397 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69be28d2-06b9-49e8-a3d6-d05d7ed0b8b8 service nova] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:49.319885 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69be28d2-06b9-49e8-a3d6-d05d7ed0b8b8 service nova] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:49.320171 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69be28d2-06b9-49e8-a3d6-d05d7ed0b8b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:49.343722 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69be28d2-06b9-49e8-a3d6-d05d7ed0b8b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:49.350452 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69be28d2-06b9-49e8-a3d6-d05d7ed0b8b8 service nova] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:49.364801 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 956/1915] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:41:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:41:49.434033 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee06565-648d-428f-9767-6378f2f43252 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:49.434324 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee06565-648d-428f-9767-6378f2f43252 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:49.434605 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee06565-648d-428f-9767-6378f2f43252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:49.526056 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-eee06565-648d-428f-9767-6378f2f43252 None None] MFA Rules not processed for user `e61888271eb24116b73d146dadd7dcb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:41:49.527305 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-eee06565-648d-428f-9767-6378f2f43252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:49.704351 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 960/1916] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:41:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:41:49.721438 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69be28d2-06b9-49e8-a3d6-d05d7ed0b8b8 service nova] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:49.723834 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-69be28d2-06b9-49e8-a3d6-d05d7ed0b8b8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:49.755964 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69be28d2-06b9-49e8-a3d6-d05d7ed0b8b8 service nova] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:49.761018 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ecae4a-2f77-4df7-a00d-ca04160a6af0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '123eb76f95ee4e39905944da701c712d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:49.761739 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ecae4a-2f77-4df7-a00d-ca04160a6af0 service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:49.762947 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ecae4a-2f77-4df7-a00d-ca04160a6af0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:49.763533 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ecae4a-2f77-4df7-a00d-ca04160a6af0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:49.810299 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:49.813847 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ecae4a-2f77-4df7-a00d-ca04160a6af0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:49.816978 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ecae4a-2f77-4df7-a00d-ca04160a6af0 service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:49.840525 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 957/1917] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:41:49 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:41:51.280975 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e571ff8-51a9-409e-97a1-7d4fa5908ed8 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:51.281425 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e571ff8-51a9-409e-97a1-7d4fa5908ed8 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:51.281554 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e571ff8-51a9-409e-97a1-7d4fa5908ed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:51.304903 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-2e571ff8-51a9-409e-97a1-7d4fa5908ed8 None None] MFA Rules not processed for user `e61888271eb24116b73d146dadd7dcb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:41:51.306152 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-2e571ff8-51a9-409e-97a1-7d4fa5908ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:51.313711 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 961/1918] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:41:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:41:52.599834 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ecae4a-2f77-4df7-a00d-ca04160a6af0 service cinder] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:52.753686 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ecae4a-2f77-4df7-a00d-ca04160a6af0 service cinder] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:52.777060 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d93252e-c24d-46ec-aed1-bae0c84d82fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:52.777748 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d93252e-c24d-46ec-aed1-bae0c84d82fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:52.778036 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d93252e-c24d-46ec-aed1-bae0c84d82fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:52.778318 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d93252e-c24d-46ec-aed1-bae0c84d82fb admin admin] PATH_INFO: `/v3/users/dc4019b3f0f5492f90728825f318c597` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:52.779627 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d93252e-c24d-46ec-aed1-bae0c84d82fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc4019b3f0f5492f90728825f318c597)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:52.781949 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d93252e-c24d-46ec-aed1-bae0c84d82fb admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:52.883187 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-3d93252e-c24d-46ec-aed1-bae0c84d82fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc4019b3f0f5492f90728825f318c597'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:52.906718 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-3d93252e-c24d-46ec-aed1-bae0c84d82fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc4019b3f0f5492f90728825f318c597'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:52.922908 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-3d93252e-c24d-46ec-aed1-bae0c84d82fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc4019b3f0f5492f90728825f318c597'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:52.924710 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-3d93252e-c24d-46ec-aed1-bae0c84d82fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc4019b3f0f5492f90728825f318c597'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:52.940410 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-3d93252e-c24d-46ec-aed1-bae0c84d82fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc4019b3f0f5492f90728825f318c597'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:52.955518 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 958/1919] 10.222.0.70 () {58 vars in 1224 bytes} [Tue Aug 2 21:41:52 2022] DELETE /identity/v3/users/dc4019b3f0f5492f90728825f318c597 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:41:52.960056 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80244825-1efa-433a-ab1d-99bc7e830f1d None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:52.960533 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80244825-1efa-433a-ab1d-99bc7e830f1d None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:52.960714 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80244825-1efa-433a-ab1d-99bc7e830f1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:52.993011 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-80244825-1efa-433a-ab1d-99bc7e830f1d None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:41:52.995899 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-80244825-1efa-433a-ab1d-99bc7e830f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:53.096653 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 962/1920] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:41:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:41:53.126959 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d93252e-c24d-46ec-aed1-bae0c84d82fb admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:53.128487 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-3d93252e-c24d-46ec-aed1-bae0c84d82fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:53.214109 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d93252e-c24d-46ec-aed1-bae0c84d82fb admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:53.224920 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29575f1f-6611-4131-8f3a-4549361ef94e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '723f5f43572a493dae0349070a2adb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:53.225838 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29575f1f-6611-4131-8f3a-4549361ef94e service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:53.226183 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29575f1f-6611-4131-8f3a-4549361ef94e service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:53.226472 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29575f1f-6611-4131-8f3a-4549361ef94e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:53.242202 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29575f1f-6611-4131-8f3a-4549361ef94e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:53.243800 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29575f1f-6611-4131-8f3a-4549361ef94e service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:53.263513 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 959/1921] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:41:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:41:53.625750 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80244825-1efa-433a-ab1d-99bc7e830f1d None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:53.627853 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-80244825-1efa-433a-ab1d-99bc7e830f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:53.642014 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80244825-1efa-433a-ab1d-99bc7e830f1d None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:53.649133 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ab23db-8af5-4dec-aba3-821663b26081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:53.650516 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ab23db-8af5-4dec-aba3-821663b26081 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:53.651083 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ab23db-8af5-4dec-aba3-821663b26081 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:53.651464 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ab23db-8af5-4dec-aba3-821663b26081 admin admin] PATH_INFO: `/v3/projects/3a277aa7d5f04ccab8f1fef6273768cc` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:53.652890 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ab23db-8af5-4dec-aba3-821663b26081 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a277aa7d5f04ccab8f1fef6273768cc)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:53.655260 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ab23db-8af5-4dec-aba3-821663b26081 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:53.702675 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:53.710294 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-98ab23db-8af5-4dec-aba3-821663b26081 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a277aa7d5f04ccab8f1fef6273768cc', 'request_id': 'req-98ab23db-8af5-4dec-aba3-821663b26081'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:53.716523 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-98ab23db-8af5-4dec-aba3-821663b26081 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a277aa7d5f04ccab8f1fef6273768cc', 'request_id': 'req-98ab23db-8af5-4dec-aba3-821663b26081'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:53.725290 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-98ab23db-8af5-4dec-aba3-821663b26081 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a277aa7d5f04ccab8f1fef6273768cc', 'request_id': 'req-98ab23db-8af5-4dec-aba3-821663b26081'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:53.737388 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-98ab23db-8af5-4dec-aba3-821663b26081 admin admin] The token cache is being invalidate because project 3a277aa7d5f04ccab8f1fef6273768cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:41:53.737743 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-98ab23db-8af5-4dec-aba3-821663b26081 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:53.738395 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-98ab23db-8af5-4dec-aba3-821663b26081 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:53.742941 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 963/1922] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Aug 2 21:41:53 2022] DELETE /identity/v3/projects/3a277aa7d5f04ccab8f1fef6273768cc => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:41:53.744058 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29575f1f-6611-4131-8f3a-4549361ef94e service neutron] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:53.754310 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29575f1f-6611-4131-8f3a-4549361ef94e service neutron] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:53.766355 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:53.812731 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3723b948-39fb-40bb-ae89-6c326ce0bc33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:53.813402 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3723b948-39fb-40bb-ae89-6c326ce0bc33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:53.813690 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3723b948-39fb-40bb-ae89-6c326ce0bc33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:53.814636 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3723b948-39fb-40bb-ae89-6c326ce0bc33 admin admin] PATH_INFO: `/v3/users/b2066b09420f4fc8a7a148e02e4a1a28` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:53.815799 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3723b948-39fb-40bb-ae89-6c326ce0bc33 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2066b09420f4fc8a7a148e02e4a1a28)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:53.817745 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3723b948-39fb-40bb-ae89-6c326ce0bc33 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:53.877435 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-3723b948-39fb-40bb-ae89-6c326ce0bc33 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2066b09420f4fc8a7a148e02e4a1a28'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:53.887495 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-3723b948-39fb-40bb-ae89-6c326ce0bc33 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2066b09420f4fc8a7a148e02e4a1a28'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:53.907124 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-3723b948-39fb-40bb-ae89-6c326ce0bc33 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2066b09420f4fc8a7a148e02e4a1a28'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:53.909659 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-3723b948-39fb-40bb-ae89-6c326ce0bc33 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2066b09420f4fc8a7a148e02e4a1a28'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:53.929528 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-3723b948-39fb-40bb-ae89-6c326ce0bc33 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2066b09420f4fc8a7a148e02e4a1a28'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:53.938910 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 960/1923] 10.222.0.70 () {58 vars in 1224 bytes} [Tue Aug 2 21:41:53 2022] DELETE /identity/v3/users/b2066b09420f4fc8a7a148e02e4a1a28 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:41:54.123719 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ab23db-8af5-4dec-aba3-821663b26081 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:54.126276 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-98ab23db-8af5-4dec-aba3-821663b26081 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:54.228376 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ab23db-8af5-4dec-aba3-821663b26081 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:54.266848 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3723b948-39fb-40bb-ae89-6c326ce0bc33 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:54.269577 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-3723b948-39fb-40bb-ae89-6c326ce0bc33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:54.346597 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdd1a16-520d-4af6-a2ae-f7ed48f60e90 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '123eb76f95ee4e39905944da701c712d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:54.347801 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdd1a16-520d-4af6-a2ae-f7ed48f60e90 service cinder] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:54.348293 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdd1a16-520d-4af6-a2ae-f7ed48f60e90 service cinder] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:54.348739 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdd1a16-520d-4af6-a2ae-f7ed48f60e90 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:54.350932 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-6cdd1a16-520d-4af6-a2ae-f7ed48f60e90 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:54.405407 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3723b948-39fb-40bb-ae89-6c326ce0bc33 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:54.412016 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ade5bb-b012-42a3-9e10-e4859fc33d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:54.412779 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ade5bb-b012-42a3-9e10-e4859fc33d22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:54.413064 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ade5bb-b012-42a3-9e10-e4859fc33d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:54.413342 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ade5bb-b012-42a3-9e10-e4859fc33d22 admin admin] PATH_INFO: `/v3/projects/bc1d78ba772340d4a2f7e262af816a51` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:54.414668 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ade5bb-b012-42a3-9e10-e4859fc33d22 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc1d78ba772340d4a2f7e262af816a51)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:54.416642 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ade5bb-b012-42a3-9e10-e4859fc33d22 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:54.440108 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdd1a16-520d-4af6-a2ae-f7ed48f60e90 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:54.441851 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdd1a16-520d-4af6-a2ae-f7ed48f60e90 service cinder] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:54.459624 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 964/1924] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:41:54 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:41:54.487771 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:54.530936 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-70ade5bb-b012-42a3-9e10-e4859fc33d22 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc1d78ba772340d4a2f7e262af816a51', 'request_id': 'req-70ade5bb-b012-42a3-9e10-e4859fc33d22'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:54.541857 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-70ade5bb-b012-42a3-9e10-e4859fc33d22 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc1d78ba772340d4a2f7e262af816a51', 'request_id': 'req-70ade5bb-b012-42a3-9e10-e4859fc33d22'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:54.551623 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-70ade5bb-b012-42a3-9e10-e4859fc33d22 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc1d78ba772340d4a2f7e262af816a51', 'request_id': 'req-70ade5bb-b012-42a3-9e10-e4859fc33d22'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:54.570910 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-70ade5bb-b012-42a3-9e10-e4859fc33d22 admin admin] The token cache is being invalidate because project bc1d78ba772340d4a2f7e262af816a51 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:41:54.571210 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-70ade5bb-b012-42a3-9e10-e4859fc33d22 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:54.572327 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-70ade5bb-b012-42a3-9e10-e4859fc33d22 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:41:54.576646 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 961/1925] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Aug 2 21:41:54 2022] DELETE /identity/v3/projects/bc1d78ba772340d4a2f7e262af816a51 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:41:54.582989 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6746f21c-7519-4f39-afba-680d4ccd7d64 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:54.583282 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6746f21c-7519-4f39-afba-680d4ccd7d64 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:54.583566 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6746f21c-7519-4f39-afba-680d4ccd7d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:54.616054 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-6746f21c-7519-4f39-afba-680d4ccd7d64 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:41:54.618017 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-6746f21c-7519-4f39-afba-680d4ccd7d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:54.659068 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:54.704418 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 965/1926] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:41:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:41:54.710892 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c46f27-1b20-4a78-bb42-0f32bd37a4cb None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:54.711877 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c46f27-1b20-4a78-bb42-0f32bd37a4cb None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:54.712162 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c46f27-1b20-4a78-bb42-0f32bd37a4cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:54.739354 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-63c46f27-1b20-4a78-bb42-0f32bd37a4cb None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:41:54.740922 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-63c46f27-1b20-4a78-bb42-0f32bd37a4cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:54.752383 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 962/1927] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:41:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:41:54.754829 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6746f21c-7519-4f39-afba-680d4ccd7d64 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:54.770115 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6746f21c-7519-4f39-afba-680d4ccd7d64 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:54.788651 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcec151-fdf4-49e0-8836-75c1c8a35ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:54.788651 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcec151-fdf4-49e0-8836-75c1c8a35ef4 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:54.788651 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcec151-fdf4-49e0-8836-75c1c8a35ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:54.788651 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcec151-fdf4-49e0-8836-75c1c8a35ef4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:54.789017 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcec151-fdf4-49e0-8836-75c1c8a35ef4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:41:54.789017 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcec151-fdf4-49e0-8836-75c1c8a35ef4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:54.789017 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcec151-fdf4-49e0-8836-75c1c8a35ef4 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:54.823641 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c46f27-1b20-4a78-bb42-0f32bd37a4cb None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:54.835692 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 966/1928] 10.222.0.70 () {58 vars in 1153 bytes} [Tue Aug 2 21:41:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:41:54.837009 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c46f27-1b20-4a78-bb42-0f32bd37a4cb None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:54.843039 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71568d0-1427-483d-80a6-c815d3c34af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:54.843673 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71568d0-1427-483d-80a6-c815d3c34af3 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:54.843942 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71568d0-1427-483d-80a6-c815d3c34af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:54.844452 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71568d0-1427-483d-80a6-c815d3c34af3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:54.845297 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71568d0-1427-483d-80a6-c815d3c34af3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:54.847830 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71568d0-1427-483d-80a6-c815d3c34af3 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:54.896543 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 963/1929] 10.222.0.70 () {60 vars in 1153 bytes} [Tue Aug 2 21:41:54 2022] POST /identity/v3/projects => generated 373 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:41:54.902823 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcec151-fdf4-49e0-8836-75c1c8a35ef4 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:54.920466 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcec151-fdf4-49e0-8836-75c1c8a35ef4 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:55.045389 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd759c5f-4951-48b8-b340-b7ae894c0468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:55.046432 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd759c5f-4951-48b8-b340-b7ae894c0468 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:55.046952 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd759c5f-4951-48b8-b340-b7ae894c0468 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:55.047408 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd759c5f-4951-48b8-b340-b7ae894c0468 admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:55.061245 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd759c5f-4951-48b8-b340-b7ae894c0468 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:55.066359 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd759c5f-4951-48b8-b340-b7ae894c0468 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:55.121589 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71568d0-1427-483d-80a6-c815d3c34af3 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:55.124383 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 967/1930] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 2 21:41:54 2022] POST /identity/v3/users => generated 287 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:41:55.135119 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71568d0-1427-483d-80a6-c815d3c34af3 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:55.141528 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39978c3c-c1bb-47b8-852f-b5381f572c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:55.142418 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39978c3c-c1bb-47b8-852f-b5381f572c9e admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:55.142770 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39978c3c-c1bb-47b8-852f-b5381f572c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:55.143122 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39978c3c-c1bb-47b8-852f-b5381f572c9e admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:55.143984 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39978c3c-c1bb-47b8-852f-b5381f572c9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:55.145888 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39978c3c-c1bb-47b8-852f-b5381f572c9e admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:55.158507 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 964/1931] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:41:55 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:41:55.164557 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd759c5f-4951-48b8-b340-b7ae894c0468 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:55.181957 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd759c5f-4951-48b8-b340-b7ae894c0468 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:55.187111 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47ed316-3141-413b-b36d-b8e94664245a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:55.187753 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47ed316-3141-413b-b36d-b8e94664245a admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:55.188069 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47ed316-3141-413b-b36d-b8e94664245a admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:55.188411 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47ed316-3141-413b-b36d-b8e94664245a admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:55.189838 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47ed316-3141-413b-b36d-b8e94664245a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:55.191555 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47ed316-3141-413b-b36d-b8e94664245a admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:55.206908 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 968/1932] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:41:55 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:41:55.208547 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39978c3c-c1bb-47b8-852f-b5381f572c9e admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:55.218565 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39978c3c-c1bb-47b8-852f-b5381f572c9e admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:55.223102 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da60e5b2-0a4c-447c-acf2-bf642d25db64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:55.223769 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da60e5b2-0a4c-447c-acf2-bf642d25db64 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:55.224057 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da60e5b2-0a4c-447c-acf2-bf642d25db64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:55.224371 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da60e5b2-0a4c-447c-acf2-bf642d25db64 admin admin] PATH_INFO: `/v3/projects/2394cf667efb40b7815dc6c92d71ecb4/users/7e7d7fafb7484d30b01830b03c36936c/roles/462e3381a85c42a9959201f9aa122f7c` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:55.240033 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da60e5b2-0a4c-447c-acf2-bf642d25db64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2394cf667efb40b7815dc6c92d71ecb4, user_id=7e7d7fafb7484d30b01830b03c36936c, role_id=462e3381a85c42a9959201f9aa122f7c)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:55.242786 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da60e5b2-0a4c-447c-acf2-bf642d25db64 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:55.259869 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 965/1933] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:41:55 2022] PUT /identity/v3/projects/2394cf667efb40b7815dc6c92d71ecb4/users/7e7d7fafb7484d30b01830b03c36936c/roles/462e3381a85c42a9959201f9aa122f7c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:41:55.261606 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553befa5-fe45-4ce1-8630-03b642f09fa5 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:55.261906 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553befa5-fe45-4ce1-8630-03b642f09fa5 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:55.262187 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553befa5-fe45-4ce1-8630-03b642f09fa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:55.280841 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-553befa5-fe45-4ce1-8630-03b642f09fa5 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:41:55.284634 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-553befa5-fe45-4ce1-8630-03b642f09fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:55.370354 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 969/1934] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:41:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:41:55.388752 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da60e5b2-0a4c-447c-acf2-bf642d25db64 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:55.391240 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-da60e5b2-0a4c-447c-acf2-bf642d25db64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:55.489506 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da60e5b2-0a4c-447c-acf2-bf642d25db64 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:55.493791 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff940266-ce2d-4a64-9206-cee87cd1dc9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '723f5f43572a493dae0349070a2adb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:55.494479 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff940266-ce2d-4a64-9206-cee87cd1dc9f service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:55.494766 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff940266-ce2d-4a64-9206-cee87cd1dc9f service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:55.495082 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff940266-ce2d-4a64-9206-cee87cd1dc9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:55.511764 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff940266-ce2d-4a64-9206-cee87cd1dc9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:55.513257 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff940266-ce2d-4a64-9206-cee87cd1dc9f service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:55.531436 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 966/1935] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:41:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:41:56.975999 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a60d440-86de-4bdb-8ea4-fc15e9c3f946 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:56.977072 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a60d440-86de-4bdb-8ea4-fc15e9c3f946 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:56.977072 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a60d440-86de-4bdb-8ea4-fc15e9c3f946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:57.064442 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-6a60d440-86de-4bdb-8ea4-fc15e9c3f946 None None] MFA Rules not processed for user `7e7d7fafb7484d30b01830b03c36936c`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:41:57.070574 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-6a60d440-86de-4bdb-8ea4-fc15e9c3f946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:57.155460 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:57.238251 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 970/1936] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:41:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:41:57.242492 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff940266-ce2d-4a64-9206-cee87cd1dc9f service neutron] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:57.253028 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff940266-ce2d-4a64-9206-cee87cd1dc9f service neutron] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:57.258320 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98b09ae-831e-42b6-afa5-26f4bf16fb1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:57.259045 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98b09ae-831e-42b6-afa5-26f4bf16fb1d admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:57.259397 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98b09ae-831e-42b6-afa5-26f4bf16fb1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:57.259743 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98b09ae-831e-42b6-afa5-26f4bf16fb1d admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:57.260514 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98b09ae-831e-42b6-afa5-26f4bf16fb1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:57.262609 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98b09ae-831e-42b6-afa5-26f4bf16fb1d admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:57.314398 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a60d440-86de-4bdb-8ea4-fc15e9c3f946 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:57.322253 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 967/1937] 10.222.0.70 () {60 vars in 1153 bytes} [Tue Aug 2 21:41:57 2022] POST /identity/v3/projects => generated 371 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:41:57.332116 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a60d440-86de-4bdb-8ea4-fc15e9c3f946 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:57.406673 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb075960-e9be-4d19-9597-a6abff8ed5bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:57.407794 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb075960-e9be-4d19-9597-a6abff8ed5bd admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:57.408427 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb075960-e9be-4d19-9597-a6abff8ed5bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:57.408878 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb075960-e9be-4d19-9597-a6abff8ed5bd admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:57.409845 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb075960-e9be-4d19-9597-a6abff8ed5bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:57.412018 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb075960-e9be-4d19-9597-a6abff8ed5bd admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:57.446095 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 971/1938] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 2 21:41:57 2022] POST /identity/v3/users => generated 292 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:41:57.450522 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98b09ae-831e-42b6-afa5-26f4bf16fb1d admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:57.464001 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98b09ae-831e-42b6-afa5-26f4bf16fb1d admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:57.469524 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf29071-0f73-49bc-8dc5-99b9e16f676b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:57.471322 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf29071-0f73-49bc-8dc5-99b9e16f676b admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:57.471598 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf29071-0f73-49bc-8dc5-99b9e16f676b admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:57.471934 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf29071-0f73-49bc-8dc5-99b9e16f676b admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:57.472887 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf29071-0f73-49bc-8dc5-99b9e16f676b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:57.474541 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf29071-0f73-49bc-8dc5-99b9e16f676b admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:57.492112 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 968/1939] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:41:57 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:41:57.493688 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb075960-e9be-4d19-9597-a6abff8ed5bd admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:57.507978 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb075960-e9be-4d19-9597-a6abff8ed5bd admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:57.513980 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1205f9-f790-4a36-b279-801f1b554c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:57.514907 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1205f9-f790-4a36-b279-801f1b554c99 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:57.515392 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1205f9-f790-4a36-b279-801f1b554c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:57.516019 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1205f9-f790-4a36-b279-801f1b554c99 admin admin] PATH_INFO: `/v3/projects/d81ae8f4d77f44df903230c11f147028/users/30db4f9e87e14d5baa38e1b2b7253277/roles/3e32dbf75f9b41f5adb9fe59851267bb` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:57.535234 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1205f9-f790-4a36-b279-801f1b554c99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d81ae8f4d77f44df903230c11f147028, user_id=30db4f9e87e14d5baa38e1b2b7253277, role_id=3e32dbf75f9b41f5adb9fe59851267bb)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:57.538098 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1205f9-f790-4a36-b279-801f1b554c99 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:57.560554 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 972/1940] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:41:57 2022] PUT /identity/v3/projects/d81ae8f4d77f44df903230c11f147028/users/30db4f9e87e14d5baa38e1b2b7253277/roles/3e32dbf75f9b41f5adb9fe59851267bb => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:41:57.561492 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf29071-0f73-49bc-8dc5-99b9e16f676b admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:57.574382 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf29071-0f73-49bc-8dc5-99b9e16f676b admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:57.612698 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:41:57.655961 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60109b90-99e0-44ac-9822-8e5e0a8142b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:57.656866 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60109b90-99e0-44ac-9822-8e5e0a8142b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:57.658246 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60109b90-99e0-44ac-9822-8e5e0a8142b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:57.658734 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60109b90-99e0-44ac-9822-8e5e0a8142b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:57.659632 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60109b90-99e0-44ac-9822-8e5e0a8142b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:57.661511 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60109b90-99e0-44ac-9822-8e5e0a8142b2 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:57.680533 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 969/1941] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:41:57 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:41:57.683553 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1205f9-f790-4a36-b279-801f1b554c99 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:57.695208 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1205f9-f790-4a36-b279-801f1b554c99 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:57.700251 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8df4dea-8c44-49f8-a42f-f0fe67ba558a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:57.701055 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8df4dea-8c44-49f8-a42f-f0fe67ba558a admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:57.701348 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8df4dea-8c44-49f8-a42f-f0fe67ba558a admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:57.701630 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8df4dea-8c44-49f8-a42f-f0fe67ba558a admin admin] PATH_INFO: `/v3/projects/d81ae8f4d77f44df903230c11f147028/users/30db4f9e87e14d5baa38e1b2b7253277/roles/3e32dbf75f9b41f5adb9fe59851267bb` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:57.703836 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8df4dea-8c44-49f8-a42f-f0fe67ba558a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d81ae8f4d77f44df903230c11f147028, user_id=30db4f9e87e14d5baa38e1b2b7253277, role_id=3e32dbf75f9b41f5adb9fe59851267bb)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:57.707019 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8df4dea-8c44-49f8-a42f-f0fe67ba558a admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:57.722954 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 973/1942] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:41:57 2022] PUT /identity/v3/projects/d81ae8f4d77f44df903230c11f147028/users/30db4f9e87e14d5baa38e1b2b7253277/roles/3e32dbf75f9b41f5adb9fe59851267bb => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:41:58.629149 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311f3a36-a6e3-481a-ae1a-8e8c214233ac None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:58.629597 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311f3a36-a6e3-481a-ae1a-8e8c214233ac None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:58.629597 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311f3a36-a6e3-481a-ae1a-8e8c214233ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:58.663218 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-311f3a36-a6e3-481a-ae1a-8e8c214233ac None None] MFA Rules not processed for user `30db4f9e87e14d5baa38e1b2b7253277`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:41:58.665285 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-311f3a36-a6e3-481a-ae1a-8e8c214233ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:58.799841 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 970/1943] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:41:58 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:41:58.811305 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2308d1fa-6533-44da-8a9a-04298fd77c33 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:58.816495 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2308d1fa-6533-44da-8a9a-04298fd77c33 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:58.816495 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2308d1fa-6533-44da-8a9a-04298fd77c33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:58.862784 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-2308d1fa-6533-44da-8a9a-04298fd77c33 None None] MFA Rules not processed for user `7e7d7fafb7484d30b01830b03c36936c`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:41:58.867821 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-2308d1fa-6533-44da-8a9a-04298fd77c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:58.962247 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 974/1944] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:41:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:41:58.973767 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311f3a36-a6e3-481a-ae1a-8e8c214233ac None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:58.980217 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-311f3a36-a6e3-481a-ae1a-8e8c214233ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:59.086285 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311f3a36-a6e3-481a-ae1a-8e8c214233ac None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:41:59.092896 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf7f9f9-e10b-41cc-b008-3e4d23e24aac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87dd5c1c5e854d4b96e0b7dad6aa3719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:41:59.093538 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf7f9f9-e10b-41cc-b008-3e4d23e24aac service nova] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:41:59.093936 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf7f9f9-e10b-41cc-b008-3e4d23e24aac service nova] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:41:59.094390 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf7f9f9-e10b-41cc-b008-3e4d23e24aac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:41:59.109094 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf7f9f9-e10b-41cc-b008-3e4d23e24aac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:41:59.111850 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf7f9f9-e10b-41cc-b008-3e4d23e24aac service nova] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:41:59.128970 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 971/1945] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:41:58 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:41:59.938139 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2308d1fa-6533-44da-8a9a-04298fd77c33 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:41:59.940758 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-2308d1fa-6533-44da-8a9a-04298fd77c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:41:59.987992 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:42:00.036638 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2308d1fa-6533-44da-8a9a-04298fd77c33 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:00.041419 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839e9c29-ecfe-460d-88a9-5b63b7f436c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:00.042136 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e9c29-ecfe-460d-88a9-5b63b7f436c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:00.042491 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e9c29-ecfe-460d-88a9-5b63b7f436c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:00.042828 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839e9c29-ecfe-460d-88a9-5b63b7f436c9 admin admin] PATH_INFO: `/v3/users/34757acdd2e14796b0b471d2fc228c7d` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:00.044405 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839e9c29-ecfe-460d-88a9-5b63b7f436c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=34757acdd2e14796b0b471d2fc228c7d)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:00.046537 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839e9c29-ecfe-460d-88a9-5b63b7f436c9 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:00.117962 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-839e9c29-ecfe-460d-88a9-5b63b7f436c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34757acdd2e14796b0b471d2fc228c7d'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:00.130321 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-839e9c29-ecfe-460d-88a9-5b63b7f436c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34757acdd2e14796b0b471d2fc228c7d'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:00.153011 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-839e9c29-ecfe-460d-88a9-5b63b7f436c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34757acdd2e14796b0b471d2fc228c7d'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:00.165260 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-839e9c29-ecfe-460d-88a9-5b63b7f436c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34757acdd2e14796b0b471d2fc228c7d'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:00.167438 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-839e9c29-ecfe-460d-88a9-5b63b7f436c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34757acdd2e14796b0b471d2fc228c7d'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:00.175168 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 975/1946] 10.222.0.70 () {58 vars in 1224 bytes} [Tue Aug 2 21:41:59 2022] DELETE /identity/v3/users/34757acdd2e14796b0b471d2fc228c7d => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:42:00.179897 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda9be4d-f711-4800-a464-d5634497abb1 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:00.179897 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda9be4d-f711-4800-a464-d5634497abb1 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:00.180444 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda9be4d-f711-4800-a464-d5634497abb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:00.202043 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-dda9be4d-f711-4800-a464-d5634497abb1 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:42:00.203367 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-dda9be4d-f711-4800-a464-d5634497abb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:42:00.292146 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:42:00.346072 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 972/1947] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:42:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:42:00.375191 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839e9c29-ecfe-460d-88a9-5b63b7f436c9 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:00.377201 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-839e9c29-ecfe-460d-88a9-5b63b7f436c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:42:00.459542 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839e9c29-ecfe-460d-88a9-5b63b7f436c9 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:00.472585 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dd9fbd-1dec-4597-a51e-14299170d174 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '723f5f43572a493dae0349070a2adb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:00.473706 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd9fbd-1dec-4597-a51e-14299170d174 service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:00.474240 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd9fbd-1dec-4597-a51e-14299170d174 service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:00.474600 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77dd9fbd-1dec-4597-a51e-14299170d174 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:00.514944 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dd9fbd-1dec-4597-a51e-14299170d174 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:00.517593 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77dd9fbd-1dec-4597-a51e-14299170d174 service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:00.544472 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 976/1948] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:42:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:42:01.310996 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda9be4d-f711-4800-a464-d5634497abb1 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:01.313589 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-dda9be4d-f711-4800-a464-d5634497abb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:42:01.345770 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda9be4d-f711-4800-a464-d5634497abb1 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:01.357428 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c69f970-0038-4483-9be2-74a45d716f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:01.358155 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c69f970-0038-4483-9be2-74a45d716f6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:01.358612 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c69f970-0038-4483-9be2-74a45d716f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:01.359054 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c69f970-0038-4483-9be2-74a45d716f6f admin admin] PATH_INFO: `/v3/projects/952635bee0c24defabb834f1556535c4` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:01.360952 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c69f970-0038-4483-9be2-74a45d716f6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=952635bee0c24defabb834f1556535c4)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:01.363122 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c69f970-0038-4483-9be2-74a45d716f6f admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:01.428136 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-3c69f970-0038-4483-9be2-74a45d716f6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '952635bee0c24defabb834f1556535c4', 'request_id': 'req-3c69f970-0038-4483-9be2-74a45d716f6f'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:01.443237 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-3c69f970-0038-4483-9be2-74a45d716f6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '952635bee0c24defabb834f1556535c4', 'request_id': 'req-3c69f970-0038-4483-9be2-74a45d716f6f'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:01.459361 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-3c69f970-0038-4483-9be2-74a45d716f6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '952635bee0c24defabb834f1556535c4', 'request_id': 'req-3c69f970-0038-4483-9be2-74a45d716f6f'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:01.488431 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-3c69f970-0038-4483-9be2-74a45d716f6f admin admin] The token cache is being invalidate because project 952635bee0c24defabb834f1556535c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:42:01.488916 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-3c69f970-0038-4483-9be2-74a45d716f6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:01.490444 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-3c69f970-0038-4483-9be2-74a45d716f6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:01.493942 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 973/1949] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Aug 2 21:42:01 2022] DELETE /identity/v3/projects/952635bee0c24defabb834f1556535c4 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:42:01.498452 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dd9fbd-1dec-4597-a51e-14299170d174 service neutron] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:01.510673 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77dd9fbd-1dec-4597-a51e-14299170d174 service neutron] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:01.567304 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:42:01.580318 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f68b3de-d915-4237-857f-77850ad94a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:01.581117 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f68b3de-d915-4237-857f-77850ad94a30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:01.581717 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f68b3de-d915-4237-857f-77850ad94a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:01.582185 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f68b3de-d915-4237-857f-77850ad94a30 admin admin] PATH_INFO: `/v3/users/0e5be80135e14b8b923a032906ad5c6f` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:01.583553 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f68b3de-d915-4237-857f-77850ad94a30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e5be80135e14b8b923a032906ad5c6f)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:01.586472 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f68b3de-d915-4237-857f-77850ad94a30 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:01.677102 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-6f68b3de-d915-4237-857f-77850ad94a30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e5be80135e14b8b923a032906ad5c6f'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:01.690556 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-6f68b3de-d915-4237-857f-77850ad94a30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e5be80135e14b8b923a032906ad5c6f'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:01.728559 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-6f68b3de-d915-4237-857f-77850ad94a30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e5be80135e14b8b923a032906ad5c6f'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:01.741478 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-6f68b3de-d915-4237-857f-77850ad94a30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e5be80135e14b8b923a032906ad5c6f'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:01.742410 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-6f68b3de-d915-4237-857f-77850ad94a30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e5be80135e14b8b923a032906ad5c6f'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:01.759511 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 977/1950] 10.222.0.70 () {58 vars in 1224 bytes} [Tue Aug 2 21:42:01 2022] DELETE /identity/v3/users/0e5be80135e14b8b923a032906ad5c6f => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:42:02.157378 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c69f970-0038-4483-9be2-74a45d716f6f admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:02.164931 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-3c69f970-0038-4483-9be2-74a45d716f6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:42:02.194584 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c69f970-0038-4483-9be2-74a45d716f6f admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:02.278822 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6022a1ba-a9bf-4c47-abc2-8a715a7fed19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:02.279842 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6022a1ba-a9bf-4c47-abc2-8a715a7fed19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:02.279842 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6022a1ba-a9bf-4c47-abc2-8a715a7fed19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:02.280189 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6022a1ba-a9bf-4c47-abc2-8a715a7fed19 admin admin] PATH_INFO: `/v3/projects/8f8b49d66e194eb0a383e4c06039fc31` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:02.281560 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6022a1ba-a9bf-4c47-abc2-8a715a7fed19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f8b49d66e194eb0a383e4c06039fc31)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:02.283528 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6022a1ba-a9bf-4c47-abc2-8a715a7fed19 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:02.356320 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-6022a1ba-a9bf-4c47-abc2-8a715a7fed19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f8b49d66e194eb0a383e4c06039fc31', 'request_id': 'req-6022a1ba-a9bf-4c47-abc2-8a715a7fed19'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:02.367460 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-6022a1ba-a9bf-4c47-abc2-8a715a7fed19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f8b49d66e194eb0a383e4c06039fc31', 'request_id': 'req-6022a1ba-a9bf-4c47-abc2-8a715a7fed19'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:02.379570 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-6022a1ba-a9bf-4c47-abc2-8a715a7fed19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f8b49d66e194eb0a383e4c06039fc31', 'request_id': 'req-6022a1ba-a9bf-4c47-abc2-8a715a7fed19'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:02.381872 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:42:02.396467 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-6022a1ba-a9bf-4c47-abc2-8a715a7fed19 admin admin] The token cache is being invalidate because project 8f8b49d66e194eb0a383e4c06039fc31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:42:02.397661 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-6022a1ba-a9bf-4c47-abc2-8a715a7fed19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:02.398510 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-6022a1ba-a9bf-4c47-abc2-8a715a7fed19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:02.400276 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 974/1951] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Aug 2 21:42:02 2022] DELETE /identity/v3/projects/8f8b49d66e194eb0a383e4c06039fc31 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:42:02.406344 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1fd5fd-3f95-41fc-bfe4-f9db451d31c3 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:02.406636 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1fd5fd-3f95-41fc-bfe4-f9db451d31c3 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:02.406915 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1fd5fd-3f95-41fc-bfe4-f9db451d31c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:02.432967 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-ad1fd5fd-3f95-41fc-bfe4-f9db451d31c3 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:42:02.434227 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-ad1fd5fd-3f95-41fc-bfe4-f9db451d31c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:42:02.502350 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 978/1952] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:42:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:42:02.510969 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c93797-65eb-46cd-9013-d83b62a812b3 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:02.511262 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c93797-65eb-46cd-9013-d83b62a812b3 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:02.511542 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c93797-65eb-46cd-9013-d83b62a812b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:02.531857 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-c0c93797-65eb-46cd-9013-d83b62a812b3 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:42:02.533383 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-c0c93797-65eb-46cd-9013-d83b62a812b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:42:02.543152 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 975/1953] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:42:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:42:02.546923 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1fd5fd-3f95-41fc-bfe4-f9db451d31c3 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:02.557119 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1fd5fd-3f95-41fc-bfe4-f9db451d31c3 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:02.561890 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ade6456-8e24-4520-8958-0845132bf65f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:02.562510 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ade6456-8e24-4520-8958-0845132bf65f admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:02.562890 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ade6456-8e24-4520-8958-0845132bf65f admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:02.563181 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ade6456-8e24-4520-8958-0845132bf65f admin admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:02.564470 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ade6456-8e24-4520-8958-0845132bf65f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:42:02.564782 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ade6456-8e24-4520-8958-0845132bf65f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:02.566393 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ade6456-8e24-4520-8958-0845132bf65f admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:02.578353 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 979/1954] 10.222.0.70 () {58 vars in 1153 bytes} [Tue Aug 2 21:42:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:42:02.582785 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c93797-65eb-46cd-9013-d83b62a812b3 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:02.592034 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c93797-65eb-46cd-9013-d83b62a812b3 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:02.596740 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f2cce2-26c7-435f-a20f-e650f12c5d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:02.597356 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f2cce2-26c7-435f-a20f-e650f12c5d4d admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:02.597644 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f2cce2-26c7-435f-a20f-e650f12c5d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:02.597925 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f2cce2-26c7-435f-a20f-e650f12c5d4d admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:02.598592 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f2cce2-26c7-435f-a20f-e650f12c5d4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:02.600538 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f2cce2-26c7-435f-a20f-e650f12c5d4d admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:02.633741 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 976/1955] 10.222.0.70 () {60 vars in 1153 bytes} [Tue Aug 2 21:42:02 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:42:02.635202 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ade6456-8e24-4520-8958-0845132bf65f admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:02.645599 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ade6456-8e24-4520-8958-0845132bf65f admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:02.697815 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:42:02.704196 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0305e991-4ed0-4304-b44a-d92b19294fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:02.704889 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0305e991-4ed0-4304-b44a-d92b19294fef admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:02.705416 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0305e991-4ed0-4304-b44a-d92b19294fef admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:02.705767 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0305e991-4ed0-4304-b44a-d92b19294fef admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:02.706911 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0305e991-4ed0-4304-b44a-d92b19294fef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:02.709429 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0305e991-4ed0-4304-b44a-d92b19294fef admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:02.731622 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 980/1956] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 2 21:42:02 2022] POST /identity/v3/users => generated 288 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:42:02.736031 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f2cce2-26c7-435f-a20f-e650f12c5d4d admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:02.746702 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f2cce2-26c7-435f-a20f-e650f12c5d4d admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:02.752037 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce704bc9-1b47-43e2-90d7-496cf8777a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:02.752788 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce704bc9-1b47-43e2-90d7-496cf8777a09 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:02.753143 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce704bc9-1b47-43e2-90d7-496cf8777a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:02.753430 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce704bc9-1b47-43e2-90d7-496cf8777a09 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:02.754132 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce704bc9-1b47-43e2-90d7-496cf8777a09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:02.755731 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce704bc9-1b47-43e2-90d7-496cf8777a09 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:02.765833 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 977/1957] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:42:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:42:02.769943 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0305e991-4ed0-4304-b44a-d92b19294fef admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:02.780786 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0305e991-4ed0-4304-b44a-d92b19294fef admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:02.786588 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73d4712-1d2f-4ea7-8155-ef605acfe802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:02.787370 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73d4712-1d2f-4ea7-8155-ef605acfe802 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:02.787686 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73d4712-1d2f-4ea7-8155-ef605acfe802 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:02.787929 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73d4712-1d2f-4ea7-8155-ef605acfe802 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:02.788780 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73d4712-1d2f-4ea7-8155-ef605acfe802 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:02.790391 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73d4712-1d2f-4ea7-8155-ef605acfe802 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:02.804971 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 981/1958] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:42:02 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:42:02.809132 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce704bc9-1b47-43e2-90d7-496cf8777a09 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:02.821045 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce704bc9-1b47-43e2-90d7-496cf8777a09 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:02.827262 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32637ecf-53e1-48e0-b229-015f1f43c56a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:02.827985 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32637ecf-53e1-48e0-b229-015f1f43c56a admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:02.828225 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32637ecf-53e1-48e0-b229-015f1f43c56a admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:02.828592 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32637ecf-53e1-48e0-b229-015f1f43c56a admin admin] PATH_INFO: `/v3/projects/ead599045e11445bb806f9f0baaabb5c/users/18cd4730aa19467e8276b2b204972999/roles/462e3381a85c42a9959201f9aa122f7c` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:02.846997 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32637ecf-53e1-48e0-b229-015f1f43c56a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ead599045e11445bb806f9f0baaabb5c, user_id=18cd4730aa19467e8276b2b204972999, role_id=462e3381a85c42a9959201f9aa122f7c)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:02.849760 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32637ecf-53e1-48e0-b229-015f1f43c56a admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:02.869982 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 978/1959] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:42:02 2022] PUT /identity/v3/projects/ead599045e11445bb806f9f0baaabb5c/users/18cd4730aa19467e8276b2b204972999/roles/462e3381a85c42a9959201f9aa122f7c => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:42:02.883666 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295f7c1b-77c4-4636-8784-2e3b0996943f None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:02.884490 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295f7c1b-77c4-4636-8784-2e3b0996943f None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:02.885165 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295f7c1b-77c4-4636-8784-2e3b0996943f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:02.939400 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-295f7c1b-77c4-4636-8784-2e3b0996943f None None] MFA Rules not processed for user `18cd4730aa19467e8276b2b204972999`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:42:02.941121 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-295f7c1b-77c4-4636-8784-2e3b0996943f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:42:03.023086 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 982/1960] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:42:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:42:03.035063 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32637ecf-53e1-48e0-b229-015f1f43c56a admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:03.037547 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-32637ecf-53e1-48e0-b229-015f1f43c56a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:42:03.149378 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32637ecf-53e1-48e0-b229-015f1f43c56a admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:03.152987 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498a0d76-044e-471f-bd61-e9513488298c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'accb7ab8b4f447389ed394a48fc27619', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:03.153608 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498a0d76-044e-471f-bd61-e9513488298c service glance] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:03.153894 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498a0d76-044e-471f-bd61-e9513488298c service glance] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:03.154175 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498a0d76-044e-471f-bd61-e9513488298c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:03.163191 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498a0d76-044e-471f-bd61-e9513488298c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:03.164693 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498a0d76-044e-471f-bd61-e9513488298c service glance] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:03.174174 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 979/1961] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:42:03 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:42:13.019781 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=40,keystone:INSERT=3 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:42:13.169424 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=65,keystone:INSERT=2 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:42:21.139747 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4437c9de-8928-484d-9b1f-6344905ae7d5 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:21.140219 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4437c9de-8928-484d-9b1f-6344905ae7d5 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:21.140483 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4437c9de-8928-484d-9b1f-6344905ae7d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:21.160955 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-4437c9de-8928-484d-9b1f-6344905ae7d5 None None] MFA Rules not processed for user `e61888271eb24116b73d146dadd7dcb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:42:21.162205 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-4437c9de-8928-484d-9b1f-6344905ae7d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:42:21.223469 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 983/1962] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:42:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:42:23.762685 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a869d93-0b03-4e44-930c-b1007a3293a4 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:23.763166 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a869d93-0b03-4e44-930c-b1007a3293a4 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:23.763272 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a869d93-0b03-4e44-930c-b1007a3293a4 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:23.765365 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 980/1963] 10.222.0.70 () {54 vars in 921 bytes} [Tue Aug 2 21:42:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:42:23.797198 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f418bba1-5dad-4336-8e5d-4d97c18c7b58 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:23.797676 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f418bba1-5dad-4336-8e5d-4d97c18c7b58 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:23.797795 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f418bba1-5dad-4336-8e5d-4d97c18c7b58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:23.818094 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-f418bba1-5dad-4336-8e5d-4d97c18c7b58 None None] MFA Rules not processed for user `83fcd951771e42959506b70b0137003f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:42:23.819426 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-f418bba1-5dad-4336-8e5d-4d97c18c7b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:42:23.864818 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a869d93-0b03-4e44-930c-b1007a3293a4 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:23.869384 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-0a869d93-0b03-4e44-930c-b1007a3293a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:42:23.905095 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 984/1964] 10.222.0.70 () {58 vars in 1018 bytes} [Tue Aug 2 21:42:23 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:42:23.938160 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f418bba1-5dad-4336-8e5d-4d97c18c7b58 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:23.940692 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-f418bba1-5dad-4336-8e5d-4d97c18c7b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:42:23.962951 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f418bba1-5dad-4336-8e5d-4d97c18c7b58 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:23.970977 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc9699d-5204-4e84-8360-d4d6b998e0ee service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83fcd951771e42959506b70b0137003f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:23.971780 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc9699d-5204-4e84-8360-d4d6b998e0ee service placement] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:23.972405 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc9699d-5204-4e84-8360-d4d6b998e0ee service placement] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:23.972680 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc9699d-5204-4e84-8360-d4d6b998e0ee service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:23.978181 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a869d93-0b03-4e44-930c-b1007a3293a4 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:23.987691 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9281ac6d-cedb-49d6-8f46-70eccb0c4899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:23.988120 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc9699d-5204-4e84-8360-d4d6b998e0ee service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:23.988874 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9281ac6d-cedb-49d6-8f46-70eccb0c4899 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:23.989415 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9281ac6d-cedb-49d6-8f46-70eccb0c4899 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:23.989934 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9281ac6d-cedb-49d6-8f46-70eccb0c4899 admin admin] PATH_INFO: `/v3/users/2dc6150d8d9e41b596246f282ab9ac34` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:23.990960 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc9699d-5204-4e84-8360-d4d6b998e0ee service placement] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:23.992148 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9281ac6d-cedb-49d6-8f46-70eccb0c4899 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2dc6150d8d9e41b596246f282ab9ac34)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:23.994998 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9281ac6d-cedb-49d6-8f46-70eccb0c4899 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:24.008375 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 985/1965] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:42:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:42:24.100978 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-9281ac6d-cedb-49d6-8f46-70eccb0c4899 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2dc6150d8d9e41b596246f282ab9ac34'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:24.114957 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-9281ac6d-cedb-49d6-8f46-70eccb0c4899 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2dc6150d8d9e41b596246f282ab9ac34'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:24.149321 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-9281ac6d-cedb-49d6-8f46-70eccb0c4899 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2dc6150d8d9e41b596246f282ab9ac34'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:24.150102 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-9281ac6d-cedb-49d6-8f46-70eccb0c4899 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2dc6150d8d9e41b596246f282ab9ac34'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:24.160279 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-9281ac6d-cedb-49d6-8f46-70eccb0c4899 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2dc6150d8d9e41b596246f282ab9ac34'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:24.172698 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 981/1966] 10.222.0.70 () {58 vars in 1224 bytes} [Tue Aug 2 21:42:23 2022] DELETE /identity/v3/users/2dc6150d8d9e41b596246f282ab9ac34 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:42:24.563396 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc9699d-5204-4e84-8360-d4d6b998e0ee service placement] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:24.574715 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc9699d-5204-4e84-8360-d4d6b998e0ee service placement] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:24.639915 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedbd00c-b32b-41fa-b9aa-5d8e0c30da16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:24.640611 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedbd00c-b32b-41fa-b9aa-5d8e0c30da16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:24.640895 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedbd00c-b32b-41fa-b9aa-5d8e0c30da16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:24.641173 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedbd00c-b32b-41fa-b9aa-5d8e0c30da16 admin admin] PATH_INFO: `/v3/projects/e07b172de67a409999c56738925838e1` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:24.642584 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedbd00c-b32b-41fa-b9aa-5d8e0c30da16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e07b172de67a409999c56738925838e1)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:24.644421 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedbd00c-b32b-41fa-b9aa-5d8e0c30da16 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:24.680717 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:42:24.696358 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-dedbd00c-b32b-41fa-b9aa-5d8e0c30da16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e07b172de67a409999c56738925838e1', 'request_id': 'req-dedbd00c-b32b-41fa-b9aa-5d8e0c30da16'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:24.701973 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-dedbd00c-b32b-41fa-b9aa-5d8e0c30da16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e07b172de67a409999c56738925838e1', 'request_id': 'req-dedbd00c-b32b-41fa-b9aa-5d8e0c30da16'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:24.711293 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-dedbd00c-b32b-41fa-b9aa-5d8e0c30da16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e07b172de67a409999c56738925838e1', 'request_id': 'req-dedbd00c-b32b-41fa-b9aa-5d8e0c30da16'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:24.727348 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-dedbd00c-b32b-41fa-b9aa-5d8e0c30da16 admin admin] The token cache is being invalidate because project e07b172de67a409999c56738925838e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:42:24.727935 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-dedbd00c-b32b-41fa-b9aa-5d8e0c30da16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:24.729004 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-dedbd00c-b32b-41fa-b9aa-5d8e0c30da16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:24.730956 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 986/1967] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Aug 2 21:42:24 2022] DELETE /identity/v3/projects/e07b172de67a409999c56738925838e1 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:42:24.736984 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b2595a-ae60-435f-94a1-8b59accf889e None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:24.737302 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b2595a-ae60-435f-94a1-8b59accf889e None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:24.737584 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b2595a-ae60-435f-94a1-8b59accf889e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:24.758949 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-04b2595a-ae60-435f-94a1-8b59accf889e None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:42:24.760171 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-04b2595a-ae60-435f-94a1-8b59accf889e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:42:24.832492 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ad2e5f-1cdb-418f-8d33-c9445f505dd4 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:24.832959 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ad2e5f-1cdb-418f-8d33-c9445f505dd4 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:24.833048 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ad2e5f-1cdb-418f-8d33-c9445f505dd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:24.836353 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 982/1968] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:42:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:42:24.856044 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-93ad2e5f-1cdb-418f-8d33-c9445f505dd4 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:42:24.857513 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-93ad2e5f-1cdb-418f-8d33-c9445f505dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:42:24.869870 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 987/1969] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:42:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:42:24.874166 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b2595a-ae60-435f-94a1-8b59accf889e None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:24.884298 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b2595a-ae60-435f-94a1-8b59accf889e None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:24.889081 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a82f643-fde5-457f-8157-8ea3449a1e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:24.889897 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a82f643-fde5-457f-8157-8ea3449a1e26 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:24.891477 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a82f643-fde5-457f-8157-8ea3449a1e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:24.891477 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a82f643-fde5-457f-8157-8ea3449a1e26 admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:24.891477 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a82f643-fde5-457f-8157-8ea3449a1e26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:42:24.891881 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a82f643-fde5-457f-8157-8ea3449a1e26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:24.894485 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a82f643-fde5-457f-8157-8ea3449a1e26 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:24.911830 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 983/1970] 10.222.0.70 () {58 vars in 1153 bytes} [Tue Aug 2 21:42:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:42:24.912941 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ad2e5f-1cdb-418f-8d33-c9445f505dd4 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:24.923432 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ad2e5f-1cdb-418f-8d33-c9445f505dd4 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:24.928155 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0af33c-bde2-4463-94ca-188398b964e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:24.928802 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0af33c-bde2-4463-94ca-188398b964e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:24.929088 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0af33c-bde2-4463-94ca-188398b964e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:24.929362 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0af33c-bde2-4463-94ca-188398b964e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:24.930048 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0af33c-bde2-4463-94ca-188398b964e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:24.931974 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0af33c-bde2-4463-94ca-188398b964e8 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:24.973438 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 988/1971] 10.222.0.70 () {60 vars in 1153 bytes} [Tue Aug 2 21:42:24 2022] POST /identity/v3/projects => generated 367 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:42:24.974827 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a82f643-fde5-457f-8157-8ea3449a1e26 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:24.986239 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a82f643-fde5-457f-8157-8ea3449a1e26 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:24.991965 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:42:25.051331 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aea11d-cfc5-46d2-b067-67f0abfd14f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:25.051959 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aea11d-cfc5-46d2-b067-67f0abfd14f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:25.052262 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aea11d-cfc5-46d2-b067-67f0abfd14f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:25.052550 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aea11d-cfc5-46d2-b067-67f0abfd14f4 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:25.053244 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aea11d-cfc5-46d2-b067-67f0abfd14f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:25.055206 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69aea11d-cfc5-46d2-b067-67f0abfd14f4 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:25.077256 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 984/1972] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 2 21:42:24 2022] POST /identity/v3/users => generated 284 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:42:25.081371 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0af33c-bde2-4463-94ca-188398b964e8 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:25.092487 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0af33c-bde2-4463-94ca-188398b964e8 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:25.097066 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4022c0-0862-4624-8175-9bbb1dc53015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:25.097675 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4022c0-0862-4624-8175-9bbb1dc53015 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:25.097955 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4022c0-0862-4624-8175-9bbb1dc53015 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:25.098302 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4022c0-0862-4624-8175-9bbb1dc53015 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:25.098989 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4022c0-0862-4624-8175-9bbb1dc53015 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:25.100625 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4022c0-0862-4624-8175-9bbb1dc53015 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:25.112730 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 989/1973] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:42:25 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 21:42:25.116655 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aea11d-cfc5-46d2-b067-67f0abfd14f4 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:25.127894 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aea11d-cfc5-46d2-b067-67f0abfd14f4 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:25.133077 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c067d3-60bf-44a7-8d99-263ccb9a44b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:25.133723 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c067d3-60bf-44a7-8d99-263ccb9a44b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:25.134006 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c067d3-60bf-44a7-8d99-263ccb9a44b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:25.134284 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c067d3-60bf-44a7-8d99-263ccb9a44b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:25.134980 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c067d3-60bf-44a7-8d99-263ccb9a44b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:25.136633 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c067d3-60bf-44a7-8d99-263ccb9a44b2 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:25.148691 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 985/1974] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:42:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:42:25.152901 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4022c0-0862-4624-8175-9bbb1dc53015 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:25.165306 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4022c0-0862-4624-8175-9bbb1dc53015 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:25.171228 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe02134c-ea67-4b97-9f46-8103375dc9c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:25.171909 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe02134c-ea67-4b97-9f46-8103375dc9c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:25.172199 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe02134c-ea67-4b97-9f46-8103375dc9c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:25.172506 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe02134c-ea67-4b97-9f46-8103375dc9c4 admin admin] PATH_INFO: `/v3/projects/2e4182276f0f4fa48f1d91ed753b54ff/users/952d35e9b0d343b6a6fa65426727de10/roles/462e3381a85c42a9959201f9aa122f7c` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:25.190421 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe02134c-ea67-4b97-9f46-8103375dc9c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e4182276f0f4fa48f1d91ed753b54ff, user_id=952d35e9b0d343b6a6fa65426727de10, role_id=462e3381a85c42a9959201f9aa122f7c)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:25.193375 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe02134c-ea67-4b97-9f46-8103375dc9c4 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:25.208773 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 990/1975] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:42:25 2022] PUT /identity/v3/projects/2e4182276f0f4fa48f1d91ed753b54ff/users/952d35e9b0d343b6a6fa65426727de10/roles/462e3381a85c42a9959201f9aa122f7c => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:42:25.219153 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a1ee83-54fb-4512-aa3b-08f3c24b3d0a None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:25.219477 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a1ee83-54fb-4512-aa3b-08f3c24b3d0a None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:25.219754 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a1ee83-54fb-4512-aa3b-08f3c24b3d0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:25.256148 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-a8a1ee83-54fb-4512-aa3b-08f3c24b3d0a None None] MFA Rules not processed for user `952d35e9b0d343b6a6fa65426727de10`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:42:25.257518 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-a8a1ee83-54fb-4512-aa3b-08f3c24b3d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:42:25.340282 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 986/1976] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:42:25 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:42:25.348268 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe02134c-ea67-4b97-9f46-8103375dc9c4 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:25.350237 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-fe02134c-ea67-4b97-9f46-8103375dc9c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:42:25.433082 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe02134c-ea67-4b97-9f46-8103375dc9c4 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:25.437123 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd06e886-f60b-42b6-ac4f-34f53740f2c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '123eb76f95ee4e39905944da701c712d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:25.437748 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd06e886-f60b-42b6-ac4f-34f53740f2c3 service cinder] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:25.438143 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd06e886-f60b-42b6-ac4f-34f53740f2c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:25.438418 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd06e886-f60b-42b6-ac4f-34f53740f2c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:25.447962 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd06e886-f60b-42b6-ac4f-34f53740f2c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:25.449448 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd06e886-f60b-42b6-ac4f-34f53740f2c3 service cinder] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:25.459437 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 991/1977] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:42:25 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 21:42:25.655185 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a1ee83-54fb-4512-aa3b-08f3c24b3d0a None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:25.656654 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-a8a1ee83-54fb-4512-aa3b-08f3c24b3d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:42:25.817545 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd06e886-f60b-42b6-ac4f-34f53740f2c3 service cinder] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:25.819021 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-bd06e886-f60b-42b6-ac4f-34f53740f2c3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:42:25.836381 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd06e886-f60b-42b6-ac4f-34f53740f2c3 service cinder] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:25.844899 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7991278b-009e-4414-bb44-635fb739866a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '123eb76f95ee4e39905944da701c712d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:25.846116 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7991278b-009e-4414-bb44-635fb739866a service cinder] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:25.846403 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7991278b-009e-4414-bb44-635fb739866a service cinder] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:25.846680 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7991278b-009e-4414-bb44-635fb739866a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:25.850578 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a1ee83-54fb-4512-aa3b-08f3c24b3d0a None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:25.853012 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-7991278b-009e-4414-bb44-635fb739866a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:42:25.866546 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c15baf-a0ee-4f0d-a569-9b7be888b313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:25.867268 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c15baf-a0ee-4f0d-a569-9b7be888b313 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:25.867968 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c15baf-a0ee-4f0d-a569-9b7be888b313 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:25.867968 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c15baf-a0ee-4f0d-a569-9b7be888b313 admin admin] PATH_INFO: `/v3/users/18cd4730aa19467e8276b2b204972999` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:25.871060 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c15baf-a0ee-4f0d-a569-9b7be888b313 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18cd4730aa19467e8276b2b204972999)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:25.877555 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c15baf-a0ee-4f0d-a569-9b7be888b313 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:25.928911 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:42:25.959720 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:42:25.991074 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7991278b-009e-4414-bb44-635fb739866a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:25.992898 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7991278b-009e-4414-bb44-635fb739866a service cinder] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:25.995328 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-f5c15baf-a0ee-4f0d-a569-9b7be888b313 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18cd4730aa19467e8276b2b204972999'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:26.007563 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-f5c15baf-a0ee-4f0d-a569-9b7be888b313 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18cd4730aa19467e8276b2b204972999'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:26.009914 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 992/1978] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:42:25 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 21:42:26.023082 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-f5c15baf-a0ee-4f0d-a569-9b7be888b313 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18cd4730aa19467e8276b2b204972999'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:26.023913 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-f5c15baf-a0ee-4f0d-a569-9b7be888b313 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18cd4730aa19467e8276b2b204972999'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:26.033549 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-f5c15baf-a0ee-4f0d-a569-9b7be888b313 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18cd4730aa19467e8276b2b204972999'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:26.040017 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 987/1979] 10.222.0.70 () {58 vars in 1224 bytes} [Tue Aug 2 21:42:25 2022] DELETE /identity/v3/users/18cd4730aa19467e8276b2b204972999 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:42:26.044982 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a06f82b-e4ea-420a-9a73-554158be5815 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:26.045546 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a06f82b-e4ea-420a-9a73-554158be5815 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:26.045999 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a06f82b-e4ea-420a-9a73-554158be5815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:26.075073 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-7a06f82b-e4ea-420a-9a73-554158be5815 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:42:26.076460 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-7a06f82b-e4ea-420a-9a73-554158be5815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:42:26.149126 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 993/1980] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:42:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:42:26.159663 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c15baf-a0ee-4f0d-a569-9b7be888b313 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:26.161235 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-f5c15baf-a0ee-4f0d-a569-9b7be888b313 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:42:26.225514 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c15baf-a0ee-4f0d-a569-9b7be888b313 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:26.229374 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085b7b21-50f5-452e-8dbf-b969284df3e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '723f5f43572a493dae0349070a2adb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:26.229998 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085b7b21-50f5-452e-8dbf-b969284df3e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:26.230283 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085b7b21-50f5-452e-8dbf-b969284df3e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:26.230558 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085b7b21-50f5-452e-8dbf-b969284df3e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:26.241727 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085b7b21-50f5-452e-8dbf-b969284df3e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:26.243401 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085b7b21-50f5-452e-8dbf-b969284df3e6 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:26.254947 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 988/1981] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:42:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:42:26.616490 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a06f82b-e4ea-420a-9a73-554158be5815 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:26.618025 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-7a06f82b-e4ea-420a-9a73-554158be5815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:42:26.630853 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a06f82b-e4ea-420a-9a73-554158be5815 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:26.635652 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6869f6e6-39a3-4cc9-86d0-dbbeeaf33f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:26.636339 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6869f6e6-39a3-4cc9-86d0-dbbeeaf33f63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:26.636629 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6869f6e6-39a3-4cc9-86d0-dbbeeaf33f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:26.636912 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6869f6e6-39a3-4cc9-86d0-dbbeeaf33f63 admin admin] PATH_INFO: `/v3/projects/ead599045e11445bb806f9f0baaabb5c` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:26.638096 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6869f6e6-39a3-4cc9-86d0-dbbeeaf33f63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ead599045e11445bb806f9f0baaabb5c)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:26.640040 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6869f6e6-39a3-4cc9-86d0-dbbeeaf33f63 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:26.695494 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-6869f6e6-39a3-4cc9-86d0-dbbeeaf33f63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ead599045e11445bb806f9f0baaabb5c', 'request_id': 'req-6869f6e6-39a3-4cc9-86d0-dbbeeaf33f63'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:26.701150 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-6869f6e6-39a3-4cc9-86d0-dbbeeaf33f63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ead599045e11445bb806f9f0baaabb5c', 'request_id': 'req-6869f6e6-39a3-4cc9-86d0-dbbeeaf33f63'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:26.710110 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-6869f6e6-39a3-4cc9-86d0-dbbeeaf33f63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ead599045e11445bb806f9f0baaabb5c', 'request_id': 'req-6869f6e6-39a3-4cc9-86d0-dbbeeaf33f63'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:26.721763 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-6869f6e6-39a3-4cc9-86d0-dbbeeaf33f63 admin admin] The token cache is being invalidate because project ead599045e11445bb806f9f0baaabb5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:42:26.722058 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-6869f6e6-39a3-4cc9-86d0-dbbeeaf33f63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:26.722695 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-6869f6e6-39a3-4cc9-86d0-dbbeeaf33f63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:26.724220 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 994/1982] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Aug 2 21:42:26 2022] DELETE /identity/v3/projects/ead599045e11445bb806f9f0baaabb5c => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:42:26.729397 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355cdae3-897d-43d2-83da-ae2d42466d21 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:26.729684 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355cdae3-897d-43d2-83da-ae2d42466d21 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:26.729959 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355cdae3-897d-43d2-83da-ae2d42466d21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:26.748978 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-355cdae3-897d-43d2-83da-ae2d42466d21 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:42:26.750199 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-355cdae3-897d-43d2-83da-ae2d42466d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:42:26.810099 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 989/1983] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:42:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:42:26.818493 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1531f8-73ea-4042-b141-615791c3a6ec None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:26.818784 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1531f8-73ea-4042-b141-615791c3a6ec None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:26.819059 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1531f8-73ea-4042-b141-615791c3a6ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:26.839273 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-3a1531f8-73ea-4042-b141-615791c3a6ec None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:42:26.840501 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-3a1531f8-73ea-4042-b141-615791c3a6ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:42:26.848603 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 995/1984] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:42:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:42:26.852885 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355cdae3-897d-43d2-83da-ae2d42466d21 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:26.863098 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355cdae3-897d-43d2-83da-ae2d42466d21 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:26.868456 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91040dfe-5853-488d-8dfd-b32ff2128ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:26.869091 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91040dfe-5853-488d-8dfd-b32ff2128ac3 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:26.869371 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91040dfe-5853-488d-8dfd-b32ff2128ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:26.869649 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91040dfe-5853-488d-8dfd-b32ff2128ac3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:26.870354 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91040dfe-5853-488d-8dfd-b32ff2128ac3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:42:26.870659 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91040dfe-5853-488d-8dfd-b32ff2128ac3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:26.873090 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91040dfe-5853-488d-8dfd-b32ff2128ac3 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:26.885785 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 990/1985] 10.222.0.70 () {58 vars in 1153 bytes} [Tue Aug 2 21:42:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:42:26.890246 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1531f8-73ea-4042-b141-615791c3a6ec None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:26.900801 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1531f8-73ea-4042-b141-615791c3a6ec None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:26.905745 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdf129d-aff1-4475-a56b-eebff3a07d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:26.906337 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf129d-aff1-4475-a56b-eebff3a07d94 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:26.907103 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf129d-aff1-4475-a56b-eebff3a07d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:26.907388 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdf129d-aff1-4475-a56b-eebff3a07d94 admin admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:26.908176 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdf129d-aff1-4475-a56b-eebff3a07d94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:26.910161 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdf129d-aff1-4475-a56b-eebff3a07d94 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:26.947643 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 996/1986] 10.222.0.70 () {60 vars in 1153 bytes} [Tue Aug 2 21:42:26 2022] POST /identity/v3/projects => generated 375 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:42:26.951666 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91040dfe-5853-488d-8dfd-b32ff2128ac3 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:26.967176 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91040dfe-5853-488d-8dfd-b32ff2128ac3 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:26.993114 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:42:27.039942 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfd340c-3af9-4e82-8ecf-834a1b14cdc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:27.040606 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd340c-3af9-4e82-8ecf-834a1b14cdc8 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:27.041017 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd340c-3af9-4e82-8ecf-834a1b14cdc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:27.041159 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfd340c-3af9-4e82-8ecf-834a1b14cdc8 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:27.041829 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfd340c-3af9-4e82-8ecf-834a1b14cdc8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:27.043754 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfd340c-3af9-4e82-8ecf-834a1b14cdc8 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:27.076047 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 991/1987] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 2 21:42:26 2022] POST /identity/v3/users => generated 288 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:42:27.077037 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdf129d-aff1-4475-a56b-eebff3a07d94 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:27.089019 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdf129d-aff1-4475-a56b-eebff3a07d94 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:27.095516 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d3fa6d-50c3-409d-a1c6-6ce547627552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:27.096619 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d3fa6d-50c3-409d-a1c6-6ce547627552 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:27.097024 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d3fa6d-50c3-409d-a1c6-6ce547627552 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:27.097404 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d3fa6d-50c3-409d-a1c6-6ce547627552 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:27.098217 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d3fa6d-50c3-409d-a1c6-6ce547627552 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:27.100283 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d3fa6d-50c3-409d-a1c6-6ce547627552 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:27.112795 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 997/1988] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:42:27 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:42:27.116898 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfd340c-3af9-4e82-8ecf-834a1b14cdc8 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:27.129272 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfd340c-3af9-4e82-8ecf-834a1b14cdc8 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:27.136770 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a4b474-3c02-404f-9124-756ee833773f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:27.138075 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a4b474-3c02-404f-9124-756ee833773f admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:27.138678 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a4b474-3c02-404f-9124-756ee833773f admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:27.141522 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a4b474-3c02-404f-9124-756ee833773f admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:27.143488 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a4b474-3c02-404f-9124-756ee833773f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:27.147187 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a4b474-3c02-404f-9124-756ee833773f admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:27.169051 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 992/1989] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:42:27 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:42:27.169595 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d3fa6d-50c3-409d-a1c6-6ce547627552 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:27.185117 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d3fa6d-50c3-409d-a1c6-6ce547627552 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:27.197002 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15908ce9-1587-4b0c-9b60-ac2b43cf1e72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:27.197692 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15908ce9-1587-4b0c-9b60-ac2b43cf1e72 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:27.197978 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15908ce9-1587-4b0c-9b60-ac2b43cf1e72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:27.198261 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15908ce9-1587-4b0c-9b60-ac2b43cf1e72 admin admin] PATH_INFO: `/v3/projects/a587626f362f4683b3cc7859a3c7e707/users/17187901d9e04a368673e5f8c00777a5/roles/462e3381a85c42a9959201f9aa122f7c` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:27.215034 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15908ce9-1587-4b0c-9b60-ac2b43cf1e72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a587626f362f4683b3cc7859a3c7e707, user_id=17187901d9e04a368673e5f8c00777a5, role_id=462e3381a85c42a9959201f9aa122f7c)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:27.217795 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15908ce9-1587-4b0c-9b60-ac2b43cf1e72 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:27.253988 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 998/1990] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:42:27 2022] PUT /identity/v3/projects/a587626f362f4683b3cc7859a3c7e707/users/17187901d9e04a368673e5f8c00777a5/roles/462e3381a85c42a9959201f9aa122f7c => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:42:27.266921 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d71468-89ec-428c-8f16-b7ff9ff61c35 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:27.267243 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d71468-89ec-428c-8f16-b7ff9ff61c35 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:27.267528 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d71468-89ec-428c-8f16-b7ff9ff61c35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:27.304326 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-86d71468-89ec-428c-8f16-b7ff9ff61c35 None None] MFA Rules not processed for user `17187901d9e04a368673e5f8c00777a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:42:27.305542 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-86d71468-89ec-428c-8f16-b7ff9ff61c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:42:27.389620 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 993/1991] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:42:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:42:27.394180 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15908ce9-1587-4b0c-9b60-ac2b43cf1e72 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:27.408441 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:42:27.461882 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15908ce9-1587-4b0c-9b60-ac2b43cf1e72 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:27.466899 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b6125b-b5d4-42d6-beaa-9ab89490d4f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:27.467520 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b6125b-b5d4-42d6-beaa-9ab89490d4f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:27.467803 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b6125b-b5d4-42d6-beaa-9ab89490d4f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:27.468078 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b6125b-b5d4-42d6-beaa-9ab89490d4f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:27.468785 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b6125b-b5d4-42d6-beaa-9ab89490d4f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:27.470730 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b6125b-b5d4-42d6-beaa-9ab89490d4f2 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:27.498259 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 999/1992] 10.222.0.70 () {60 vars in 1153 bytes} [Tue Aug 2 21:42:27 2022] POST /identity/v3/projects => generated 375 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:42:27.502935 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d71468-89ec-428c-8f16-b7ff9ff61c35 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:27.513787 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d71468-89ec-428c-8f16-b7ff9ff61c35 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:27.569855 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bee3577-e020-4990-8ff0-b6dd0d61d3d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:27.570479 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee3577-e020-4990-8ff0-b6dd0d61d3d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:27.570766 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee3577-e020-4990-8ff0-b6dd0d61d3d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:27.571046 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee3577-e020-4990-8ff0-b6dd0d61d3d2 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:27.571723 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bee3577-e020-4990-8ff0-b6dd0d61d3d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:27.573685 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bee3577-e020-4990-8ff0-b6dd0d61d3d2 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:27.594663 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 994/1993] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 2 21:42:27 2022] POST /identity/v3/users => generated 294 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 21:42:27.599163 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b6125b-b5d4-42d6-beaa-9ab89490d4f2 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:27.609669 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b6125b-b5d4-42d6-beaa-9ab89490d4f2 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:27.614871 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf02492-81be-48a3-9c91-119a31d2bfaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:27.615482 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf02492-81be-48a3-9c91-119a31d2bfaf admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:27.615765 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf02492-81be-48a3-9c91-119a31d2bfaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:27.616070 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf02492-81be-48a3-9c91-119a31d2bfaf admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:27.616794 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf02492-81be-48a3-9c91-119a31d2bfaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:27.618405 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf02492-81be-48a3-9c91-119a31d2bfaf admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:27.640677 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1000/1994] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:42:27 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:42:27.641904 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bee3577-e020-4990-8ff0-b6dd0d61d3d2 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:27.654215 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bee3577-e020-4990-8ff0-b6dd0d61d3d2 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:27.659913 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c69a27-f25c-4806-841e-cc429bf37f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:27.660564 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c69a27-f25c-4806-841e-cc429bf37f1a admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:27.660853 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c69a27-f25c-4806-841e-cc429bf37f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:27.661136 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c69a27-f25c-4806-841e-cc429bf37f1a admin admin] PATH_INFO: `/v3/projects/41c378216f224074bfdd5395d3c6e0b7/users/a64b29a14e1f44f5a7cf6e45b4b2e35e/roles/3e32dbf75f9b41f5adb9fe59851267bb` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:27.678206 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c69a27-f25c-4806-841e-cc429bf37f1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=41c378216f224074bfdd5395d3c6e0b7, user_id=a64b29a14e1f44f5a7cf6e45b4b2e35e, role_id=3e32dbf75f9b41f5adb9fe59851267bb)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:27.680976 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c69a27-f25c-4806-841e-cc429bf37f1a admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:27.689489 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:42:27.696625 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 995/1995] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:42:27 2022] PUT /identity/v3/projects/41c378216f224074bfdd5395d3c6e0b7/users/a64b29a14e1f44f5a7cf6e45b4b2e35e/roles/3e32dbf75f9b41f5adb9fe59851267bb => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:42:27.700360 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf02492-81be-48a3-9c91-119a31d2bfaf admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:27.710402 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf02492-81be-48a3-9c91-119a31d2bfaf admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:27.771125 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36ada1e-4771-4ccf-874f-95f27c67d58a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:27.771879 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ada1e-4771-4ccf-874f-95f27c67d58a admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:27.772167 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ada1e-4771-4ccf-874f-95f27c67d58a admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:27.772491 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ada1e-4771-4ccf-874f-95f27c67d58a admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:27.773677 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36ada1e-4771-4ccf-874f-95f27c67d58a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:27.775291 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36ada1e-4771-4ccf-874f-95f27c67d58a admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:27.786886 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1001/1996] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:42:27 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:42:27.790923 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c69a27-f25c-4806-841e-cc429bf37f1a admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:27.802064 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c69a27-f25c-4806-841e-cc429bf37f1a admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:27.806601 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b92ae89-7eb5-4c49-998b-ff1c8e48f7d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:27.807294 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b92ae89-7eb5-4c49-998b-ff1c8e48f7d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:27.807584 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b92ae89-7eb5-4c49-998b-ff1c8e48f7d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:27.807867 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b92ae89-7eb5-4c49-998b-ff1c8e48f7d3 admin admin] PATH_INFO: `/v3/projects/41c378216f224074bfdd5395d3c6e0b7/users/a64b29a14e1f44f5a7cf6e45b4b2e35e/roles/3e32dbf75f9b41f5adb9fe59851267bb` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:27.809882 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b92ae89-7eb5-4c49-998b-ff1c8e48f7d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41c378216f224074bfdd5395d3c6e0b7, user_id=a64b29a14e1f44f5a7cf6e45b4b2e35e, role_id=3e32dbf75f9b41f5adb9fe59851267bb)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:27.812607 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b92ae89-7eb5-4c49-998b-ff1c8e48f7d3 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:27.822913 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 996/1997] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:42:27 2022] PUT /identity/v3/projects/41c378216f224074bfdd5395d3c6e0b7/users/a64b29a14e1f44f5a7cf6e45b4b2e35e/roles/3e32dbf75f9b41f5adb9fe59851267bb => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:42:27.833328 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aff924c-383f-425c-9c46-51c12444bae4 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:27.833656 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aff924c-383f-425c-9c46-51c12444bae4 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:27.834009 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aff924c-383f-425c-9c46-51c12444bae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:27.863544 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-3aff924c-383f-425c-9c46-51c12444bae4 None None] MFA Rules not processed for user `a64b29a14e1f44f5a7cf6e45b4b2e35e`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:42:27.864797 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-3aff924c-383f-425c-9c46-51c12444bae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:42:27.944531 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1002/1998] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:42:27 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:42:27.956746 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b92ae89-7eb5-4c49-998b-ff1c8e48f7d3 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:27.958510 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-1b92ae89-7eb5-4c49-998b-ff1c8e48f7d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:42:28.020514 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b92ae89-7eb5-4c49-998b-ff1c8e48f7d3 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:28.024117 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2046e575-fea5-43f3-b59a-5c2c9e0a5da1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '123eb76f95ee4e39905944da701c712d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:28.024804 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2046e575-fea5-43f3-b59a-5c2c9e0a5da1 service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:28.025090 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2046e575-fea5-43f3-b59a-5c2c9e0a5da1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:28.025369 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2046e575-fea5-43f3-b59a-5c2c9e0a5da1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:28.080672 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2046e575-fea5-43f3-b59a-5c2c9e0a5da1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:28.082115 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2046e575-fea5-43f3-b59a-5c2c9e0a5da1 service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:28.091004 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 997/1999] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:42:27 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:42:30.724816 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aff924c-383f-425c-9c46-51c12444bae4 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:30.739615 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:42:30.811544 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aff924c-383f-425c-9c46-51c12444bae4 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:30.822116 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf12502-975f-4544-9ee6-5999f0a74f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:30.823016 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf12502-975f-4544-9ee6-5999f0a74f61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:30.823313 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf12502-975f-4544-9ee6-5999f0a74f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:30.823647 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf12502-975f-4544-9ee6-5999f0a74f61 admin admin] PATH_INFO: `/v3/users/17187901d9e04a368673e5f8c00777a5` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:30.825006 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf12502-975f-4544-9ee6-5999f0a74f61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17187901d9e04a368673e5f8c00777a5)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:30.827234 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf12502-975f-4544-9ee6-5999f0a74f61 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:30.895207 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-adf12502-975f-4544-9ee6-5999f0a74f61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17187901d9e04a368673e5f8c00777a5'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:30.907713 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-adf12502-975f-4544-9ee6-5999f0a74f61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17187901d9e04a368673e5f8c00777a5'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:30.922505 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-adf12502-975f-4544-9ee6-5999f0a74f61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17187901d9e04a368673e5f8c00777a5'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:30.930526 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-adf12502-975f-4544-9ee6-5999f0a74f61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17187901d9e04a368673e5f8c00777a5'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:30.931269 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-adf12502-975f-4544-9ee6-5999f0a74f61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17187901d9e04a368673e5f8c00777a5'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:30.943147 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1003/2000] 10.222.0.70 () {58 vars in 1224 bytes} [Tue Aug 2 21:42:30 2022] DELETE /identity/v3/users/17187901d9e04a368673e5f8c00777a5 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:42:30.943298 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2753da-687c-434c-8146-3499148cbc86 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:30.943298 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2753da-687c-434c-8146-3499148cbc86 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:30.943811 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2753da-687c-434c-8146-3499148cbc86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:30.964027 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-5c2753da-687c-434c-8146-3499148cbc86 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:42:30.965579 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-5c2753da-687c-434c-8146-3499148cbc86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:42:31.037310 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 998/2001] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:42:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:42:31.047028 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf12502-975f-4544-9ee6-5999f0a74f61 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:31.049694 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-adf12502-975f-4544-9ee6-5999f0a74f61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:42:31.114194 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf12502-975f-4544-9ee6-5999f0a74f61 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:31.119988 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d342620-8540-4d29-89ca-f62cab36f7a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '723f5f43572a493dae0349070a2adb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:31.120770 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d342620-8540-4d29-89ca-f62cab36f7a8 service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:31.121063 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d342620-8540-4d29-89ca-f62cab36f7a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:31.121340 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d342620-8540-4d29-89ca-f62cab36f7a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:31.131472 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d342620-8540-4d29-89ca-f62cab36f7a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:31.132970 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d342620-8540-4d29-89ca-f62cab36f7a8 service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:31.143335 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1004/2002] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:42:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:42:31.459930 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2753da-687c-434c-8146-3499148cbc86 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:31.459930 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-5c2753da-687c-434c-8146-3499148cbc86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:42:31.467573 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2753da-687c-434c-8146-3499148cbc86 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:31.473875 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21757eb-e980-41f6-b682-f037fa9022c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:31.474538 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21757eb-e980-41f6-b682-f037fa9022c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:31.474823 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21757eb-e980-41f6-b682-f037fa9022c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:31.475086 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21757eb-e980-41f6-b682-f037fa9022c4 admin admin] PATH_INFO: `/v3/projects/a587626f362f4683b3cc7859a3c7e707` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:31.476257 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21757eb-e980-41f6-b682-f037fa9022c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a587626f362f4683b3cc7859a3c7e707)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:31.478198 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21757eb-e980-41f6-b682-f037fa9022c4 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:31.517332 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:42:31.529176 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-d21757eb-e980-41f6-b682-f037fa9022c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a587626f362f4683b3cc7859a3c7e707', 'request_id': 'req-d21757eb-e980-41f6-b682-f037fa9022c4'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:31.536902 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-d21757eb-e980-41f6-b682-f037fa9022c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a587626f362f4683b3cc7859a3c7e707', 'request_id': 'req-d21757eb-e980-41f6-b682-f037fa9022c4'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:31.542694 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-d21757eb-e980-41f6-b682-f037fa9022c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a587626f362f4683b3cc7859a3c7e707', 'request_id': 'req-d21757eb-e980-41f6-b682-f037fa9022c4'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:31.554507 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-d21757eb-e980-41f6-b682-f037fa9022c4 admin admin] The token cache is being invalidate because project a587626f362f4683b3cc7859a3c7e707 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:42:31.554798 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-d21757eb-e980-41f6-b682-f037fa9022c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:31.555438 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-d21757eb-e980-41f6-b682-f037fa9022c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:31.556983 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 999/2003] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Aug 2 21:42:31 2022] DELETE /identity/v3/projects/a587626f362f4683b3cc7859a3c7e707 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:42:31.561112 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d342620-8540-4d29-89ca-f62cab36f7a8 service neutron] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:31.570920 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d342620-8540-4d29-89ca-f62cab36f7a8 service neutron] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:31.596852 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:42:31.630035 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be225d91-b010-4d79-b62f-f64253a3a05c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:31.630606 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be225d91-b010-4d79-b62f-f64253a3a05c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:31.630891 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be225d91-b010-4d79-b62f-f64253a3a05c admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:31.631172 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be225d91-b010-4d79-b62f-f64253a3a05c admin admin] PATH_INFO: `/v3/users/a64b29a14e1f44f5a7cf6e45b4b2e35e` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:31.632370 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be225d91-b010-4d79-b62f-f64253a3a05c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a64b29a14e1f44f5a7cf6e45b4b2e35e)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:31.634297 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be225d91-b010-4d79-b62f-f64253a3a05c admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:31.679726 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-be225d91-b010-4d79-b62f-f64253a3a05c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a64b29a14e1f44f5a7cf6e45b4b2e35e'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:31.688116 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-be225d91-b010-4d79-b62f-f64253a3a05c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a64b29a14e1f44f5a7cf6e45b4b2e35e'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:31.700103 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-be225d91-b010-4d79-b62f-f64253a3a05c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a64b29a14e1f44f5a7cf6e45b4b2e35e'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:31.707415 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-be225d91-b010-4d79-b62f-f64253a3a05c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a64b29a14e1f44f5a7cf6e45b4b2e35e'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:31.708057 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-be225d91-b010-4d79-b62f-f64253a3a05c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a64b29a14e1f44f5a7cf6e45b4b2e35e'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:31.713891 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1005/2004] 10.222.0.70 () {58 vars in 1224 bytes} [Tue Aug 2 21:42:31 2022] DELETE /identity/v3/users/a64b29a14e1f44f5a7cf6e45b4b2e35e => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:42:32.080625 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21757eb-e980-41f6-b682-f037fa9022c4 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:32.083009 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-d21757eb-e980-41f6-b682-f037fa9022c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:42:32.108723 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21757eb-e980-41f6-b682-f037fa9022c4 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:32.202128 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea8c7e3-b380-429b-8615-3f1c453e0622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:32.203461 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea8c7e3-b380-429b-8615-3f1c453e0622 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:32.203658 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea8c7e3-b380-429b-8615-3f1c453e0622 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:32.203945 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea8c7e3-b380-429b-8615-3f1c453e0622 admin admin] PATH_INFO: `/v3/projects/41c378216f224074bfdd5395d3c6e0b7` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:32.205921 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea8c7e3-b380-429b-8615-3f1c453e0622 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41c378216f224074bfdd5395d3c6e0b7)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:32.209289 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea8c7e3-b380-429b-8615-3f1c453e0622 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:32.273630 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-0ea8c7e3-b380-429b-8615-3f1c453e0622 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41c378216f224074bfdd5395d3c6e0b7', 'request_id': 'req-0ea8c7e3-b380-429b-8615-3f1c453e0622'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:32.283005 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-0ea8c7e3-b380-429b-8615-3f1c453e0622 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41c378216f224074bfdd5395d3c6e0b7', 'request_id': 'req-0ea8c7e3-b380-429b-8615-3f1c453e0622'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:32.294514 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-0ea8c7e3-b380-429b-8615-3f1c453e0622 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41c378216f224074bfdd5395d3c6e0b7', 'request_id': 'req-0ea8c7e3-b380-429b-8615-3f1c453e0622'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:32.306053 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-0ea8c7e3-b380-429b-8615-3f1c453e0622 admin admin] The token cache is being invalidate because project 41c378216f224074bfdd5395d3c6e0b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:42:32.306343 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-0ea8c7e3-b380-429b-8615-3f1c453e0622 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:32.306998 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-0ea8c7e3-b380-429b-8615-3f1c453e0622 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:32.308591 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1000/2005] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Aug 2 21:42:32 2022] DELETE /identity/v3/projects/41c378216f224074bfdd5395d3c6e0b7 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:42:32.313425 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d15e745-3683-4fe1-8c5f-3ef222c2d88c None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:32.314400 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d15e745-3683-4fe1-8c5f-3ef222c2d88c None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:32.315062 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d15e745-3683-4fe1-8c5f-3ef222c2d88c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:32.337833 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-9d15e745-3683-4fe1-8c5f-3ef222c2d88c None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:42:32.339058 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-9d15e745-3683-4fe1-8c5f-3ef222c2d88c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:42:32.400154 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1006/2006] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:42:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:42:32.407866 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3409b093-6dd1-4945-b021-68bb44617e16 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:32.408155 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3409b093-6dd1-4945-b021-68bb44617e16 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:32.408472 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3409b093-6dd1-4945-b021-68bb44617e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:32.428636 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-3409b093-6dd1-4945-b021-68bb44617e16 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:42:32.429879 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-3409b093-6dd1-4945-b021-68bb44617e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:42:32.437806 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1001/2007] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:42:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:42:32.442566 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d15e745-3683-4fe1-8c5f-3ef222c2d88c None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:32.452122 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d15e745-3683-4fe1-8c5f-3ef222c2d88c None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:32.456763 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ed9286-3c41-4296-939e-2e4a7a7975de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:32.457553 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ed9286-3c41-4296-939e-2e4a7a7975de admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:32.457833 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ed9286-3c41-4296-939e-2e4a7a7975de admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:32.458133 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ed9286-3c41-4296-939e-2e4a7a7975de admin admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:32.458822 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ed9286-3c41-4296-939e-2e4a7a7975de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:42:32.459126 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ed9286-3c41-4296-939e-2e4a7a7975de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:32.460765 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ed9286-3c41-4296-939e-2e4a7a7975de admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:32.476667 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1007/2008] 10.222.0.70 () {58 vars in 1153 bytes} [Tue Aug 2 21:42:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:42:32.480971 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3409b093-6dd1-4945-b021-68bb44617e16 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:32.491989 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3409b093-6dd1-4945-b021-68bb44617e16 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:32.497569 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384d6c6b-f750-4ff3-9e7d-42c5c3a5e9d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:32.498189 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384d6c6b-f750-4ff3-9e7d-42c5c3a5e9d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:32.498473 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384d6c6b-f750-4ff3-9e7d-42c5c3a5e9d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:32.498752 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384d6c6b-f750-4ff3-9e7d-42c5c3a5e9d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:32.499417 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384d6c6b-f750-4ff3-9e7d-42c5c3a5e9d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:32.501437 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384d6c6b-f750-4ff3-9e7d-42c5c3a5e9d9 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:32.530407 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1002/2009] 10.222.0.70 () {60 vars in 1153 bytes} [Tue Aug 2 21:42:32 2022] POST /identity/v3/projects => generated 365 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 21:42:32.534581 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ed9286-3c41-4296-939e-2e4a7a7975de admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:32.545724 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ed9286-3c41-4296-939e-2e4a7a7975de admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:32.581568 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:42:32.609197 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbed3973-21b1-40fb-acf5-60bb9bbf0488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:32.609861 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbed3973-21b1-40fb-acf5-60bb9bbf0488 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:32.610144 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbed3973-21b1-40fb-acf5-60bb9bbf0488 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:32.610417 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbed3973-21b1-40fb-acf5-60bb9bbf0488 admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:32.611638 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbed3973-21b1-40fb-acf5-60bb9bbf0488 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:32.613770 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbed3973-21b1-40fb-acf5-60bb9bbf0488 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:32.635736 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1008/2010] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 2 21:42:32 2022] POST /identity/v3/users => generated 283 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:42:32.640670 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384d6c6b-f750-4ff3-9e7d-42c5c3a5e9d9 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:32.651636 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384d6c6b-f750-4ff3-9e7d-42c5c3a5e9d9 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:32.656224 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cfdab6-2548-4bd2-9187-fe4fbf779f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:32.656867 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cfdab6-2548-4bd2-9187-fe4fbf779f51 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:32.657153 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cfdab6-2548-4bd2-9187-fe4fbf779f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:32.657433 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cfdab6-2548-4bd2-9187-fe4fbf779f51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:32.658202 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cfdab6-2548-4bd2-9187-fe4fbf779f51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:32.659800 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cfdab6-2548-4bd2-9187-fe4fbf779f51 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:32.669886 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1003/2011] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:42:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:42:32.674441 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbed3973-21b1-40fb-acf5-60bb9bbf0488 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:32.684323 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbed3973-21b1-40fb-acf5-60bb9bbf0488 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:32.689026 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea20665f-03dc-42fe-b207-45b251bb6625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:32.690320 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea20665f-03dc-42fe-b207-45b251bb6625 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:32.690615 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea20665f-03dc-42fe-b207-45b251bb6625 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:32.690898 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea20665f-03dc-42fe-b207-45b251bb6625 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:32.691594 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea20665f-03dc-42fe-b207-45b251bb6625 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:32.693235 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea20665f-03dc-42fe-b207-45b251bb6625 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:32.703207 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1009/2012] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:42:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:42:32.707513 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cfdab6-2548-4bd2-9187-fe4fbf779f51 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:32.717951 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cfdab6-2548-4bd2-9187-fe4fbf779f51 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:32.722905 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdb2186-497f-4d07-bba4-e11239fbd49a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:32.723562 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb2186-497f-4d07-bba4-e11239fbd49a admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:32.723847 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb2186-497f-4d07-bba4-e11239fbd49a admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:32.724129 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdb2186-497f-4d07-bba4-e11239fbd49a admin admin] PATH_INFO: `/v3/projects/9533341ef961418e8f3f3f221c89842d/users/45454e51dd64431eac6654c20f6526b3/roles/462e3381a85c42a9959201f9aa122f7c` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:32.737509 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:42:32.743296 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdb2186-497f-4d07-bba4-e11239fbd49a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9533341ef961418e8f3f3f221c89842d, user_id=45454e51dd64431eac6654c20f6526b3, role_id=462e3381a85c42a9959201f9aa122f7c)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:32.746513 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdb2186-497f-4d07-bba4-e11239fbd49a admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:32.760203 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1004/2013] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:42:32 2022] PUT /identity/v3/projects/9533341ef961418e8f3f3f221c89842d/users/45454e51dd64431eac6654c20f6526b3/roles/462e3381a85c42a9959201f9aa122f7c => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:42:32.771970 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae998753-dfc4-4ede-b924-3bec5475e592 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:32.772283 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae998753-dfc4-4ede-b924-3bec5475e592 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:32.772570 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae998753-dfc4-4ede-b924-3bec5475e592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:32.800906 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-ae998753-dfc4-4ede-b924-3bec5475e592 None None] MFA Rules not processed for user `45454e51dd64431eac6654c20f6526b3`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:42:32.802238 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-ae998753-dfc4-4ede-b924-3bec5475e592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:42:32.867621 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1010/2014] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:42:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:42:32.879752 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdb2186-497f-4d07-bba4-e11239fbd49a admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:32.881460 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-3cdb2186-497f-4d07-bba4-e11239fbd49a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:42:32.938103 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdb2186-497f-4d07-bba4-e11239fbd49a admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:32.941739 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c3a731-edb9-4af6-8b7c-b3f98d7779fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '123eb76f95ee4e39905944da701c712d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:32.942362 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c3a731-edb9-4af6-8b7c-b3f98d7779fc service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:32.942651 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c3a731-edb9-4af6-8b7c-b3f98d7779fc service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:32.942932 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c3a731-edb9-4af6-8b7c-b3f98d7779fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:32.951282 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c3a731-edb9-4af6-8b7c-b3f98d7779fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:32.952776 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c3a731-edb9-4af6-8b7c-b3f98d7779fc service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:32.962146 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1005/2015] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:42:32 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:42:34.355371 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae998753-dfc4-4ede-b924-3bec5475e592 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:34.356787 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-ae998753-dfc4-4ede-b924-3bec5475e592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:42:34.423206 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae998753-dfc4-4ede-b924-3bec5475e592 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:34.427806 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44592b3c-eeb2-47f7-a3d0-794c7c30f866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:34.428472 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44592b3c-eeb2-47f7-a3d0-794c7c30f866 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:34.428752 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44592b3c-eeb2-47f7-a3d0-794c7c30f866 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:34.429028 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44592b3c-eeb2-47f7-a3d0-794c7c30f866 admin admin] PATH_INFO: `/v3/users/952d35e9b0d343b6a6fa65426727de10` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:34.430190 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44592b3c-eeb2-47f7-a3d0-794c7c30f866 admin admin] RBAC: Authorizing `identity:delete_user(user_id=952d35e9b0d343b6a6fa65426727de10)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:34.432095 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44592b3c-eeb2-47f7-a3d0-794c7c30f866 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:34.478906 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:42:34.480474 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-44592b3c-eeb2-47f7-a3d0-794c7c30f866 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '952d35e9b0d343b6a6fa65426727de10'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:34.489085 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-44592b3c-eeb2-47f7-a3d0-794c7c30f866 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '952d35e9b0d343b6a6fa65426727de10'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:34.501179 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-44592b3c-eeb2-47f7-a3d0-794c7c30f866 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '952d35e9b0d343b6a6fa65426727de10'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:34.513164 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-44592b3c-eeb2-47f7-a3d0-794c7c30f866 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '952d35e9b0d343b6a6fa65426727de10'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:34.513882 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-44592b3c-eeb2-47f7-a3d0-794c7c30f866 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '952d35e9b0d343b6a6fa65426727de10'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:34.520680 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1011/2016] 10.222.0.70 () {58 vars in 1224 bytes} [Tue Aug 2 21:42:34 2022] DELETE /identity/v3/users/952d35e9b0d343b6a6fa65426727de10 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:42:34.525233 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05a3ac3-4f70-43cd-89e5-1bf53abbd3b2 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:34.525688 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05a3ac3-4f70-43cd-89e5-1bf53abbd3b2 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:34.525791 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05a3ac3-4f70-43cd-89e5-1bf53abbd3b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:34.549300 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-e05a3ac3-4f70-43cd-89e5-1bf53abbd3b2 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:42:34.550389 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-e05a3ac3-4f70-43cd-89e5-1bf53abbd3b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:42:34.623181 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1006/2017] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:42:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:42:34.633930 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44592b3c-eeb2-47f7-a3d0-794c7c30f866 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:34.635604 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-44592b3c-eeb2-47f7-a3d0-794c7c30f866 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:42:34.718875 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44592b3c-eeb2-47f7-a3d0-794c7c30f866 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:34.722871 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e33490-fc13-4030-bf3e-f2f264e92bf2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '723f5f43572a493dae0349070a2adb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:34.723503 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e33490-fc13-4030-bf3e-f2f264e92bf2 service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:34.723787 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e33490-fc13-4030-bf3e-f2f264e92bf2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:34.724066 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e33490-fc13-4030-bf3e-f2f264e92bf2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:34.734250 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e33490-fc13-4030-bf3e-f2f264e92bf2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:34.736260 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e33490-fc13-4030-bf3e-f2f264e92bf2 service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:34.746935 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1012/2018] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:42:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:42:35.187330 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05a3ac3-4f70-43cd-89e5-1bf53abbd3b2 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:35.189353 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-e05a3ac3-4f70-43cd-89e5-1bf53abbd3b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:42:35.201291 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05a3ac3-4f70-43cd-89e5-1bf53abbd3b2 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:35.206198 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6939ddd5-897c-4f48-bd25-d8b5d3271df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:35.206847 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6939ddd5-897c-4f48-bd25-d8b5d3271df0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:35.207134 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6939ddd5-897c-4f48-bd25-d8b5d3271df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:35.207406 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6939ddd5-897c-4f48-bd25-d8b5d3271df0 admin admin] PATH_INFO: `/v3/projects/2e4182276f0f4fa48f1d91ed753b54ff` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:35.208627 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6939ddd5-897c-4f48-bd25-d8b5d3271df0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e4182276f0f4fa48f1d91ed753b54ff)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:35.210552 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6939ddd5-897c-4f48-bd25-d8b5d3271df0 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:35.258567 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-6939ddd5-897c-4f48-bd25-d8b5d3271df0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e4182276f0f4fa48f1d91ed753b54ff', 'request_id': 'req-6939ddd5-897c-4f48-bd25-d8b5d3271df0'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:35.265959 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-6939ddd5-897c-4f48-bd25-d8b5d3271df0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e4182276f0f4fa48f1d91ed753b54ff', 'request_id': 'req-6939ddd5-897c-4f48-bd25-d8b5d3271df0'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:35.272652 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-6939ddd5-897c-4f48-bd25-d8b5d3271df0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e4182276f0f4fa48f1d91ed753b54ff', 'request_id': 'req-6939ddd5-897c-4f48-bd25-d8b5d3271df0'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:35.286241 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-6939ddd5-897c-4f48-bd25-d8b5d3271df0 admin admin] The token cache is being invalidate because project 2e4182276f0f4fa48f1d91ed753b54ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:42:35.286241 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-6939ddd5-897c-4f48-bd25-d8b5d3271df0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:35.286241 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-6939ddd5-897c-4f48-bd25-d8b5d3271df0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:35.286241 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1007/2019] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Aug 2 21:42:35 2022] DELETE /identity/v3/projects/2e4182276f0f4fa48f1d91ed753b54ff => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:42:35.290887 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4af4a2d-4e64-4d33-9b02-fe920cdd767a None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:35.291249 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4af4a2d-4e64-4d33-9b02-fe920cdd767a None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:35.291598 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4af4a2d-4e64-4d33-9b02-fe920cdd767a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:35.311042 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-f4af4a2d-4e64-4d33-9b02-fe920cdd767a None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:42:35.312270 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-f4af4a2d-4e64-4d33-9b02-fe920cdd767a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:42:35.373584 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1013/2020] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:42:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:42:35.382797 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7097803d-f9ee-4398-a1f7-7be30934444d None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:35.383087 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7097803d-f9ee-4398-a1f7-7be30934444d None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:35.383369 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7097803d-f9ee-4398-a1f7-7be30934444d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:35.403440 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-7097803d-f9ee-4398-a1f7-7be30934444d None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:42:35.404684 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-7097803d-f9ee-4398-a1f7-7be30934444d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:42:35.413284 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1008/2021] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:42:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:42:35.419160 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4af4a2d-4e64-4d33-9b02-fe920cdd767a None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:35.431065 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4af4a2d-4e64-4d33-9b02-fe920cdd767a None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:35.436027 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0558780-8246-4d63-b2eb-011ad5d940a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:35.436677 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0558780-8246-4d63-b2eb-011ad5d940a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:35.436981 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0558780-8246-4d63-b2eb-011ad5d940a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:35.437283 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0558780-8246-4d63-b2eb-011ad5d940a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:35.438093 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0558780-8246-4d63-b2eb-011ad5d940a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:42:35.438434 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0558780-8246-4d63-b2eb-011ad5d940a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:35.440046 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0558780-8246-4d63-b2eb-011ad5d940a3 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:35.451999 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1014/2022] 10.222.0.70 () {58 vars in 1153 bytes} [Tue Aug 2 21:42:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:42:35.457077 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7097803d-f9ee-4398-a1f7-7be30934444d None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:35.466511 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7097803d-f9ee-4398-a1f7-7be30934444d None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:35.471712 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a352b2-a9c8-4835-ae86-a14897d36d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:35.472355 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a352b2-a9c8-4835-ae86-a14897d36d05 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:35.472642 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a352b2-a9c8-4835-ae86-a14897d36d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:35.472926 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a352b2-a9c8-4835-ae86-a14897d36d05 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:35.473605 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a352b2-a9c8-4835-ae86-a14897d36d05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:35.475514 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a352b2-a9c8-4835-ae86-a14897d36d05 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:35.481136 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:42:35.503651 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1009/2023] 10.222.0.70 () {60 vars in 1153 bytes} [Tue Aug 2 21:42:35 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:42:35.507827 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0558780-8246-4d63-b2eb-011ad5d940a3 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:35.518244 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0558780-8246-4d63-b2eb-011ad5d940a3 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:35.579752 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:42:35.590793 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca89598-ef9b-4857-ae85-93c0b11c06ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:35.591429 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca89598-ef9b-4857-ae85-93c0b11c06ce admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:35.591716 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca89598-ef9b-4857-ae85-93c0b11c06ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:35.591998 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca89598-ef9b-4857-ae85-93c0b11c06ce admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:35.592799 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca89598-ef9b-4857-ae85-93c0b11c06ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:35.594762 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca89598-ef9b-4857-ae85-93c0b11c06ce admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:35.617284 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1015/2024] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 2 21:42:35 2022] POST /identity/v3/users => generated 287 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:42:35.621582 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a352b2-a9c8-4835-ae86-a14897d36d05 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:35.632041 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a352b2-a9c8-4835-ae86-a14897d36d05 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:35.636521 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ae22d6-e7a4-4785-81ce-e3f087387174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:35.637129 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ae22d6-e7a4-4785-81ce-e3f087387174 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:35.637413 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ae22d6-e7a4-4785-81ce-e3f087387174 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:35.637685 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ae22d6-e7a4-4785-81ce-e3f087387174 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:35.638419 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ae22d6-e7a4-4785-81ce-e3f087387174 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:35.639996 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ae22d6-e7a4-4785-81ce-e3f087387174 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:35.650325 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1010/2025] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:42:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:42:35.654207 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca89598-ef9b-4857-ae85-93c0b11c06ce admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:35.664799 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca89598-ef9b-4857-ae85-93c0b11c06ce admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:35.669573 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc25b145-515d-4a89-b5e1-9b4f43dd0d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:35.670188 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc25b145-515d-4a89-b5e1-9b4f43dd0d87 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:35.670475 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc25b145-515d-4a89-b5e1-9b4f43dd0d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:35.670762 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc25b145-515d-4a89-b5e1-9b4f43dd0d87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:35.671564 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc25b145-515d-4a89-b5e1-9b4f43dd0d87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:35.673239 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc25b145-515d-4a89-b5e1-9b4f43dd0d87 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:35.683708 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1016/2026] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:42:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:42:35.687710 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ae22d6-e7a4-4785-81ce-e3f087387174 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:35.697752 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ae22d6-e7a4-4785-81ce-e3f087387174 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:35.702608 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c53924b-8e7d-4278-be0e-ee477c99ea6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:35.703498 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c53924b-8e7d-4278-be0e-ee477c99ea6e admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:35.703973 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c53924b-8e7d-4278-be0e-ee477c99ea6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:35.705058 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c53924b-8e7d-4278-be0e-ee477c99ea6e admin admin] PATH_INFO: `/v3/projects/663bb93b21194177a51eb4eca17a5872/users/34eb2c0300a141fdbf5560939a6978fc/roles/462e3381a85c42a9959201f9aa122f7c` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:35.723936 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c53924b-8e7d-4278-be0e-ee477c99ea6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=663bb93b21194177a51eb4eca17a5872, user_id=34eb2c0300a141fdbf5560939a6978fc, role_id=462e3381a85c42a9959201f9aa122f7c)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:35.726796 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c53924b-8e7d-4278-be0e-ee477c99ea6e admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:35.742242 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1011/2027] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:42:35 2022] PUT /identity/v3/projects/663bb93b21194177a51eb4eca17a5872/users/34eb2c0300a141fdbf5560939a6978fc/roles/462e3381a85c42a9959201f9aa122f7c => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:42:35.752708 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4487f40-9765-4fbb-b0be-55d7d784de99 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:35.753001 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4487f40-9765-4fbb-b0be-55d7d784de99 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:35.753282 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4487f40-9765-4fbb-b0be-55d7d784de99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:35.784215 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-b4487f40-9765-4fbb-b0be-55d7d784de99 None None] MFA Rules not processed for user `34eb2c0300a141fdbf5560939a6978fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:42:35.785599 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-b4487f40-9765-4fbb-b0be-55d7d784de99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:42:35.854501 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1017/2028] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:42:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:42:35.866666 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c53924b-8e7d-4278-be0e-ee477c99ea6e admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:35.868442 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-4c53924b-8e7d-4278-be0e-ee477c99ea6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:42:35.946587 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c53924b-8e7d-4278-be0e-ee477c99ea6e admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:35.953773 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e932a54-d3aa-4e4a-8914-1bdbcabb60a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87dd5c1c5e854d4b96e0b7dad6aa3719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:35.955837 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e932a54-d3aa-4e4a-8914-1bdbcabb60a2 service nova] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:35.956149 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e932a54-d3aa-4e4a-8914-1bdbcabb60a2 service nova] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:35.956479 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e932a54-d3aa-4e4a-8914-1bdbcabb60a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:35.967434 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e932a54-d3aa-4e4a-8914-1bdbcabb60a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:35.969244 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e932a54-d3aa-4e4a-8914-1bdbcabb60a2 service nova] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:35.978990 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1012/2029] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:42:35 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:42:36.260935 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4487f40-9765-4fbb-b0be-55d7d784de99 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:36.386967 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4487f40-9765-4fbb-b0be-55d7d784de99 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:36.393382 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd16f65a-8ce3-4b01-b592-95644590bb7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:36.394044 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd16f65a-8ce3-4b01-b592-95644590bb7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:36.394328 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd16f65a-8ce3-4b01-b592-95644590bb7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:36.394607 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd16f65a-8ce3-4b01-b592-95644590bb7a admin admin] PATH_INFO: `/v3/users/34eb2c0300a141fdbf5560939a6978fc` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:36.395820 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd16f65a-8ce3-4b01-b592-95644590bb7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=34eb2c0300a141fdbf5560939a6978fc)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:36.398111 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd16f65a-8ce3-4b01-b592-95644590bb7a admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:36.450190 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-cd16f65a-8ce3-4b01-b592-95644590bb7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34eb2c0300a141fdbf5560939a6978fc'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:36.458115 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-cd16f65a-8ce3-4b01-b592-95644590bb7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34eb2c0300a141fdbf5560939a6978fc'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:36.465667 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:42:36.473690 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-cd16f65a-8ce3-4b01-b592-95644590bb7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34eb2c0300a141fdbf5560939a6978fc'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:36.481445 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-cd16f65a-8ce3-4b01-b592-95644590bb7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34eb2c0300a141fdbf5560939a6978fc'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:36.482155 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-cd16f65a-8ce3-4b01-b592-95644590bb7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34eb2c0300a141fdbf5560939a6978fc'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:36.488069 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1018/2030] 10.222.0.70 () {58 vars in 1224 bytes} [Tue Aug 2 21:42:36 2022] DELETE /identity/v3/users/34eb2c0300a141fdbf5560939a6978fc => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:42:36.492680 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55201a0e-b967-4094-a175-ed56bf385ca3 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:36.492994 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55201a0e-b967-4094-a175-ed56bf385ca3 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:36.493298 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55201a0e-b967-4094-a175-ed56bf385ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:36.512140 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-55201a0e-b967-4094-a175-ed56bf385ca3 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:42:36.513370 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-55201a0e-b967-4094-a175-ed56bf385ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:42:36.572959 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1013/2031] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:42:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:42:36.583067 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd16f65a-8ce3-4b01-b592-95644590bb7a admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:36.584684 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-cd16f65a-8ce3-4b01-b592-95644590bb7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:42:36.641823 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd16f65a-8ce3-4b01-b592-95644590bb7a admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:36.645490 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b3d321-63f1-4651-9058-e61f0d932cf0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '723f5f43572a493dae0349070a2adb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:36.646101 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b3d321-63f1-4651-9058-e61f0d932cf0 service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:36.646381 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b3d321-63f1-4651-9058-e61f0d932cf0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:36.646655 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b3d321-63f1-4651-9058-e61f0d932cf0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:36.655795 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b3d321-63f1-4651-9058-e61f0d932cf0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:36.657255 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b3d321-63f1-4651-9058-e61f0d932cf0 service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:36.667526 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1019/2032] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:42:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:42:36.947660 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55201a0e-b967-4094-a175-ed56bf385ca3 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:36.949190 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-55201a0e-b967-4094-a175-ed56bf385ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:42:36.971380 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55201a0e-b967-4094-a175-ed56bf385ca3 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:36.977723 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42128cfe-bc42-4ede-bd6a-2ce2cfef5684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:36.978483 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42128cfe-bc42-4ede-bd6a-2ce2cfef5684 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:36.978987 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42128cfe-bc42-4ede-bd6a-2ce2cfef5684 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:36.979295 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42128cfe-bc42-4ede-bd6a-2ce2cfef5684 admin admin] PATH_INFO: `/v3/projects/663bb93b21194177a51eb4eca17a5872` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:36.980532 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42128cfe-bc42-4ede-bd6a-2ce2cfef5684 admin admin] RBAC: Authorizing `identity:delete_project(project_id=663bb93b21194177a51eb4eca17a5872)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:36.982659 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42128cfe-bc42-4ede-bd6a-2ce2cfef5684 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:37.019941 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:42:37.034730 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-42128cfe-bc42-4ede-bd6a-2ce2cfef5684 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '663bb93b21194177a51eb4eca17a5872', 'request_id': 'req-42128cfe-bc42-4ede-bd6a-2ce2cfef5684'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:37.042782 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-42128cfe-bc42-4ede-bd6a-2ce2cfef5684 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '663bb93b21194177a51eb4eca17a5872', 'request_id': 'req-42128cfe-bc42-4ede-bd6a-2ce2cfef5684'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:37.049486 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-42128cfe-bc42-4ede-bd6a-2ce2cfef5684 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '663bb93b21194177a51eb4eca17a5872', 'request_id': 'req-42128cfe-bc42-4ede-bd6a-2ce2cfef5684'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:37.061193 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-42128cfe-bc42-4ede-bd6a-2ce2cfef5684 admin admin] The token cache is being invalidate because project 663bb93b21194177a51eb4eca17a5872 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:42:37.061666 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-42128cfe-bc42-4ede-bd6a-2ce2cfef5684 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:37.062402 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-42128cfe-bc42-4ede-bd6a-2ce2cfef5684 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:37.065540 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1014/2033] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Aug 2 21:42:36 2022] DELETE /identity/v3/projects/663bb93b21194177a51eb4eca17a5872 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:42:37.077265 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd669195-def4-4643-a5de-cc408f6e3b1c None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:37.077575 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd669195-def4-4643-a5de-cc408f6e3b1c None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:37.077857 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd669195-def4-4643-a5de-cc408f6e3b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:37.098416 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-dd669195-def4-4643-a5de-cc408f6e3b1c None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:42:37.099777 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-dd669195-def4-4643-a5de-cc408f6e3b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:42:37.160766 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1020/2034] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:42:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:42:37.169034 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6419d2e4-558b-4b75-b6cc-d098c0b0903a None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:37.169034 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6419d2e4-558b-4b75-b6cc-d098c0b0903a None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:37.169315 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6419d2e4-558b-4b75-b6cc-d098c0b0903a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:37.191923 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-6419d2e4-558b-4b75-b6cc-d098c0b0903a None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:42:37.193350 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-6419d2e4-558b-4b75-b6cc-d098c0b0903a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:42:37.201774 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1015/2035] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:42:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:42:37.206653 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd669195-def4-4643-a5de-cc408f6e3b1c None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:37.216498 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd669195-def4-4643-a5de-cc408f6e3b1c None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:37.221823 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b54c3c-1a3c-4776-892c-b6fd746726f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:37.222446 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b54c3c-1a3c-4776-892c-b6fd746726f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:37.222729 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b54c3c-1a3c-4776-892c-b6fd746726f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:37.223004 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b54c3c-1a3c-4776-892c-b6fd746726f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:37.223706 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b54c3c-1a3c-4776-892c-b6fd746726f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:42:37.224018 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b54c3c-1a3c-4776-892c-b6fd746726f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:37.225666 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b54c3c-1a3c-4776-892c-b6fd746726f6 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:37.238098 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1021/2036] 10.222.0.70 () {58 vars in 1153 bytes} [Tue Aug 2 21:42:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:42:37.242397 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6419d2e4-558b-4b75-b6cc-d098c0b0903a None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:37.252053 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6419d2e4-558b-4b75-b6cc-d098c0b0903a None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:37.256638 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f22611-5413-4ed3-a207-39af8797d395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:37.257258 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f22611-5413-4ed3-a207-39af8797d395 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:37.257570 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f22611-5413-4ed3-a207-39af8797d395 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:37.257810 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f22611-5413-4ed3-a207-39af8797d395 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:37.258492 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f22611-5413-4ed3-a207-39af8797d395 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:37.260428 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f22611-5413-4ed3-a207-39af8797d395 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:37.296824 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1016/2037] 10.222.0.70 () {60 vars in 1153 bytes} [Tue Aug 2 21:42:37 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:42:37.299643 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b54c3c-1a3c-4776-892c-b6fd746726f6 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:37.310146 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b54c3c-1a3c-4776-892c-b6fd746726f6 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:37.372354 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e0e1a2-d62f-4cb5-a7a2-9a374e8eee02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:37.373542 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e0e1a2-d62f-4cb5-a7a2-9a374e8eee02 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:37.374096 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e0e1a2-d62f-4cb5-a7a2-9a374e8eee02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:37.374623 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e0e1a2-d62f-4cb5-a7a2-9a374e8eee02 admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:37.375556 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e0e1a2-d62f-4cb5-a7a2-9a374e8eee02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:37.377820 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e0e1a2-d62f-4cb5-a7a2-9a374e8eee02 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:37.399399 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:42:37.405533 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1022/2038] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 2 21:42:37 2022] POST /identity/v3/users => generated 287 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:42:37.409181 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f22611-5413-4ed3-a207-39af8797d395 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:37.424472 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f22611-5413-4ed3-a207-39af8797d395 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:37.429391 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d123b16d-2a7b-4416-9e8c-bcf61f053591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:37.430025 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d123b16d-2a7b-4416-9e8c-bcf61f053591 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:37.430311 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d123b16d-2a7b-4416-9e8c-bcf61f053591 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:37.430587 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d123b16d-2a7b-4416-9e8c-bcf61f053591 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:37.431283 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d123b16d-2a7b-4416-9e8c-bcf61f053591 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:37.433989 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d123b16d-2a7b-4416-9e8c-bcf61f053591 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:37.447740 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1017/2039] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:42:37 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:42:37.452020 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e0e1a2-d62f-4cb5-a7a2-9a374e8eee02 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:37.462077 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e0e1a2-d62f-4cb5-a7a2-9a374e8eee02 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:37.467407 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b40a05-c38d-4606-beb1-d56da913b48e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:37.468151 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b40a05-c38d-4606-beb1-d56da913b48e admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:37.468504 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b40a05-c38d-4606-beb1-d56da913b48e admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:37.468885 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b40a05-c38d-4606-beb1-d56da913b48e admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:37.469573 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b40a05-c38d-4606-beb1-d56da913b48e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:37.472019 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b40a05-c38d-4606-beb1-d56da913b48e admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:37.490074 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1023/2040] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:42:37 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:42:37.494604 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d123b16d-2a7b-4416-9e8c-bcf61f053591 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:37.507165 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d123b16d-2a7b-4416-9e8c-bcf61f053591 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:37.513621 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec041d6-40bb-46e7-a147-6c4f4047bce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:37.514497 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec041d6-40bb-46e7-a147-6c4f4047bce9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:37.514844 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec041d6-40bb-46e7-a147-6c4f4047bce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:37.515153 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec041d6-40bb-46e7-a147-6c4f4047bce9 admin admin] PATH_INFO: `/v3/projects/6120936726854808973a2ad62b820165/users/f8335095460d4c37b05e4293fa698716/roles/462e3381a85c42a9959201f9aa122f7c` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:37.539403 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec041d6-40bb-46e7-a147-6c4f4047bce9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6120936726854808973a2ad62b820165, user_id=f8335095460d4c37b05e4293fa698716, role_id=462e3381a85c42a9959201f9aa122f7c)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:37.542858 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec041d6-40bb-46e7-a147-6c4f4047bce9 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:37.585306 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1018/2041] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:42:37 2022] PUT /identity/v3/projects/6120936726854808973a2ad62b820165/users/f8335095460d4c37b05e4293fa698716/roles/462e3381a85c42a9959201f9aa122f7c => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:42:37.587081 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca37c13-a331-4cf9-971f-e360ddbbc124 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:37.587377 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca37c13-a331-4cf9-971f-e360ddbbc124 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:37.587656 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca37c13-a331-4cf9-971f-e360ddbbc124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:37.618466 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-aca37c13-a331-4cf9-971f-e360ddbbc124 None None] MFA Rules not processed for user `f8335095460d4c37b05e4293fa698716`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:42:37.619776 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-aca37c13-a331-4cf9-971f-e360ddbbc124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:42:37.704120 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1024/2042] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:42:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:42:37.709963 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec041d6-40bb-46e7-a147-6c4f4047bce9 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:37.783589 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec041d6-40bb-46e7-a147-6c4f4047bce9 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:37.788690 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed435942-9f16-4b52-952a-a6172b1f4780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:37.789307 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed435942-9f16-4b52-952a-a6172b1f4780 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:37.789585 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed435942-9f16-4b52-952a-a6172b1f4780 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:37.789858 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed435942-9f16-4b52-952a-a6172b1f4780 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:37.790552 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed435942-9f16-4b52-952a-a6172b1f4780 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:37.792489 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed435942-9f16-4b52-952a-a6172b1f4780 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:37.819993 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1019/2043] 10.222.0.70 () {60 vars in 1153 bytes} [Tue Aug 2 21:42:37 2022] POST /identity/v3/projects => generated 373 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:42:37.824077 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca37c13-a331-4cf9-971f-e360ddbbc124 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:37.835362 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca37c13-a331-4cf9-971f-e360ddbbc124 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:37.892695 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5002ca-bcba-44ed-8b08-d1650a3bede6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:37.893310 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5002ca-bcba-44ed-8b08-d1650a3bede6 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:37.893591 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5002ca-bcba-44ed-8b08-d1650a3bede6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:37.893867 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5002ca-bcba-44ed-8b08-d1650a3bede6 admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:37.894540 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5002ca-bcba-44ed-8b08-d1650a3bede6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:37.896561 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5002ca-bcba-44ed-8b08-d1650a3bede6 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:37.918654 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1025/2044] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 2 21:42:37 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:42:37.922047 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed435942-9f16-4b52-952a-a6172b1f4780 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:37.933700 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed435942-9f16-4b52-952a-a6172b1f4780 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:37.937892 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c11872-ca10-4dd6-b265-fbde918b78bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:37.938511 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c11872-ca10-4dd6-b265-fbde918b78bd admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:37.939353 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c11872-ca10-4dd6-b265-fbde918b78bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:37.939646 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c11872-ca10-4dd6-b265-fbde918b78bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:37.940376 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c11872-ca10-4dd6-b265-fbde918b78bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:37.942017 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c11872-ca10-4dd6-b265-fbde918b78bd admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:37.952817 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1020/2045] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:42:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:42:37.956936 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5002ca-bcba-44ed-8b08-d1650a3bede6 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:37.966779 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5002ca-bcba-44ed-8b08-d1650a3bede6 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:37.971309 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3b8805-f885-414b-95ae-77d6b381f7af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:37.971962 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3b8805-f885-414b-95ae-77d6b381f7af admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:37.972261 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3b8805-f885-414b-95ae-77d6b381f7af admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:37.972551 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3b8805-f885-414b-95ae-77d6b381f7af admin admin] PATH_INFO: `/v3/projects/f7ddb987deae4259947f405e27c6a8c3/users/c675f6762b99429c8a5eab3910a84815/roles/3e32dbf75f9b41f5adb9fe59851267bb` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:37.990576 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3b8805-f885-414b-95ae-77d6b381f7af admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7ddb987deae4259947f405e27c6a8c3, user_id=c675f6762b99429c8a5eab3910a84815, role_id=3e32dbf75f9b41f5adb9fe59851267bb)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:37.993390 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3b8805-f885-414b-95ae-77d6b381f7af admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:38.007048 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1026/2046] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:42:37 2022] PUT /identity/v3/projects/f7ddb987deae4259947f405e27c6a8c3/users/c675f6762b99429c8a5eab3910a84815/roles/3e32dbf75f9b41f5adb9fe59851267bb => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:42:38.011002 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c11872-ca10-4dd6-b265-fbde918b78bd admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:38.021102 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c11872-ca10-4dd6-b265-fbde918b78bd admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:38.050504 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:42:38.079390 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44bbc35-86c3-47e5-b531-bc1fb1929b85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:38.080009 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44bbc35-86c3-47e5-b531-bc1fb1929b85 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:38.080320 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44bbc35-86c3-47e5-b531-bc1fb1929b85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:38.080596 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44bbc35-86c3-47e5-b531-bc1fb1929b85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:38.081306 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44bbc35-86c3-47e5-b531-bc1fb1929b85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:38.083173 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44bbc35-86c3-47e5-b531-bc1fb1929b85 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:38.093154 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1021/2047] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:42:38 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:42:38.097805 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3b8805-f885-414b-95ae-77d6b381f7af admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:38.108572 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3b8805-f885-414b-95ae-77d6b381f7af admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:38.113781 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86746615-49f7-4589-9ec3-ef033d8d340f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:38.114446 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86746615-49f7-4589-9ec3-ef033d8d340f admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:38.114726 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86746615-49f7-4589-9ec3-ef033d8d340f admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:38.115002 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86746615-49f7-4589-9ec3-ef033d8d340f admin admin] PATH_INFO: `/v3/projects/f7ddb987deae4259947f405e27c6a8c3/users/c675f6762b99429c8a5eab3910a84815/roles/3e32dbf75f9b41f5adb9fe59851267bb` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:38.116970 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86746615-49f7-4589-9ec3-ef033d8d340f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7ddb987deae4259947f405e27c6a8c3, user_id=c675f6762b99429c8a5eab3910a84815, role_id=3e32dbf75f9b41f5adb9fe59851267bb)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:38.119627 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86746615-49f7-4589-9ec3-ef033d8d340f admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:38.129952 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1027/2048] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:42:38 2022] PUT /identity/v3/projects/f7ddb987deae4259947f405e27c6a8c3/users/c675f6762b99429c8a5eab3910a84815/roles/3e32dbf75f9b41f5adb9fe59851267bb => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:42:38.141141 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad35b03a-5a7c-4222-b7a4-8fc3ece4d1d4 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:38.141436 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad35b03a-5a7c-4222-b7a4-8fc3ece4d1d4 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:38.141716 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad35b03a-5a7c-4222-b7a4-8fc3ece4d1d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:38.170180 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-ad35b03a-5a7c-4222-b7a4-8fc3ece4d1d4 None None] MFA Rules not processed for user `c675f6762b99429c8a5eab3910a84815`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:42:38.171383 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-ad35b03a-5a7c-4222-b7a4-8fc3ece4d1d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:42:38.247511 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1022/2049] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:42:38 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:42:38.257062 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86746615-49f7-4589-9ec3-ef033d8d340f admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:38.258818 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-86746615-49f7-4589-9ec3-ef033d8d340f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:42:38.294103 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:42:38.318945 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86746615-49f7-4589-9ec3-ef033d8d340f admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:38.322722 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f593e729-d6e2-4607-8f6e-f70f89df1405 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '123eb76f95ee4e39905944da701c712d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:38.323338 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f593e729-d6e2-4607-8f6e-f70f89df1405 service cinder] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:38.323619 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f593e729-d6e2-4607-8f6e-f70f89df1405 service cinder] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:38.323894 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f593e729-d6e2-4607-8f6e-f70f89df1405 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:38.333483 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f593e729-d6e2-4607-8f6e-f70f89df1405 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:38.334955 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f593e729-d6e2-4607-8f6e-f70f89df1405 service cinder] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:38.344113 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1028/2050] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:42:38 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:42:38.420784 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad35b03a-5a7c-4222-b7a4-8fc3ece4d1d4 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:38.430734 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad35b03a-5a7c-4222-b7a4-8fc3ece4d1d4 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:38.434365 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601e74ac-1bdf-4aff-849b-fe6b02359f85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '123eb76f95ee4e39905944da701c712d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:38.435265 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601e74ac-1bdf-4aff-849b-fe6b02359f85 service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:38.435550 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601e74ac-1bdf-4aff-849b-fe6b02359f85 service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:38.435827 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601e74ac-1bdf-4aff-849b-fe6b02359f85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:38.495766 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601e74ac-1bdf-4aff-849b-fe6b02359f85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:38.497272 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601e74ac-1bdf-4aff-849b-fe6b02359f85 service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:38.510281 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1023/2051] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:42:38 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:42:44.078860 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fc8288-a2d2-4a63-a115-0c922a83fbab None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:44.079881 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fc8288-a2d2-4a63-a115-0c922a83fbab None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:44.080101 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fc8288-a2d2-4a63-a115-0c922a83fbab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:44.099694 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-71fc8288-a2d2-4a63-a115-0c922a83fbab None None] MFA Rules not processed for user `6be7b2bcfebd45389ca289c34fbabc3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:42:44.100934 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-71fc8288-a2d2-4a63-a115-0c922a83fbab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:42:44.163373 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1029/2052] 10.222.0.70 () {58 vars in 1009 bytes} [Tue Aug 2 21:42:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:42:44.224503 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601e74ac-1bdf-4aff-849b-fe6b02359f85 service cinder] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:44.226418 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-601e74ac-1bdf-4aff-849b-fe6b02359f85 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:42:44.295634 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:42:44.327464 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601e74ac-1bdf-4aff-849b-fe6b02359f85 service cinder] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:44.336864 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c99b67b-1d2f-43e4-8558-23aab2841fef service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee7ebf40212465aac997b461a2d10fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:44.337938 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c99b67b-1d2f-43e4-8558-23aab2841fef service swift] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:44.338491 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c99b67b-1d2f-43e4-8558-23aab2841fef service swift] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:44.338772 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c99b67b-1d2f-43e4-8558-23aab2841fef service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:44.351852 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c99b67b-1d2f-43e4-8558-23aab2841fef service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:44.353494 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c99b67b-1d2f-43e4-8558-23aab2841fef service swift] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:44.363842 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1024/2053] 10.222.0.70 () {60 vars in 1384 bytes} [Tue Aug 2 21:42:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 02 21:42:48.451657 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4933d62-3f20-4716-b2a6-34b743bfd5e6 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:48.452296 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4933d62-3f20-4716-b2a6-34b743bfd5e6 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:48.452407 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4933d62-3f20-4716-b2a6-34b743bfd5e6 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:48.456300 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1030/2054] 10.222.0.70 () {54 vars in 921 bytes} [Tue Aug 2 21:42:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:42:48.486064 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518e82a6-2192-4da9-a530-67074da629ba None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:48.493561 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518e82a6-2192-4da9-a530-67074da629ba None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:48.493561 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518e82a6-2192-4da9-a530-67074da629ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:48.511153 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-518e82a6-2192-4da9-a530-67074da629ba None None] MFA Rules not processed for user `83fcd951771e42959506b70b0137003f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:42:48.512609 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-518e82a6-2192-4da9-a530-67074da629ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:42:48.614959 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1025/2055] 10.222.0.70 () {58 vars in 1018 bytes} [Tue Aug 2 21:42:48 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:42:48.633995 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4933d62-3f20-4716-b2a6-34b743bfd5e6 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:48.636646 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-d4933d62-3f20-4716-b2a6-34b743bfd5e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:42:48.672658 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4933d62-3f20-4716-b2a6-34b743bfd5e6 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:48.678755 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb23ba15-010c-49ca-bc53-32f1a81e46f9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83fcd951771e42959506b70b0137003f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:48.679454 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb23ba15-010c-49ca-bc53-32f1a81e46f9 service placement] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:48.679821 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb23ba15-010c-49ca-bc53-32f1a81e46f9 service placement] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:48.680167 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb23ba15-010c-49ca-bc53-32f1a81e46f9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:48.691169 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb23ba15-010c-49ca-bc53-32f1a81e46f9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:48.692964 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb23ba15-010c-49ca-bc53-32f1a81e46f9 service placement] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:48.705850 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1031/2056] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:42:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:42:49.392274 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518e82a6-2192-4da9-a530-67074da629ba None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:49.394132 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-518e82a6-2192-4da9-a530-67074da629ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:42:49.470064 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518e82a6-2192-4da9-a530-67074da629ba None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:49.474938 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd423a7-e911-42d9-a3ce-8b217ca8fbb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:49.475689 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd423a7-e911-42d9-a3ce-8b217ca8fbb3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:49.476034 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd423a7-e911-42d9-a3ce-8b217ca8fbb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:49.476418 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd423a7-e911-42d9-a3ce-8b217ca8fbb3 admin admin] PATH_INFO: `/v3/users/7e7d7fafb7484d30b01830b03c36936c` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:49.477668 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd423a7-e911-42d9-a3ce-8b217ca8fbb3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e7d7fafb7484d30b01830b03c36936c)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:49.479921 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd423a7-e911-42d9-a3ce-8b217ca8fbb3 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:49.536763 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ecd423a7-e911-42d9-a3ce-8b217ca8fbb3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e7d7fafb7484d30b01830b03c36936c'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:49.545446 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ecd423a7-e911-42d9-a3ce-8b217ca8fbb3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e7d7fafb7484d30b01830b03c36936c'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:49.559808 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ecd423a7-e911-42d9-a3ce-8b217ca8fbb3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e7d7fafb7484d30b01830b03c36936c'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:49.560547 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ecd423a7-e911-42d9-a3ce-8b217ca8fbb3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e7d7fafb7484d30b01830b03c36936c'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:49.566400 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:42:49.568742 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ecd423a7-e911-42d9-a3ce-8b217ca8fbb3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e7d7fafb7484d30b01830b03c36936c'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:49.578032 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1026/2057] 10.222.0.70 () {58 vars in 1224 bytes} [Tue Aug 2 21:42:49 2022] DELETE /identity/v3/users/7e7d7fafb7484d30b01830b03c36936c => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:42:49.778365 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb23ba15-010c-49ca-bc53-32f1a81e46f9 service placement] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:49.794128 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb23ba15-010c-49ca-bc53-32f1a81e46f9 service placement] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:49.867979 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c897f4d4-a875-4802-9f98-fe9dfc4466a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:49.868700 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c897f4d4-a875-4802-9f98-fe9dfc4466a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:49.869133 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c897f4d4-a875-4802-9f98-fe9dfc4466a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:49.869419 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c897f4d4-a875-4802-9f98-fe9dfc4466a8 admin admin] PATH_INFO: `/v3/projects/2394cf667efb40b7815dc6c92d71ecb4` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:49.871388 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c897f4d4-a875-4802-9f98-fe9dfc4466a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2394cf667efb40b7815dc6c92d71ecb4)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:49.873395 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c897f4d4-a875-4802-9f98-fe9dfc4466a8 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:49.930917 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-c897f4d4-a875-4802-9f98-fe9dfc4466a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2394cf667efb40b7815dc6c92d71ecb4', 'request_id': 'req-c897f4d4-a875-4802-9f98-fe9dfc4466a8'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:49.936438 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-c897f4d4-a875-4802-9f98-fe9dfc4466a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2394cf667efb40b7815dc6c92d71ecb4', 'request_id': 'req-c897f4d4-a875-4802-9f98-fe9dfc4466a8'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:49.945476 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-c897f4d4-a875-4802-9f98-fe9dfc4466a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2394cf667efb40b7815dc6c92d71ecb4', 'request_id': 'req-c897f4d4-a875-4802-9f98-fe9dfc4466a8'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:49.947705 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:42:49.960939 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-c897f4d4-a875-4802-9f98-fe9dfc4466a8 admin admin] The token cache is being invalidate because project 2394cf667efb40b7815dc6c92d71ecb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:42:49.961528 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-c897f4d4-a875-4802-9f98-fe9dfc4466a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:49.963451 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-c897f4d4-a875-4802-9f98-fe9dfc4466a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:49.968372 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1032/2058] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Aug 2 21:42:49 2022] DELETE /identity/v3/projects/2394cf667efb40b7815dc6c92d71ecb4 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:42:49.970280 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd423a7-e911-42d9-a3ce-8b217ca8fbb3 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:49.972896 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-ecd423a7-e911-42d9-a3ce-8b217ca8fbb3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:42:49.987722 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd423a7-e911-42d9-a3ce-8b217ca8fbb3 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:50.056463 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d0080a-5929-43fd-9f02-4cc6089a82ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:50.057172 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d0080a-5929-43fd-9f02-4cc6089a82ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:50.057476 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d0080a-5929-43fd-9f02-4cc6089a82ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:50.057859 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d0080a-5929-43fd-9f02-4cc6089a82ae admin admin] PATH_INFO: `/v3/users/30db4f9e87e14d5baa38e1b2b7253277` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:50.059150 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d0080a-5929-43fd-9f02-4cc6089a82ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=30db4f9e87e14d5baa38e1b2b7253277)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:50.061415 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d0080a-5929-43fd-9f02-4cc6089a82ae admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:50.161176 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-81d0080a-5929-43fd-9f02-4cc6089a82ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30db4f9e87e14d5baa38e1b2b7253277'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:50.177801 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-81d0080a-5929-43fd-9f02-4cc6089a82ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30db4f9e87e14d5baa38e1b2b7253277'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:50.199183 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-81d0080a-5929-43fd-9f02-4cc6089a82ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30db4f9e87e14d5baa38e1b2b7253277'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:50.200082 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-81d0080a-5929-43fd-9f02-4cc6089a82ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30db4f9e87e14d5baa38e1b2b7253277'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:50.210494 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-81d0080a-5929-43fd-9f02-4cc6089a82ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30db4f9e87e14d5baa38e1b2b7253277'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:50.224255 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1027/2059] 10.222.0.70 () {58 vars in 1224 bytes} [Tue Aug 2 21:42:49 2022] DELETE /identity/v3/users/30db4f9e87e14d5baa38e1b2b7253277 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:42:50.466935 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c897f4d4-a875-4802-9f98-fe9dfc4466a8 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:50.469552 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-c897f4d4-a875-4802-9f98-fe9dfc4466a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:42:50.495173 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c897f4d4-a875-4802-9f98-fe9dfc4466a8 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:50.600182 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff2680e-ea4e-44b3-8fc8-0266cfae2587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:50.601048 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff2680e-ea4e-44b3-8fc8-0266cfae2587 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:50.601359 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff2680e-ea4e-44b3-8fc8-0266cfae2587 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:50.601836 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff2680e-ea4e-44b3-8fc8-0266cfae2587 admin admin] PATH_INFO: `/v3/projects/d81ae8f4d77f44df903230c11f147028` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:50.603145 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff2680e-ea4e-44b3-8fc8-0266cfae2587 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d81ae8f4d77f44df903230c11f147028)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:50.605618 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff2680e-ea4e-44b3-8fc8-0266cfae2587 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:50.693511 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-2ff2680e-ea4e-44b3-8fc8-0266cfae2587 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd81ae8f4d77f44df903230c11f147028', 'request_id': 'req-2ff2680e-ea4e-44b3-8fc8-0266cfae2587'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:50.701355 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-2ff2680e-ea4e-44b3-8fc8-0266cfae2587 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd81ae8f4d77f44df903230c11f147028', 'request_id': 'req-2ff2680e-ea4e-44b3-8fc8-0266cfae2587'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:50.741415 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-2ff2680e-ea4e-44b3-8fc8-0266cfae2587 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd81ae8f4d77f44df903230c11f147028', 'request_id': 'req-2ff2680e-ea4e-44b3-8fc8-0266cfae2587'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:50.755761 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-2ff2680e-ea4e-44b3-8fc8-0266cfae2587 admin admin] The token cache is being invalidate because project d81ae8f4d77f44df903230c11f147028 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:42:50.756553 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-2ff2680e-ea4e-44b3-8fc8-0266cfae2587 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:50.757624 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-2ff2680e-ea4e-44b3-8fc8-0266cfae2587 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:42:50.763067 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1033/2060] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Aug 2 21:42:50 2022] DELETE /identity/v3/projects/d81ae8f4d77f44df903230c11f147028 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:42:50.764546 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2467ff26-fcd1-479d-8902-1a110db5928a None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:50.765783 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2467ff26-fcd1-479d-8902-1a110db5928a None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:50.766299 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2467ff26-fcd1-479d-8902-1a110db5928a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:50.790562 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-2467ff26-fcd1-479d-8902-1a110db5928a None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:42:50.792213 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-2467ff26-fcd1-479d-8902-1a110db5928a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:42:50.878773 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1028/2061] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:42:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:42:50.886443 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb788b6b-d99d-4284-85d2-13a3f7c299de None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:50.886931 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb788b6b-d99d-4284-85d2-13a3f7c299de None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:50.887040 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb788b6b-d99d-4284-85d2-13a3f7c299de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:50.906618 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-eb788b6b-d99d-4284-85d2-13a3f7c299de None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:42:50.908394 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-eb788b6b-d99d-4284-85d2-13a3f7c299de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:42:50.916286 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1034/2062] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:42:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:42:50.920396 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2467ff26-fcd1-479d-8902-1a110db5928a None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:50.930618 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2467ff26-fcd1-479d-8902-1a110db5928a None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:50.935222 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b37b341-6569-42a6-a8f3-ef4c26399b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:50.935851 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b37b341-6569-42a6-a8f3-ef4c26399b42 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:50.936138 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b37b341-6569-42a6-a8f3-ef4c26399b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:50.936442 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b37b341-6569-42a6-a8f3-ef4c26399b42 admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:50.937145 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b37b341-6569-42a6-a8f3-ef4c26399b42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:42:50.937453 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b37b341-6569-42a6-a8f3-ef4c26399b42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:50.939091 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b37b341-6569-42a6-a8f3-ef4c26399b42 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:50.950639 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1029/2063] 10.222.0.70 () {58 vars in 1153 bytes} [Tue Aug 2 21:42:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:42:50.954853 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb788b6b-d99d-4284-85d2-13a3f7c299de None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:50.964013 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb788b6b-d99d-4284-85d2-13a3f7c299de None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:50.969391 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbebe7f-0245-480c-938b-f7923b26d923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:50.970607 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbebe7f-0245-480c-938b-f7923b26d923 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:50.971301 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbebe7f-0245-480c-938b-f7923b26d923 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:50.971624 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbebe7f-0245-480c-938b-f7923b26d923 admin admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:50.972321 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbebe7f-0245-480c-938b-f7923b26d923 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:50.974550 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbebe7f-0245-480c-938b-f7923b26d923 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:51.002863 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1035/2064] 10.222.0.70 () {60 vars in 1153 bytes} [Tue Aug 2 21:42:50 2022] POST /identity/v3/projects => generated 377 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 21:42:51.007134 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b37b341-6569-42a6-a8f3-ef4c26399b42 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:51.016351 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:42:51.022800 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b37b341-6569-42a6-a8f3-ef4c26399b42 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:51.082340 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8a8c04-6a4a-45aa-9c58-13729c9a86f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:51.082933 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8a8c04-6a4a-45aa-9c58-13729c9a86f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:51.083228 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8a8c04-6a4a-45aa-9c58-13729c9a86f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:51.083506 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8a8c04-6a4a-45aa-9c58-13729c9a86f4 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:51.084204 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8a8c04-6a4a-45aa-9c58-13729c9a86f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:51.086196 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8a8c04-6a4a-45aa-9c58-13729c9a86f4 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:51.108766 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1030/2065] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 2 21:42:51 2022] POST /identity/v3/users => generated 289 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:42:51.112988 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbebe7f-0245-480c-938b-f7923b26d923 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:51.123954 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbebe7f-0245-480c-938b-f7923b26d923 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:51.129455 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea610d0-f0ba-4d5c-a6d7-a3cbf7e175ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:51.130069 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea610d0-f0ba-4d5c-a6d7-a3cbf7e175ef admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:51.130349 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea610d0-f0ba-4d5c-a6d7-a3cbf7e175ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:51.130623 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea610d0-f0ba-4d5c-a6d7-a3cbf7e175ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:51.131314 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea610d0-f0ba-4d5c-a6d7-a3cbf7e175ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:51.132960 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea610d0-f0ba-4d5c-a6d7-a3cbf7e175ef admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:51.143582 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1036/2066] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:42:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:42:51.147642 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8a8c04-6a4a-45aa-9c58-13729c9a86f4 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:51.157973 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8a8c04-6a4a-45aa-9c58-13729c9a86f4 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:51.163850 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a9605f-c6e6-4ad7-aa83-095b25f57d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:51.164730 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a9605f-c6e6-4ad7-aa83-095b25f57d1a admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:51.165017 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a9605f-c6e6-4ad7-aa83-095b25f57d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:51.165294 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a9605f-c6e6-4ad7-aa83-095b25f57d1a admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:51.165999 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a9605f-c6e6-4ad7-aa83-095b25f57d1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:51.167602 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a9605f-c6e6-4ad7-aa83-095b25f57d1a admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:51.179410 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1031/2067] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:42:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:42:51.183616 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea610d0-f0ba-4d5c-a6d7-a3cbf7e175ef admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:51.194148 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea610d0-f0ba-4d5c-a6d7-a3cbf7e175ef admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:51.198788 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ac989d-2efe-4a07-8aef-7ca101d83d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:51.199437 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac989d-2efe-4a07-8aef-7ca101d83d02 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:51.199721 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac989d-2efe-4a07-8aef-7ca101d83d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:51.199998 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac989d-2efe-4a07-8aef-7ca101d83d02 admin admin] PATH_INFO: `/v3/projects/836ae8caec4747959a965ca85b527c35/users/aa043b9e0b74406ea1fa0767a2d9de28/roles/462e3381a85c42a9959201f9aa122f7c` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:51.216401 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ac989d-2efe-4a07-8aef-7ca101d83d02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=836ae8caec4747959a965ca85b527c35, user_id=aa043b9e0b74406ea1fa0767a2d9de28, role_id=462e3381a85c42a9959201f9aa122f7c)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:51.219388 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ac989d-2efe-4a07-8aef-7ca101d83d02 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:51.233693 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1037/2068] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:42:51 2022] PUT /identity/v3/projects/836ae8caec4747959a965ca85b527c35/users/aa043b9e0b74406ea1fa0767a2d9de28/roles/462e3381a85c42a9959201f9aa122f7c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:42:51.248332 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d51e89-4e12-4b52-84a4-3fdeebfae9b0 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:51.248545 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d51e89-4e12-4b52-84a4-3fdeebfae9b0 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:51.248770 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d51e89-4e12-4b52-84a4-3fdeebfae9b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:51.299129 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-d5d51e89-4e12-4b52-84a4-3fdeebfae9b0 None None] MFA Rules not processed for user `aa043b9e0b74406ea1fa0767a2d9de28`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:42:51.300410 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-d5d51e89-4e12-4b52-84a4-3fdeebfae9b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:42:51.381825 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1032/2069] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:42:51 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:42:51.395201 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ac989d-2efe-4a07-8aef-7ca101d83d02 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:42:51.397459 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-b4ac989d-2efe-4a07-8aef-7ca101d83d02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:42:51.471575 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:42:51.506182 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ac989d-2efe-4a07-8aef-7ca101d83d02 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:42:51.510613 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203d9a16-b536-49db-bb08-917353b2feb3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '123eb76f95ee4e39905944da701c712d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:42:51.511209 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203d9a16-b536-49db-bb08-917353b2feb3 service cinder] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:42:51.511489 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203d9a16-b536-49db-bb08-917353b2feb3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:42:51.511832 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203d9a16-b536-49db-bb08-917353b2feb3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:42:51.521533 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203d9a16-b536-49db-bb08-917353b2feb3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:42:51.523060 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203d9a16-b536-49db-bb08-917353b2feb3 service cinder] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:42:51.532921 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1038/2070] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:42:51 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:43:01.374940 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=65,keystone:INSERT=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:43:01.528445 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=16 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:43:05.473221 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d51e89-4e12-4b52-84a4-3fdeebfae9b0 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:05.608008 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d51e89-4e12-4b52-84a4-3fdeebfae9b0 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:05.614273 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eb9844-1f3a-49da-9b82-88113faa6db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:05.615211 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eb9844-1f3a-49da-9b82-88113faa6db6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:05.615678 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eb9844-1f3a-49da-9b82-88113faa6db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:05.616167 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eb9844-1f3a-49da-9b82-88113faa6db6 admin admin] PATH_INFO: `/v3/users/aa043b9e0b74406ea1fa0767a2d9de28` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:05.617837 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27eb9844-1f3a-49da-9b82-88113faa6db6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa043b9e0b74406ea1fa0767a2d9de28)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:05.620117 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27eb9844-1f3a-49da-9b82-88113faa6db6 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:05.717130 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-27eb9844-1f3a-49da-9b82-88113faa6db6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa043b9e0b74406ea1fa0767a2d9de28'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:05.735035 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-27eb9844-1f3a-49da-9b82-88113faa6db6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa043b9e0b74406ea1fa0767a2d9de28'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:05.776373 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-27eb9844-1f3a-49da-9b82-88113faa6db6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa043b9e0b74406ea1fa0767a2d9de28'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:05.778113 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-27eb9844-1f3a-49da-9b82-88113faa6db6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa043b9e0b74406ea1fa0767a2d9de28'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:05.790557 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-27eb9844-1f3a-49da-9b82-88113faa6db6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa043b9e0b74406ea1fa0767a2d9de28'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:05.797503 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1033/2071] 10.222.0.70 () {58 vars in 1224 bytes} [Tue Aug 2 21:43:05 2022] DELETE /identity/v3/users/aa043b9e0b74406ea1fa0767a2d9de28 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:43:05.801730 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9261a7ae-9e40-4934-aca5-c8a292c56897 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:05.802320 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9261a7ae-9e40-4934-aca5-c8a292c56897 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:05.802320 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9261a7ae-9e40-4934-aca5-c8a292c56897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:05.825964 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-9261a7ae-9e40-4934-aca5-c8a292c56897 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:43:05.827329 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-9261a7ae-9e40-4934-aca5-c8a292c56897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:05.915266 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1039/2072] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:43:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:43:05.923183 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eb9844-1f3a-49da-9b82-88113faa6db6 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:05.924908 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-27eb9844-1f3a-49da-9b82-88113faa6db6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:06.043290 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eb9844-1f3a-49da-9b82-88113faa6db6 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:06.053971 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d351a791-b614-4db3-9264-2ee2d2177d9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '723f5f43572a493dae0349070a2adb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:06.054804 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d351a791-b614-4db3-9264-2ee2d2177d9c service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:06.055273 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d351a791-b614-4db3-9264-2ee2d2177d9c service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:06.055714 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d351a791-b614-4db3-9264-2ee2d2177d9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:06.069204 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d351a791-b614-4db3-9264-2ee2d2177d9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:06.072029 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d351a791-b614-4db3-9264-2ee2d2177d9c service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:06.110529 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1034/2073] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:43:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:43:06.520642 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9261a7ae-9e40-4934-aca5-c8a292c56897 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:06.522176 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-9261a7ae-9e40-4934-aca5-c8a292c56897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:06.541025 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9261a7ae-9e40-4934-aca5-c8a292c56897 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:06.546309 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f09e37-40f0-4dd5-adc7-c28fb126577a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:06.546960 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f09e37-40f0-4dd5-adc7-c28fb126577a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:06.547235 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f09e37-40f0-4dd5-adc7-c28fb126577a admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:06.547562 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f09e37-40f0-4dd5-adc7-c28fb126577a admin admin] PATH_INFO: `/v3/projects/836ae8caec4747959a965ca85b527c35` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:06.548861 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f09e37-40f0-4dd5-adc7-c28fb126577a admin admin] RBAC: Authorizing `identity:delete_project(project_id=836ae8caec4747959a965ca85b527c35)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:06.557167 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f09e37-40f0-4dd5-adc7-c28fb126577a admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:06.616097 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-77f09e37-40f0-4dd5-adc7-c28fb126577a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '836ae8caec4747959a965ca85b527c35', 'request_id': 'req-77f09e37-40f0-4dd5-adc7-c28fb126577a'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:06.624597 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-77f09e37-40f0-4dd5-adc7-c28fb126577a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '836ae8caec4747959a965ca85b527c35', 'request_id': 'req-77f09e37-40f0-4dd5-adc7-c28fb126577a'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:06.640214 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-77f09e37-40f0-4dd5-adc7-c28fb126577a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '836ae8caec4747959a965ca85b527c35', 'request_id': 'req-77f09e37-40f0-4dd5-adc7-c28fb126577a'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:06.663756 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-77f09e37-40f0-4dd5-adc7-c28fb126577a admin admin] The token cache is being invalidate because project 836ae8caec4747959a965ca85b527c35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:43:06.664510 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-77f09e37-40f0-4dd5-adc7-c28fb126577a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:06.665307 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-77f09e37-40f0-4dd5-adc7-c28fb126577a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:06.668513 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1040/2074] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Aug 2 21:43:06 2022] DELETE /identity/v3/projects/836ae8caec4747959a965ca85b527c35 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:43:06.673266 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c3b803-a575-4135-8ba1-2535fcb3db9e None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:06.673956 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c3b803-a575-4135-8ba1-2535fcb3db9e None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:06.673956 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c3b803-a575-4135-8ba1-2535fcb3db9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:06.700098 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-45c3b803-a575-4135-8ba1-2535fcb3db9e None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:43:06.702152 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-45c3b803-a575-4135-8ba1-2535fcb3db9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:06.727149 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:43:06.793575 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1035/2075] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:43:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:43:06.800825 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f89b895-b31d-4d71-a980-795c8189c140 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:06.801471 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f89b895-b31d-4d71-a980-795c8189c140 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:06.801889 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f89b895-b31d-4d71-a980-795c8189c140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:06.845409 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-0f89b895-b31d-4d71-a980-795c8189c140 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:43:06.847592 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-0f89b895-b31d-4d71-a980-795c8189c140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:06.857301 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1041/2076] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:43:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:43:06.868708 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c3b803-a575-4135-8ba1-2535fcb3db9e None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:06.884151 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c3b803-a575-4135-8ba1-2535fcb3db9e None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:06.889869 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34feab34-2fa8-428e-92dd-1451628e21d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:06.890776 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34feab34-2fa8-428e-92dd-1451628e21d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:06.891365 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34feab34-2fa8-428e-92dd-1451628e21d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:06.891831 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34feab34-2fa8-428e-92dd-1451628e21d0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:06.892734 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34feab34-2fa8-428e-92dd-1451628e21d0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:43:06.893042 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34feab34-2fa8-428e-92dd-1451628e21d0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:06.894778 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34feab34-2fa8-428e-92dd-1451628e21d0 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:06.911085 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1036/2077] 10.222.0.70 () {58 vars in 1153 bytes} [Tue Aug 2 21:43:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:43:06.916113 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f89b895-b31d-4d71-a980-795c8189c140 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:06.926021 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f89b895-b31d-4d71-a980-795c8189c140 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:06.934052 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19eea98-b713-4707-ab8b-1af12d178594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:06.934764 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19eea98-b713-4707-ab8b-1af12d178594 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:06.934981 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19eea98-b713-4707-ab8b-1af12d178594 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:06.935255 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19eea98-b713-4707-ab8b-1af12d178594 admin admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:06.935935 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19eea98-b713-4707-ab8b-1af12d178594 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:06.937921 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19eea98-b713-4707-ab8b-1af12d178594 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:06.975926 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1042/2078] 10.222.0.70 () {60 vars in 1153 bytes} [Tue Aug 2 21:43:06 2022] POST /identity/v3/projects => generated 383 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:43:06.976587 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34feab34-2fa8-428e-92dd-1451628e21d0 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:06.989626 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34feab34-2fa8-428e-92dd-1451628e21d0 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:07.081528 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff124fb8-e745-4427-9abc-d9caea28c785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:07.082606 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff124fb8-e745-4427-9abc-d9caea28c785 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:07.082606 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff124fb8-e745-4427-9abc-d9caea28c785 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:07.082805 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff124fb8-e745-4427-9abc-d9caea28c785 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:07.083975 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff124fb8-e745-4427-9abc-d9caea28c785 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:07.086516 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff124fb8-e745-4427-9abc-d9caea28c785 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:07.115910 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1037/2079] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 2 21:43:06 2022] POST /identity/v3/users => generated 292 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 21:43:07.117905 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19eea98-b713-4707-ab8b-1af12d178594 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:07.188407 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19eea98-b713-4707-ab8b-1af12d178594 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:07.270660 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950f10f8-6405-49d1-b120-3de2a7dfc4ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:07.271752 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950f10f8-6405-49d1-b120-3de2a7dfc4ba admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:07.272186 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950f10f8-6405-49d1-b120-3de2a7dfc4ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:07.274103 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950f10f8-6405-49d1-b120-3de2a7dfc4ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:07.277416 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950f10f8-6405-49d1-b120-3de2a7dfc4ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:07.285791 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950f10f8-6405-49d1-b120-3de2a7dfc4ba admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:07.337672 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1043/2080] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:43:07 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:43:07.361767 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff124fb8-e745-4427-9abc-d9caea28c785 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:07.419493 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff124fb8-e745-4427-9abc-d9caea28c785 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:07.443207 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4eb3c3-7e01-4b4c-9485-bc91ceb34eab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:07.444098 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4eb3c3-7e01-4b4c-9485-bc91ceb34eab admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:07.444570 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4eb3c3-7e01-4b4c-9485-bc91ceb34eab admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:07.445013 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4eb3c3-7e01-4b4c-9485-bc91ceb34eab admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:07.445887 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4eb3c3-7e01-4b4c-9485-bc91ceb34eab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:07.452845 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4eb3c3-7e01-4b4c-9485-bc91ceb34eab admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:07.497164 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950f10f8-6405-49d1-b120-3de2a7dfc4ba admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:07.498906 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1038/2081] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:43:07 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:43:07.515403 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950f10f8-6405-49d1-b120-3de2a7dfc4ba admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:07.541278 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdac4eb-72ef-420d-8456-9116ef7d5a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:07.542023 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdac4eb-72ef-420d-8456-9116ef7d5a48 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:07.542309 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdac4eb-72ef-420d-8456-9116ef7d5a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:07.542588 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdac4eb-72ef-420d-8456-9116ef7d5a48 admin admin] PATH_INFO: `/v3/projects/3b95c7d0396d46bcb4e041ab1634bdea/users/c38f7f04cc0043649b0b45d5baea5236/roles/462e3381a85c42a9959201f9aa122f7c` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:07.565826 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdac4eb-72ef-420d-8456-9116ef7d5a48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b95c7d0396d46bcb4e041ab1634bdea, user_id=c38f7f04cc0043649b0b45d5baea5236, role_id=462e3381a85c42a9959201f9aa122f7c)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:07.568869 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdac4eb-72ef-420d-8456-9116ef7d5a48 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:07.602071 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1044/2082] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:43:07 2022] PUT /identity/v3/projects/3b95c7d0396d46bcb4e041ab1634bdea/users/c38f7f04cc0043649b0b45d5baea5236/roles/462e3381a85c42a9959201f9aa122f7c => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:43:07.603546 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a321ae8c-f3b3-40f2-9e82-78db4bbeb717 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:07.604102 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a321ae8c-f3b3-40f2-9e82-78db4bbeb717 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:07.604945 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a321ae8c-f3b3-40f2-9e82-78db4bbeb717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:07.659319 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-a321ae8c-f3b3-40f2-9e82-78db4bbeb717 None None] MFA Rules not processed for user `c38f7f04cc0043649b0b45d5baea5236`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:43:07.661406 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-a321ae8c-f3b3-40f2-9e82-78db4bbeb717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:07.763965 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1039/2083] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:43:07 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:43:07.777094 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdac4eb-72ef-420d-8456-9116ef7d5a48 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:07.780216 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-cbdac4eb-72ef-420d-8456-9116ef7d5a48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:07.839188 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:43:07.921377 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdac4eb-72ef-420d-8456-9116ef7d5a48 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:07.925538 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5b34fe-03bd-4062-985a-6c1a157abea6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '123eb76f95ee4e39905944da701c712d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:07.926250 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5b34fe-03bd-4062-985a-6c1a157abea6 service cinder] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:07.926608 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5b34fe-03bd-4062-985a-6c1a157abea6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:07.927014 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5b34fe-03bd-4062-985a-6c1a157abea6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:07.936847 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5b34fe-03bd-4062-985a-6c1a157abea6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:07.938407 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5b34fe-03bd-4062-985a-6c1a157abea6 service cinder] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:07.960825 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1045/2084] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:43:07 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 21:43:08.776790 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834d69fe-5421-41ee-b948-fe7e3eeeab19 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:08.777301 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834d69fe-5421-41ee-b948-fe7e3eeeab19 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:08.777381 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834d69fe-5421-41ee-b948-fe7e3eeeab19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:08.796252 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-834d69fe-5421-41ee-b948-fe7e3eeeab19 None None] MFA Rules not processed for user `54c59604553a491b9276bd45b3a2f6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:43:08.797476 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-834d69fe-5421-41ee-b948-fe7e3eeeab19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:08.815278 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:43:08.863906 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1040/2085] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:43:08 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:43:10.857332 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5b34fe-03bd-4062-985a-6c1a157abea6 service cinder] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:10.929192 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5b34fe-03bd-4062-985a-6c1a157abea6 service cinder] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:10.935230 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcba713-67ef-4e60-91b7-24bb13627032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:10.935886 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcba713-67ef-4e60-91b7-24bb13627032 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:10.936172 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcba713-67ef-4e60-91b7-24bb13627032 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:10.936533 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcba713-67ef-4e60-91b7-24bb13627032 admin admin] PATH_INFO: `/v3/users/c38f7f04cc0043649b0b45d5baea5236` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:10.937768 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcba713-67ef-4e60-91b7-24bb13627032 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c38f7f04cc0043649b0b45d5baea5236)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:10.939771 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcba713-67ef-4e60-91b7-24bb13627032 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:10.993789 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-ebcba713-67ef-4e60-91b7-24bb13627032 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c38f7f04cc0043649b0b45d5baea5236'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:11.001607 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-ebcba713-67ef-4e60-91b7-24bb13627032 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c38f7f04cc0043649b0b45d5baea5236'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:11.014662 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-ebcba713-67ef-4e60-91b7-24bb13627032 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c38f7f04cc0043649b0b45d5baea5236'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:11.022088 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-ebcba713-67ef-4e60-91b7-24bb13627032 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c38f7f04cc0043649b0b45d5baea5236'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:11.022751 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-ebcba713-67ef-4e60-91b7-24bb13627032 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c38f7f04cc0043649b0b45d5baea5236'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:11.028656 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1046/2086] 10.222.0.70 () {58 vars in 1224 bytes} [Tue Aug 2 21:43:10 2022] DELETE /identity/v3/users/c38f7f04cc0043649b0b45d5baea5236 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:43:11.033123 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc25be97-383b-4878-b802-57ad3e47dc54 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:11.033590 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc25be97-383b-4878-b802-57ad3e47dc54 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:11.033783 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc25be97-383b-4878-b802-57ad3e47dc54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:11.054889 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-dc25be97-383b-4878-b802-57ad3e47dc54 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:43:11.056145 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-dc25be97-383b-4878-b802-57ad3e47dc54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:11.124499 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1041/2087] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:43:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:43:11.130559 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcba713-67ef-4e60-91b7-24bb13627032 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:11.132132 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-ebcba713-67ef-4e60-91b7-24bb13627032 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:11.183494 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:43:11.198967 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcba713-67ef-4e60-91b7-24bb13627032 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:11.203277 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f7a12b-58a6-45cb-97cc-946207e7f269 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '723f5f43572a493dae0349070a2adb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:11.203955 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f7a12b-58a6-45cb-97cc-946207e7f269 service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:11.204252 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f7a12b-58a6-45cb-97cc-946207e7f269 service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:11.204615 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f7a12b-58a6-45cb-97cc-946207e7f269 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:11.214897 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f7a12b-58a6-45cb-97cc-946207e7f269 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:11.216625 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f7a12b-58a6-45cb-97cc-946207e7f269 service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:11.228281 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1047/2088] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:43:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:43:11.521979 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc25be97-383b-4878-b802-57ad3e47dc54 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:11.523470 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-dc25be97-383b-4878-b802-57ad3e47dc54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:11.536919 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc25be97-383b-4878-b802-57ad3e47dc54 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:11.557078 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fe6917-7163-44b6-9bf5-89ef2b47ce3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:11.558069 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fe6917-7163-44b6-9bf5-89ef2b47ce3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:11.558366 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fe6917-7163-44b6-9bf5-89ef2b47ce3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:11.558726 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fe6917-7163-44b6-9bf5-89ef2b47ce3d admin admin] PATH_INFO: `/v3/projects/3b95c7d0396d46bcb4e041ab1634bdea` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:11.561379 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fe6917-7163-44b6-9bf5-89ef2b47ce3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b95c7d0396d46bcb4e041ab1634bdea)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:11.563839 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fe6917-7163-44b6-9bf5-89ef2b47ce3d admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:11.618815 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-45fe6917-7163-44b6-9bf5-89ef2b47ce3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b95c7d0396d46bcb4e041ab1634bdea', 'request_id': 'req-45fe6917-7163-44b6-9bf5-89ef2b47ce3d'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:11.627636 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-45fe6917-7163-44b6-9bf5-89ef2b47ce3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b95c7d0396d46bcb4e041ab1634bdea', 'request_id': 'req-45fe6917-7163-44b6-9bf5-89ef2b47ce3d'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:11.634784 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-45fe6917-7163-44b6-9bf5-89ef2b47ce3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b95c7d0396d46bcb4e041ab1634bdea', 'request_id': 'req-45fe6917-7163-44b6-9bf5-89ef2b47ce3d'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:11.648170 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-45fe6917-7163-44b6-9bf5-89ef2b47ce3d admin admin] The token cache is being invalidate because project 3b95c7d0396d46bcb4e041ab1634bdea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:43:11.648591 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-45fe6917-7163-44b6-9bf5-89ef2b47ce3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:11.649379 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-45fe6917-7163-44b6-9bf5-89ef2b47ce3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:11.650874 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1042/2089] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Aug 2 21:43:11 2022] DELETE /identity/v3/projects/3b95c7d0396d46bcb4e041ab1634bdea => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:43:12.280495 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f7a12b-58a6-45cb-97cc-946207e7f269 service neutron] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:12.294361 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-66f7a12b-58a6-45cb-97cc-946207e7f269 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:12.327927 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f7a12b-58a6-45cb-97cc-946207e7f269 service neutron] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:12.420381 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce6fb52-d3fa-44b2-b9f3-0252ecedee9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:12.421291 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce6fb52-d3fa-44b2-b9f3-0252ecedee9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:12.421681 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce6fb52-d3fa-44b2-b9f3-0252ecedee9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:12.422065 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce6fb52-d3fa-44b2-b9f3-0252ecedee9b admin admin] PATH_INFO: `/v3/users/f8335095460d4c37b05e4293fa698716` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:12.423558 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce6fb52-d3fa-44b2-b9f3-0252ecedee9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8335095460d4c37b05e4293fa698716)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:12.428646 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce6fb52-d3fa-44b2-b9f3-0252ecedee9b admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:12.516821 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-3ce6fb52-d3fa-44b2-b9f3-0252ecedee9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8335095460d4c37b05e4293fa698716'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:12.529037 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-3ce6fb52-d3fa-44b2-b9f3-0252ecedee9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8335095460d4c37b05e4293fa698716'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:12.563016 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-3ce6fb52-d3fa-44b2-b9f3-0252ecedee9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8335095460d4c37b05e4293fa698716'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:12.583849 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-3ce6fb52-d3fa-44b2-b9f3-0252ecedee9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8335095460d4c37b05e4293fa698716'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:12.584627 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-3ce6fb52-d3fa-44b2-b9f3-0252ecedee9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8335095460d4c37b05e4293fa698716'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:12.592640 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1048/2090] 10.222.0.70 () {58 vars in 1224 bytes} [Tue Aug 2 21:43:12 2022] DELETE /identity/v3/users/f8335095460d4c37b05e4293fa698716 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:43:12.596863 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e95ac-7960-4cd2-a6ff-9492bbf28b84 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:12.597753 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e95ac-7960-4cd2-a6ff-9492bbf28b84 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:12.598224 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e95ac-7960-4cd2-a6ff-9492bbf28b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:12.638556 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-4e3e95ac-7960-4cd2-a6ff-9492bbf28b84 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:43:12.640450 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-4e3e95ac-7960-4cd2-a6ff-9492bbf28b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:12.769480 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:43:12.817830 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce6fb52-d3fa-44b2-b9f3-0252ecedee9b admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:12.818213 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1043/2091] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:43:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:43:12.821358 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-3ce6fb52-d3fa-44b2-b9f3-0252ecedee9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:12.969974 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce6fb52-d3fa-44b2-b9f3-0252ecedee9b admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:12.975260 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63edc4b5-f3fe-4255-b377-376fa662e66b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '723f5f43572a493dae0349070a2adb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:12.975966 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63edc4b5-f3fe-4255-b377-376fa662e66b service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:12.976269 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63edc4b5-f3fe-4255-b377-376fa662e66b service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:12.976546 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63edc4b5-f3fe-4255-b377-376fa662e66b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:13.003934 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63edc4b5-f3fe-4255-b377-376fa662e66b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:13.007176 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63edc4b5-f3fe-4255-b377-376fa662e66b service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:13.025139 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1049/2092] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:43:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:43:13.402121 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3e95ac-7960-4cd2-a6ff-9492bbf28b84 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:13.403617 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-4e3e95ac-7960-4cd2-a6ff-9492bbf28b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:13.416986 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3e95ac-7960-4cd2-a6ff-9492bbf28b84 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:13.422780 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a748562-1e6f-4181-8773-8cfbaf09cfd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:13.423749 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a748562-1e6f-4181-8773-8cfbaf09cfd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:13.424202 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a748562-1e6f-4181-8773-8cfbaf09cfd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:13.424672 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a748562-1e6f-4181-8773-8cfbaf09cfd0 admin admin] PATH_INFO: `/v3/projects/6120936726854808973a2ad62b820165` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:13.429197 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a748562-1e6f-4181-8773-8cfbaf09cfd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6120936726854808973a2ad62b820165)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:13.432127 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a748562-1e6f-4181-8773-8cfbaf09cfd0 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:13.516842 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-2a748562-1e6f-4181-8773-8cfbaf09cfd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6120936726854808973a2ad62b820165', 'request_id': 'req-2a748562-1e6f-4181-8773-8cfbaf09cfd0'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:13.530499 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-2a748562-1e6f-4181-8773-8cfbaf09cfd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6120936726854808973a2ad62b820165', 'request_id': 'req-2a748562-1e6f-4181-8773-8cfbaf09cfd0'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:13.541308 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-2a748562-1e6f-4181-8773-8cfbaf09cfd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6120936726854808973a2ad62b820165', 'request_id': 'req-2a748562-1e6f-4181-8773-8cfbaf09cfd0'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:13.559900 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-2a748562-1e6f-4181-8773-8cfbaf09cfd0 admin admin] The token cache is being invalidate because project 6120936726854808973a2ad62b820165 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:43:13.560496 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-2a748562-1e6f-4181-8773-8cfbaf09cfd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:13.561498 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-2a748562-1e6f-4181-8773-8cfbaf09cfd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:13.563301 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1044/2093] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Aug 2 21:43:13 2022] DELETE /identity/v3/projects/6120936726854808973a2ad62b820165 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:43:13.568313 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63edc4b5-f3fe-4255-b377-376fa662e66b service neutron] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:13.582029 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63edc4b5-f3fe-4255-b377-376fa662e66b service neutron] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:13.588499 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:43:13.777151 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b26eef-fada-4ca0-8a72-21c4f4340892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:13.783003 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b26eef-fada-4ca0-8a72-21c4f4340892 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:13.783003 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b26eef-fada-4ca0-8a72-21c4f4340892 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:13.783003 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b26eef-fada-4ca0-8a72-21c4f4340892 admin admin] PATH_INFO: `/v3/users/c675f6762b99429c8a5eab3910a84815` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:13.783774 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b26eef-fada-4ca0-8a72-21c4f4340892 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c675f6762b99429c8a5eab3910a84815)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:13.788410 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b26eef-fada-4ca0-8a72-21c4f4340892 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:13.915804 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-08b26eef-fada-4ca0-8a72-21c4f4340892 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c675f6762b99429c8a5eab3910a84815'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:13.934001 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-08b26eef-fada-4ca0-8a72-21c4f4340892 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c675f6762b99429c8a5eab3910a84815'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:13.969491 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-08b26eef-fada-4ca0-8a72-21c4f4340892 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c675f6762b99429c8a5eab3910a84815'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:13.994297 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-08b26eef-fada-4ca0-8a72-21c4f4340892 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c675f6762b99429c8a5eab3910a84815'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:13.996587 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-08b26eef-fada-4ca0-8a72-21c4f4340892 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c675f6762b99429c8a5eab3910a84815'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:14.009964 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1050/2094] 10.222.0.70 () {58 vars in 1224 bytes} [Tue Aug 2 21:43:13 2022] DELETE /identity/v3/users/c675f6762b99429c8a5eab3910a84815 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:43:14.698757 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a748562-1e6f-4181-8773-8cfbaf09cfd0 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:14.701338 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-2a748562-1e6f-4181-8773-8cfbaf09cfd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:14.737048 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a748562-1e6f-4181-8773-8cfbaf09cfd0 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:14.797044 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22109780-9ef7-4d4d-b4b2-fed84f17e2a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:14.797697 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22109780-9ef7-4d4d-b4b2-fed84f17e2a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:14.797979 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22109780-9ef7-4d4d-b4b2-fed84f17e2a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:14.798255 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22109780-9ef7-4d4d-b4b2-fed84f17e2a9 admin admin] PATH_INFO: `/v3/projects/f7ddb987deae4259947f405e27c6a8c3` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:14.799412 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22109780-9ef7-4d4d-b4b2-fed84f17e2a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7ddb987deae4259947f405e27c6a8c3)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:14.801445 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22109780-9ef7-4d4d-b4b2-fed84f17e2a9 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:14.852169 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-22109780-9ef7-4d4d-b4b2-fed84f17e2a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7ddb987deae4259947f405e27c6a8c3', 'request_id': 'req-22109780-9ef7-4d4d-b4b2-fed84f17e2a9'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:14.863300 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-22109780-9ef7-4d4d-b4b2-fed84f17e2a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7ddb987deae4259947f405e27c6a8c3', 'request_id': 'req-22109780-9ef7-4d4d-b4b2-fed84f17e2a9'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:14.872414 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-22109780-9ef7-4d4d-b4b2-fed84f17e2a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7ddb987deae4259947f405e27c6a8c3', 'request_id': 'req-22109780-9ef7-4d4d-b4b2-fed84f17e2a9'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:14.884946 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:43:14.892381 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-22109780-9ef7-4d4d-b4b2-fed84f17e2a9 admin admin] The token cache is being invalidate because project f7ddb987deae4259947f405e27c6a8c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:43:14.892703 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-22109780-9ef7-4d4d-b4b2-fed84f17e2a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:14.893475 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-22109780-9ef7-4d4d-b4b2-fed84f17e2a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:14.902907 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1045/2095] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Aug 2 21:43:14 2022] DELETE /identity/v3/projects/f7ddb987deae4259947f405e27c6a8c3 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:43:14.904713 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d50af0f-65c9-4e67-9e8b-8396f5827aeb None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:14.905225 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d50af0f-65c9-4e67-9e8b-8396f5827aeb None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:14.905312 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d50af0f-65c9-4e67-9e8b-8396f5827aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:14.927252 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-2d50af0f-65c9-4e67-9e8b-8396f5827aeb None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:43:14.928640 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-2d50af0f-65c9-4e67-9e8b-8396f5827aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:15.062032 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1051/2096] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:43:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:43:15.071196 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a170af4-f783-4f64-aab7-3c822c1167fb None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:15.071495 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a170af4-f783-4f64-aab7-3c822c1167fb None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:15.071763 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a170af4-f783-4f64-aab7-3c822c1167fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:15.110097 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-0a170af4-f783-4f64-aab7-3c822c1167fb None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:43:15.111749 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-0a170af4-f783-4f64-aab7-3c822c1167fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:15.128686 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1046/2097] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:43:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:43:15.131267 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d50af0f-65c9-4e67-9e8b-8396f5827aeb None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:15.142290 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d50af0f-65c9-4e67-9e8b-8396f5827aeb None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:15.147488 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404d7a06-40b9-4bea-9fae-d458a3a35f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:15.148132 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404d7a06-40b9-4bea-9fae-d458a3a35f42 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:15.148611 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404d7a06-40b9-4bea-9fae-d458a3a35f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:15.148897 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404d7a06-40b9-4bea-9fae-d458a3a35f42 admin admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:15.149606 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404d7a06-40b9-4bea-9fae-d458a3a35f42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:43:15.149913 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404d7a06-40b9-4bea-9fae-d458a3a35f42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:15.151526 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404d7a06-40b9-4bea-9fae-d458a3a35f42 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:15.182817 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1052/2098] 10.222.0.70 () {58 vars in 1153 bytes} [Tue Aug 2 21:43:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:43:15.187404 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a170af4-f783-4f64-aab7-3c822c1167fb None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:15.198665 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a170af4-f783-4f64-aab7-3c822c1167fb None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:15.209182 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6440fcaf-3d73-4877-9b80-d9bbf331fab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:15.209739 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6440fcaf-3d73-4877-9b80-d9bbf331fab8 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:15.210022 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6440fcaf-3d73-4877-9b80-d9bbf331fab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:15.210305 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6440fcaf-3d73-4877-9b80-d9bbf331fab8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:15.211255 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6440fcaf-3d73-4877-9b80-d9bbf331fab8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:15.213994 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6440fcaf-3d73-4877-9b80-d9bbf331fab8 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:15.256652 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1047/2099] 10.222.0.70 () {60 vars in 1153 bytes} [Tue Aug 2 21:43:15 2022] POST /identity/v3/projects => generated 385 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:43:15.261926 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404d7a06-40b9-4bea-9fae-d458a3a35f42 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:15.273460 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404d7a06-40b9-4bea-9fae-d458a3a35f42 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:15.285180 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:43:15.394456 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a11f761-6191-4b7e-8a47-6820f4938c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:15.395468 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a11f761-6191-4b7e-8a47-6820f4938c24 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:15.395933 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a11f761-6191-4b7e-8a47-6820f4938c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:15.396541 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a11f761-6191-4b7e-8a47-6820f4938c24 admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:15.397483 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a11f761-6191-4b7e-8a47-6820f4938c24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:15.399703 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a11f761-6191-4b7e-8a47-6820f4938c24 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:15.430004 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1053/2100] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 2 21:43:15 2022] POST /identity/v3/users => generated 293 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:43:15.434583 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6440fcaf-3d73-4877-9b80-d9bbf331fab8 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:15.450331 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6440fcaf-3d73-4877-9b80-d9bbf331fab8 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:15.455945 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2686def-cb0b-41c1-83bc-cec2ef61b3e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:15.456764 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2686def-cb0b-41c1-83bc-cec2ef61b3e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:15.457054 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2686def-cb0b-41c1-83bc-cec2ef61b3e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:15.457445 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2686def-cb0b-41c1-83bc-cec2ef61b3e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:15.458394 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2686def-cb0b-41c1-83bc-cec2ef61b3e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:15.460527 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2686def-cb0b-41c1-83bc-cec2ef61b3e0 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:15.479584 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1048/2101] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:43:15 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:43:15.484391 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a11f761-6191-4b7e-8a47-6820f4938c24 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:15.498883 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a11f761-6191-4b7e-8a47-6820f4938c24 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:15.504542 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77f790e-0ba3-46c1-a15c-2c610ede0a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:15.505546 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77f790e-0ba3-46c1-a15c-2c610ede0a87 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:15.506047 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77f790e-0ba3-46c1-a15c-2c610ede0a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:15.506536 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77f790e-0ba3-46c1-a15c-2c610ede0a87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:15.507453 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77f790e-0ba3-46c1-a15c-2c610ede0a87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:15.509485 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77f790e-0ba3-46c1-a15c-2c610ede0a87 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:15.522076 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1054/2102] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:43:15 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:43:15.527216 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2686def-cb0b-41c1-83bc-cec2ef61b3e0 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:15.540626 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2686def-cb0b-41c1-83bc-cec2ef61b3e0 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:15.547127 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba609c3-ce1c-4abe-b8df-ed8e8057aee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:15.548055 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba609c3-ce1c-4abe-b8df-ed8e8057aee2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:15.548579 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba609c3-ce1c-4abe-b8df-ed8e8057aee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:15.548967 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba609c3-ce1c-4abe-b8df-ed8e8057aee2 admin admin] PATH_INFO: `/v3/projects/ca852920ad4c494b9409e16c47de94c0/users/f0a2223234984ac7ab2b2defa1797e8b/roles/462e3381a85c42a9959201f9aa122f7c` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:15.569033 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba609c3-ce1c-4abe-b8df-ed8e8057aee2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca852920ad4c494b9409e16c47de94c0, user_id=f0a2223234984ac7ab2b2defa1797e8b, role_id=462e3381a85c42a9959201f9aa122f7c)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:15.572453 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba609c3-ce1c-4abe-b8df-ed8e8057aee2 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:15.587666 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1049/2103] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:43:15 2022] PUT /identity/v3/projects/ca852920ad4c494b9409e16c47de94c0/users/f0a2223234984ac7ab2b2defa1797e8b/roles/462e3381a85c42a9959201f9aa122f7c => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:43:15.598121 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e60a6d-d74f-47c9-83e5-cdf9c03db544 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:15.599094 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e60a6d-d74f-47c9-83e5-cdf9c03db544 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:15.599379 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e60a6d-d74f-47c9-83e5-cdf9c03db544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:15.632795 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-f7e60a6d-d74f-47c9-83e5-cdf9c03db544 None None] MFA Rules not processed for user `f0a2223234984ac7ab2b2defa1797e8b`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:43:15.634027 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-f7e60a6d-d74f-47c9-83e5-cdf9c03db544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:15.704580 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1055/2104] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:43:15 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:43:15.709519 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba609c3-ce1c-4abe-b8df-ed8e8057aee2 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:15.783807 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba609c3-ce1c-4abe-b8df-ed8e8057aee2 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:15.789283 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b3f0c7-80b5-4459-8502-1b9b74de6509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:15.789942 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b3f0c7-80b5-4459-8502-1b9b74de6509 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:15.790230 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b3f0c7-80b5-4459-8502-1b9b74de6509 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:15.790516 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b3f0c7-80b5-4459-8502-1b9b74de6509 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:15.791181 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b3f0c7-80b5-4459-8502-1b9b74de6509 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:15.793379 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b3f0c7-80b5-4459-8502-1b9b74de6509 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:15.827693 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1050/2105] 10.222.0.70 () {60 vars in 1153 bytes} [Tue Aug 2 21:43:15 2022] POST /identity/v3/projects => generated 385 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:43:15.828941 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e60a6d-d74f-47c9-83e5-cdf9c03db544 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:15.840512 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e60a6d-d74f-47c9-83e5-cdf9c03db544 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:15.900325 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7f10b7-9c3d-41ad-ac26-9430e115f6b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:15.900957 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f10b7-9c3d-41ad-ac26-9430e115f6b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:15.901240 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f10b7-9c3d-41ad-ac26-9430e115f6b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:15.901527 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f10b7-9c3d-41ad-ac26-9430e115f6b1 admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:15.902222 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7f10b7-9c3d-41ad-ac26-9430e115f6b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:15.904196 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7f10b7-9c3d-41ad-ac26-9430e115f6b1 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:15.924810 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1056/2106] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 2 21:43:15 2022] POST /identity/v3/users => generated 299 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:43:15.929453 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b3f0c7-80b5-4459-8502-1b9b74de6509 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:15.939803 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b3f0c7-80b5-4459-8502-1b9b74de6509 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:15.945280 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52138f9-a16b-4d72-a89f-607bb4cd313c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:15.945956 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52138f9-a16b-4d72-a89f-607bb4cd313c admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:15.946256 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52138f9-a16b-4d72-a89f-607bb4cd313c admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:15.946537 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52138f9-a16b-4d72-a89f-607bb4cd313c admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:15.947517 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52138f9-a16b-4d72-a89f-607bb4cd313c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:15.949702 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52138f9-a16b-4d72-a89f-607bb4cd313c admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:15.961713 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1051/2107] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:43:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:43:15.966555 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7f10b7-9c3d-41ad-ac26-9430e115f6b1 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:15.977721 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7f10b7-9c3d-41ad-ac26-9430e115f6b1 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:15.983210 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b37136d-1a12-4f64-898f-1b7a456ca10e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:15.983886 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b37136d-1a12-4f64-898f-1b7a456ca10e admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:15.984180 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b37136d-1a12-4f64-898f-1b7a456ca10e admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:15.984502 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b37136d-1a12-4f64-898f-1b7a456ca10e admin admin] PATH_INFO: `/v3/projects/e3ea4d21e7204c7c8c9b0e878c02aaf1/users/81d138d8eb804ea6aa7b60f91b7b0d8c/roles/3e32dbf75f9b41f5adb9fe59851267bb` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:15.996873 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:43:16.011977 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b37136d-1a12-4f64-898f-1b7a456ca10e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3ea4d21e7204c7c8c9b0e878c02aaf1, user_id=81d138d8eb804ea6aa7b60f91b7b0d8c, role_id=3e32dbf75f9b41f5adb9fe59851267bb)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:16.017293 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b37136d-1a12-4f64-898f-1b7a456ca10e admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:16.065097 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52138f9-a16b-4d72-a89f-607bb4cd313c admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:16.065349 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1057/2108] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:43:15 2022] PUT /identity/v3/projects/e3ea4d21e7204c7c8c9b0e878c02aaf1/users/81d138d8eb804ea6aa7b60f91b7b0d8c/roles/3e32dbf75f9b41f5adb9fe59851267bb => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:43:16.082242 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52138f9-a16b-4d72-a89f-607bb4cd313c admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:16.210370 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aee56e-30b4-4a3e-a32d-f76fb02af102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:16.211858 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aee56e-30b4-4a3e-a32d-f76fb02af102 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:16.212559 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aee56e-30b4-4a3e-a32d-f76fb02af102 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:16.213051 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aee56e-30b4-4a3e-a32d-f76fb02af102 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:16.213952 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aee56e-30b4-4a3e-a32d-f76fb02af102 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:16.215935 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aee56e-30b4-4a3e-a32d-f76fb02af102 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:16.232007 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1052/2109] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:43:16 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:43:16.236215 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b37136d-1a12-4f64-898f-1b7a456ca10e admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:16.249446 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b37136d-1a12-4f64-898f-1b7a456ca10e admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:16.269219 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619a4561-02bf-4d9c-9947-230508cde759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:16.271476 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a4561-02bf-4d9c-9947-230508cde759 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:16.275103 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a4561-02bf-4d9c-9947-230508cde759 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:16.275500 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a4561-02bf-4d9c-9947-230508cde759 admin admin] PATH_INFO: `/v3/projects/e3ea4d21e7204c7c8c9b0e878c02aaf1/users/81d138d8eb804ea6aa7b60f91b7b0d8c/roles/3e32dbf75f9b41f5adb9fe59851267bb` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:16.279750 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619a4561-02bf-4d9c-9947-230508cde759 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3ea4d21e7204c7c8c9b0e878c02aaf1, user_id=81d138d8eb804ea6aa7b60f91b7b0d8c, role_id=3e32dbf75f9b41f5adb9fe59851267bb)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:16.301007 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619a4561-02bf-4d9c-9947-230508cde759 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:16.329558 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1058/2110] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:43:16 2022] PUT /identity/v3/projects/e3ea4d21e7204c7c8c9b0e878c02aaf1/users/81d138d8eb804ea6aa7b60f91b7b0d8c/roles/3e32dbf75f9b41f5adb9fe59851267bb => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:43:16.341637 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36421af-3489-4e15-a533-d82801ee61eb None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:16.342174 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36421af-3489-4e15-a533-d82801ee61eb None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:16.343635 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36421af-3489-4e15-a533-d82801ee61eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:16.374221 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:43:16.398343 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-e36421af-3489-4e15-a533-d82801ee61eb None None] MFA Rules not processed for user `81d138d8eb804ea6aa7b60f91b7b0d8c`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:43:16.400330 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-e36421af-3489-4e15-a533-d82801ee61eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:16.605574 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1053/2111] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:43:16 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:43:16.626445 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619a4561-02bf-4d9c-9947-230508cde759 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:16.628655 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-619a4561-02bf-4d9c-9947-230508cde759 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:16.764954 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619a4561-02bf-4d9c-9947-230508cde759 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:16.789094 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cc6453-62a9-48a5-ad1f-d8c6631aba90 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '123eb76f95ee4e39905944da701c712d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:16.790226 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cc6453-62a9-48a5-ad1f-d8c6631aba90 service cinder] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:16.790577 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cc6453-62a9-48a5-ad1f-d8c6631aba90 service cinder] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:16.790923 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cc6453-62a9-48a5-ad1f-d8c6631aba90 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:16.811060 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cc6453-62a9-48a5-ad1f-d8c6631aba90 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:16.812600 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cc6453-62a9-48a5-ad1f-d8c6631aba90 service cinder] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:16.838599 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1059/2112] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:43:16 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:43:16.937943 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36421af-3489-4e15-a533-d82801ee61eb None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:17.179018 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36421af-3489-4e15-a533-d82801ee61eb None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:17.206503 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17358d0-aaae-44c9-9f5a-ae206fb50c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:17.207177 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17358d0-aaae-44c9-9f5a-ae206fb50c78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:17.214096 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17358d0-aaae-44c9-9f5a-ae206fb50c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:17.214417 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17358d0-aaae-44c9-9f5a-ae206fb50c78 admin admin] PATH_INFO: `/v3/users/f0a2223234984ac7ab2b2defa1797e8b` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:17.219153 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17358d0-aaae-44c9-9f5a-ae206fb50c78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0a2223234984ac7ab2b2defa1797e8b)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:17.221911 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17358d0-aaae-44c9-9f5a-ae206fb50c78 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:17.341410 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-f17358d0-aaae-44c9-9f5a-ae206fb50c78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0a2223234984ac7ab2b2defa1797e8b'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:17.351588 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-f17358d0-aaae-44c9-9f5a-ae206fb50c78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0a2223234984ac7ab2b2defa1797e8b'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:17.366928 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-f17358d0-aaae-44c9-9f5a-ae206fb50c78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0a2223234984ac7ab2b2defa1797e8b'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:17.369018 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-f17358d0-aaae-44c9-9f5a-ae206fb50c78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0a2223234984ac7ab2b2defa1797e8b'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:17.377563 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-f17358d0-aaae-44c9-9f5a-ae206fb50c78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0a2223234984ac7ab2b2defa1797e8b'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:17.384652 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1054/2113] 10.222.0.70 () {58 vars in 1224 bytes} [Tue Aug 2 21:43:16 2022] DELETE /identity/v3/users/f0a2223234984ac7ab2b2defa1797e8b => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:43:17.389567 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1967961-f9bb-43f4-88a0-f2b8da45a235 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:17.390095 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1967961-f9bb-43f4-88a0-f2b8da45a235 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:17.390095 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1967961-f9bb-43f4-88a0-f2b8da45a235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:17.432477 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-d1967961-f9bb-43f4-88a0-f2b8da45a235 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:43:17.433994 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-d1967961-f9bb-43f4-88a0-f2b8da45a235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:17.504298 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1060/2114] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:43:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:43:17.519456 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17358d0-aaae-44c9-9f5a-ae206fb50c78 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:17.522040 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-f17358d0-aaae-44c9-9f5a-ae206fb50c78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:17.547511 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:43:17.653019 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17358d0-aaae-44c9-9f5a-ae206fb50c78 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:17.661815 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ccfe70-0d40-445a-b526-0d92a76d30ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '723f5f43572a493dae0349070a2adb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:17.662471 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ccfe70-0d40-445a-b526-0d92a76d30ba service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:17.662751 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ccfe70-0d40-445a-b526-0d92a76d30ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:17.663036 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ccfe70-0d40-445a-b526-0d92a76d30ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:17.702619 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ccfe70-0d40-445a-b526-0d92a76d30ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:17.703879 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ccfe70-0d40-445a-b526-0d92a76d30ba service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:17.726523 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1055/2115] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:43:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:43:18.854964 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1967961-f9bb-43f4-88a0-f2b8da45a235 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:18.857390 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-d1967961-f9bb-43f4-88a0-f2b8da45a235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:18.871503 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1967961-f9bb-43f4-88a0-f2b8da45a235 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:18.877248 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c46909-a512-4f7c-a946-6413af9533ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:18.878384 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c46909-a512-4f7c-a946-6413af9533ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:18.879011 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c46909-a512-4f7c-a946-6413af9533ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:18.879867 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c46909-a512-4f7c-a946-6413af9533ee admin admin] PATH_INFO: `/v3/projects/ca852920ad4c494b9409e16c47de94c0` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:18.881946 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c46909-a512-4f7c-a946-6413af9533ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca852920ad4c494b9409e16c47de94c0)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:18.884447 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c46909-a512-4f7c-a946-6413af9533ee admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:19.039766 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-63c46909-a512-4f7c-a946-6413af9533ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca852920ad4c494b9409e16c47de94c0', 'request_id': 'req-63c46909-a512-4f7c-a946-6413af9533ee'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:19.056981 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-63c46909-a512-4f7c-a946-6413af9533ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca852920ad4c494b9409e16c47de94c0', 'request_id': 'req-63c46909-a512-4f7c-a946-6413af9533ee'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:19.071698 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-63c46909-a512-4f7c-a946-6413af9533ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca852920ad4c494b9409e16c47de94c0', 'request_id': 'req-63c46909-a512-4f7c-a946-6413af9533ee'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:19.094207 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:43:19.124798 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-63c46909-a512-4f7c-a946-6413af9533ee admin admin] The token cache is being invalidate because project ca852920ad4c494b9409e16c47de94c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:43:19.126613 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-63c46909-a512-4f7c-a946-6413af9533ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:19.129978 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-63c46909-a512-4f7c-a946-6413af9533ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:19.136435 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1061/2116] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Aug 2 21:43:18 2022] DELETE /identity/v3/projects/ca852920ad4c494b9409e16c47de94c0 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:43:19.140050 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ccfe70-0d40-445a-b526-0d92a76d30ba service neutron] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:19.151426 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ccfe70-0d40-445a-b526-0d92a76d30ba service neutron] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:19.232668 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84e2460-3420-4f26-b1c7-040396c51029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:19.233334 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84e2460-3420-4f26-b1c7-040396c51029 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:19.233622 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84e2460-3420-4f26-b1c7-040396c51029 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:19.233903 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84e2460-3420-4f26-b1c7-040396c51029 admin admin] PATH_INFO: `/v3/users/81d138d8eb804ea6aa7b60f91b7b0d8c` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:19.236756 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84e2460-3420-4f26-b1c7-040396c51029 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81d138d8eb804ea6aa7b60f91b7b0d8c)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:19.244647 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84e2460-3420-4f26-b1c7-040396c51029 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:19.367162 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-c84e2460-3420-4f26-b1c7-040396c51029 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81d138d8eb804ea6aa7b60f91b7b0d8c'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:19.387753 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-c84e2460-3420-4f26-b1c7-040396c51029 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81d138d8eb804ea6aa7b60f91b7b0d8c'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:19.406733 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-c84e2460-3420-4f26-b1c7-040396c51029 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81d138d8eb804ea6aa7b60f91b7b0d8c'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:19.407870 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-c84e2460-3420-4f26-b1c7-040396c51029 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81d138d8eb804ea6aa7b60f91b7b0d8c'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:19.419901 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-c84e2460-3420-4f26-b1c7-040396c51029 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81d138d8eb804ea6aa7b60f91b7b0d8c'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:19.431481 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1056/2117] 10.222.0.70 () {58 vars in 1224 bytes} [Tue Aug 2 21:43:19 2022] DELETE /identity/v3/users/81d138d8eb804ea6aa7b60f91b7b0d8c => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:43:20.326984 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab95006-0e0c-4e74-9d1b-77d646863b0d None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:20.327597 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab95006-0e0c-4e74-9d1b-77d646863b0d None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:20.327597 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab95006-0e0c-4e74-9d1b-77d646863b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:20.349257 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-8ab95006-0e0c-4e74-9d1b-77d646863b0d None None] MFA Rules not processed for user `6be7b2bcfebd45389ca289c34fbabc3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:43:20.350904 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-8ab95006-0e0c-4e74-9d1b-77d646863b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:20.421284 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1062/2118] 10.222.0.70 () {58 vars in 967 bytes} [Tue Aug 2 21:43:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:43:20.436068 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84e2460-3420-4f26-b1c7-040396c51029 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:20.437714 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-c84e2460-3420-4f26-b1c7-040396c51029 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:20.472257 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab95006-0e0c-4e74-9d1b-77d646863b0d None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:20.474367 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-8ab95006-0e0c-4e74-9d1b-77d646863b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:20.486415 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:43:20.527706 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84e2460-3420-4f26-b1c7-040396c51029 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:20.533411 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3082b75e-5839-4524-b93f-bb15182c3f24 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee7ebf40212465aac997b461a2d10fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:20.534071 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3082b75e-5839-4524-b93f-bb15182c3f24 service swift] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:20.534353 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3082b75e-5839-4524-b93f-bb15182c3f24 service swift] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:20.534631 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3082b75e-5839-4524-b93f-bb15182c3f24 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:20.543478 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3082b75e-5839-4524-b93f-bb15182c3f24 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:20.545105 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3082b75e-5839-4524-b93f-bb15182c3f24 service swift] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:20.546219 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab95006-0e0c-4e74-9d1b-77d646863b0d None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:20.550813 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817bb27e-a437-48f3-977e-f7a90c734671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:20.551482 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817bb27e-a437-48f3-977e-f7a90c734671 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:20.551770 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817bb27e-a437-48f3-977e-f7a90c734671 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:20.552051 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817bb27e-a437-48f3-977e-f7a90c734671 admin admin] PATH_INFO: `/v3/projects/e3ea4d21e7204c7c8c9b0e878c02aaf1` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:20.553210 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1057/2119] 10.222.0.70 () {60 vars in 1384 bytes} [Tue Aug 2 21:43:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 02 21:43:20.553331 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817bb27e-a437-48f3-977e-f7a90c734671 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3ea4d21e7204c7c8c9b0e878c02aaf1)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:20.555356 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817bb27e-a437-48f3-977e-f7a90c734671 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:20.610994 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-817bb27e-a437-48f3-977e-f7a90c734671 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3ea4d21e7204c7c8c9b0e878c02aaf1', 'request_id': 'req-817bb27e-a437-48f3-977e-f7a90c734671'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:20.617373 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-817bb27e-a437-48f3-977e-f7a90c734671 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3ea4d21e7204c7c8c9b0e878c02aaf1', 'request_id': 'req-817bb27e-a437-48f3-977e-f7a90c734671'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:20.625736 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-817bb27e-a437-48f3-977e-f7a90c734671 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3ea4d21e7204c7c8c9b0e878c02aaf1', 'request_id': 'req-817bb27e-a437-48f3-977e-f7a90c734671'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:20.638725 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-817bb27e-a437-48f3-977e-f7a90c734671 admin admin] The token cache is being invalidate because project e3ea4d21e7204c7c8c9b0e878c02aaf1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:43:20.639082 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-817bb27e-a437-48f3-977e-f7a90c734671 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:20.639826 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-817bb27e-a437-48f3-977e-f7a90c734671 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:20.641456 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1063/2120] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Aug 2 21:43:20 2022] DELETE /identity/v3/projects/e3ea4d21e7204c7c8c9b0e878c02aaf1 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:43:20.647179 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d39b1a-4a54-411d-8b01-028d8a888c3e None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:20.647578 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d39b1a-4a54-411d-8b01-028d8a888c3e None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:20.648080 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d39b1a-4a54-411d-8b01-028d8a888c3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:20.675941 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-71d39b1a-4a54-411d-8b01-028d8a888c3e None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:43:20.677269 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-71d39b1a-4a54-411d-8b01-028d8a888c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:20.758240 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1058/2121] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:43:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:43:20.766327 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2786dbf3-0500-4af4-895c-34d3662bc3e1 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:20.766616 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2786dbf3-0500-4af4-895c-34d3662bc3e1 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:20.766894 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2786dbf3-0500-4af4-895c-34d3662bc3e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:20.798566 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-2786dbf3-0500-4af4-895c-34d3662bc3e1 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:43:20.799800 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-2786dbf3-0500-4af4-895c-34d3662bc3e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:20.808589 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1064/2122] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:43:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:43:20.812663 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d39b1a-4a54-411d-8b01-028d8a888c3e None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:20.824409 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d39b1a-4a54-411d-8b01-028d8a888c3e None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:20.829722 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56ab5c0-3823-49f4-a8f8-96188992f7b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:20.830395 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56ab5c0-3823-49f4-a8f8-96188992f7b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:20.830636 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56ab5c0-3823-49f4-a8f8-96188992f7b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:20.830912 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56ab5c0-3823-49f4-a8f8-96188992f7b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:20.831617 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56ab5c0-3823-49f4-a8f8-96188992f7b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:43:20.831924 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56ab5c0-3823-49f4-a8f8-96188992f7b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:20.834183 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56ab5c0-3823-49f4-a8f8-96188992f7b8 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:20.847652 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1059/2123] 10.222.0.70 () {58 vars in 1153 bytes} [Tue Aug 2 21:43:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:43:20.852323 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2786dbf3-0500-4af4-895c-34d3662bc3e1 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:20.862196 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2786dbf3-0500-4af4-895c-34d3662bc3e1 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:20.869515 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9c6766-9e28-41ed-9715-ca82fd00ea2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:20.870806 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9c6766-9e28-41ed-9715-ca82fd00ea2e admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:20.871301 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9c6766-9e28-41ed-9715-ca82fd00ea2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:20.871987 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9c6766-9e28-41ed-9715-ca82fd00ea2e admin admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:20.873214 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9c6766-9e28-41ed-9715-ca82fd00ea2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:20.875488 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9c6766-9e28-41ed-9715-ca82fd00ea2e admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:20.949688 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1065/2124] 10.222.0.70 () {60 vars in 1153 bytes} [Tue Aug 2 21:43:20 2022] POST /identity/v3/projects => generated 387 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:43:20.954177 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56ab5c0-3823-49f4-a8f8-96188992f7b8 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:20.969092 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56ab5c0-3823-49f4-a8f8-96188992f7b8 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:21.111125 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01381085-176e-4e18-8a6b-300fcef0e746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:21.111763 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01381085-176e-4e18-8a6b-300fcef0e746 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:21.112112 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01381085-176e-4e18-8a6b-300fcef0e746 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:21.112430 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01381085-176e-4e18-8a6b-300fcef0e746 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:21.113245 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01381085-176e-4e18-8a6b-300fcef0e746 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:21.116439 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01381085-176e-4e18-8a6b-300fcef0e746 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:21.144821 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1060/2125] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 2 21:43:20 2022] POST /identity/v3/users => generated 294 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:43:21.148288 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9c6766-9e28-41ed-9715-ca82fd00ea2e admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:21.160646 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9c6766-9e28-41ed-9715-ca82fd00ea2e admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:21.166567 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378bb5d8-858e-4601-b955-c0c865f23e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:21.167197 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378bb5d8-858e-4601-b955-c0c865f23e14 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:21.167496 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378bb5d8-858e-4601-b955-c0c865f23e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:21.167746 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378bb5d8-858e-4601-b955-c0c865f23e14 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:21.168697 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378bb5d8-858e-4601-b955-c0c865f23e14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:21.170257 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378bb5d8-858e-4601-b955-c0c865f23e14 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:21.171907 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:43:21.182453 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1066/2126] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:43:21 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:43:21.187517 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01381085-176e-4e18-8a6b-300fcef0e746 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:21.211503 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01381085-176e-4e18-8a6b-300fcef0e746 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:21.221054 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f95e30e-3aff-4c31-9ddf-86939eca8bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:21.221881 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f95e30e-3aff-4c31-9ddf-86939eca8bc8 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:21.222170 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f95e30e-3aff-4c31-9ddf-86939eca8bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:21.222827 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f95e30e-3aff-4c31-9ddf-86939eca8bc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:21.224039 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f95e30e-3aff-4c31-9ddf-86939eca8bc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:21.226284 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f95e30e-3aff-4c31-9ddf-86939eca8bc8 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:21.244254 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1061/2127] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:43:21 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:43:21.249002 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378bb5d8-858e-4601-b955-c0c865f23e14 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:21.272497 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378bb5d8-858e-4601-b955-c0c865f23e14 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:21.277485 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7e4be9-a421-45ac-8ceb-a781f2cdc013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:21.278166 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e4be9-a421-45ac-8ceb-a781f2cdc013 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:21.278586 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e4be9-a421-45ac-8ceb-a781f2cdc013 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:21.278759 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e4be9-a421-45ac-8ceb-a781f2cdc013 admin admin] PATH_INFO: `/v3/projects/7537c79f6aac43c9a49cbe1e9af531bc/users/de0b4cc591f34cba870f2bb5a03e09d8/roles/462e3381a85c42a9959201f9aa122f7c` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:21.336382 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7e4be9-a421-45ac-8ceb-a781f2cdc013 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7537c79f6aac43c9a49cbe1e9af531bc, user_id=de0b4cc591f34cba870f2bb5a03e09d8, role_id=462e3381a85c42a9959201f9aa122f7c)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:21.336382 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7e4be9-a421-45ac-8ceb-a781f2cdc013 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:21.348059 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1067/2128] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:43:21 2022] PUT /identity/v3/projects/7537c79f6aac43c9a49cbe1e9af531bc/users/de0b4cc591f34cba870f2bb5a03e09d8/roles/462e3381a85c42a9959201f9aa122f7c => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:43:21.365923 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d1b5c9-e4ae-4271-968b-efd9efdd8676 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:21.366447 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d1b5c9-e4ae-4271-968b-efd9efdd8676 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:21.366734 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d1b5c9-e4ae-4271-968b-efd9efdd8676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:21.420771 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-91d1b5c9-e4ae-4271-968b-efd9efdd8676 None None] MFA Rules not processed for user `de0b4cc591f34cba870f2bb5a03e09d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:43:21.422405 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-91d1b5c9-e4ae-4271-968b-efd9efdd8676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:21.443440 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:43:21.504938 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1062/2129] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:43:21 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:43:21.509493 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7e4be9-a421-45ac-8ceb-a781f2cdc013 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:21.580147 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7e4be9-a421-45ac-8ceb-a781f2cdc013 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:21.586567 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6592318-11fa-4706-8b60-8a16c72a21d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:21.587206 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6592318-11fa-4706-8b60-8a16c72a21d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:21.587493 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6592318-11fa-4706-8b60-8a16c72a21d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:21.587774 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6592318-11fa-4706-8b60-8a16c72a21d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:21.588491 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6592318-11fa-4706-8b60-8a16c72a21d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:21.590454 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6592318-11fa-4706-8b60-8a16c72a21d6 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:21.624098 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1068/2130] 10.222.0.70 () {60 vars in 1153 bytes} [Tue Aug 2 21:43:21 2022] POST /identity/v3/projects => generated 389 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 21:43:21.625268 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d1b5c9-e4ae-4271-968b-efd9efdd8676 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:21.637105 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d1b5c9-e4ae-4271-968b-efd9efdd8676 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:21.697479 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be20a73-fbe9-4094-a357-2f6978f4c6de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:21.698098 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be20a73-fbe9-4094-a357-2f6978f4c6de admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:21.698379 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be20a73-fbe9-4094-a357-2f6978f4c6de admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:21.698650 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be20a73-fbe9-4094-a357-2f6978f4c6de admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:21.699308 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be20a73-fbe9-4094-a357-2f6978f4c6de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:21.701394 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be20a73-fbe9-4094-a357-2f6978f4c6de admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:21.737381 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1063/2131] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 2 21:43:21 2022] POST /identity/v3/users => generated 301 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 21:43:21.740331 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6592318-11fa-4706-8b60-8a16c72a21d6 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:21.751004 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6592318-11fa-4706-8b60-8a16c72a21d6 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:21.756377 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9025663b-807f-4889-a61d-412ba57a3962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:21.756992 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9025663b-807f-4889-a61d-412ba57a3962 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:21.757280 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9025663b-807f-4889-a61d-412ba57a3962 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:21.757559 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9025663b-807f-4889-a61d-412ba57a3962 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:21.758283 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9025663b-807f-4889-a61d-412ba57a3962 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:21.759881 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9025663b-807f-4889-a61d-412ba57a3962 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:21.771603 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1069/2132] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:43:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:43:21.775916 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be20a73-fbe9-4094-a357-2f6978f4c6de admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:21.787598 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be20a73-fbe9-4094-a357-2f6978f4c6de admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:21.792597 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f239cf3-9309-4bb2-9c7b-fa35388b1de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:21.793331 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f239cf3-9309-4bb2-9c7b-fa35388b1de5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:21.793814 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f239cf3-9309-4bb2-9c7b-fa35388b1de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:21.793919 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f239cf3-9309-4bb2-9c7b-fa35388b1de5 admin admin] PATH_INFO: `/v3/projects/a25e43c4bfeb44e5af59a3fd60e50c98/users/a05e022ac55d4ed4b2fa3e6c2b18ea47/roles/3e32dbf75f9b41f5adb9fe59851267bb` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:21.811238 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f239cf3-9309-4bb2-9c7b-fa35388b1de5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a25e43c4bfeb44e5af59a3fd60e50c98, user_id=a05e022ac55d4ed4b2fa3e6c2b18ea47, role_id=3e32dbf75f9b41f5adb9fe59851267bb)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:21.813957 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f239cf3-9309-4bb2-9c7b-fa35388b1de5 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:21.832291 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1064/2133] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:43:21 2022] PUT /identity/v3/projects/a25e43c4bfeb44e5af59a3fd60e50c98/users/a05e022ac55d4ed4b2fa3e6c2b18ea47/roles/3e32dbf75f9b41f5adb9fe59851267bb => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:43:21.834290 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9025663b-807f-4889-a61d-412ba57a3962 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:21.845960 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9025663b-807f-4889-a61d-412ba57a3962 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:21.918905 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14cc3ed-4140-461c-9e5a-0c497c704e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:21.919671 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14cc3ed-4140-461c-9e5a-0c497c704e59 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:21.920198 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14cc3ed-4140-461c-9e5a-0c497c704e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:21.920718 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14cc3ed-4140-461c-9e5a-0c497c704e59 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:21.921623 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14cc3ed-4140-461c-9e5a-0c497c704e59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:21.923414 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14cc3ed-4140-461c-9e5a-0c497c704e59 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:21.938074 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1070/2134] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:43:21 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 21:43:21.943481 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f239cf3-9309-4bb2-9c7b-fa35388b1de5 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:21.954948 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f239cf3-9309-4bb2-9c7b-fa35388b1de5 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:21.960363 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5a258f-7308-45e4-9927-eb0341203a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:21.961285 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5a258f-7308-45e4-9927-eb0341203a57 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:21.961574 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5a258f-7308-45e4-9927-eb0341203a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:21.961855 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5a258f-7308-45e4-9927-eb0341203a57 admin admin] PATH_INFO: `/v3/projects/a25e43c4bfeb44e5af59a3fd60e50c98/users/a05e022ac55d4ed4b2fa3e6c2b18ea47/roles/3e32dbf75f9b41f5adb9fe59851267bb` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:21.964294 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5a258f-7308-45e4-9927-eb0341203a57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a25e43c4bfeb44e5af59a3fd60e50c98, user_id=a05e022ac55d4ed4b2fa3e6c2b18ea47, role_id=3e32dbf75f9b41f5adb9fe59851267bb)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:21.966656 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5a258f-7308-45e4-9927-eb0341203a57 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:21.988862 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1065/2135] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:43:21 2022] PUT /identity/v3/projects/a25e43c4bfeb44e5af59a3fd60e50c98/users/a05e022ac55d4ed4b2fa3e6c2b18ea47/roles/3e32dbf75f9b41f5adb9fe59851267bb => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:43:21.992323 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594bc1d9-ff5c-45df-83c9-5f4367be69bc None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:21.992800 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594bc1d9-ff5c-45df-83c9-5f4367be69bc None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:21.993113 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594bc1d9-ff5c-45df-83c9-5f4367be69bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:22.031862 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-594bc1d9-ff5c-45df-83c9-5f4367be69bc None None] MFA Rules not processed for user `a05e022ac55d4ed4b2fa3e6c2b18ea47`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:43:22.033589 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-594bc1d9-ff5c-45df-83c9-5f4367be69bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:22.077956 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:43:22.126673 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5a258f-7308-45e4-9927-eb0341203a57 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:22.129133 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-3f5a258f-7308-45e4-9927-eb0341203a57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:22.148400 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1071/2136] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:43:21 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:43:22.156756 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594bc1d9-ff5c-45df-83c9-5f4367be69bc None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:22.158224 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-594bc1d9-ff5c-45df-83c9-5f4367be69bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:22.230100 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594bc1d9-ff5c-45df-83c9-5f4367be69bc None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:22.233679 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8b86de-d671-42e6-9a75-ed70cfc6cec5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '123eb76f95ee4e39905944da701c712d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:22.234375 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8b86de-d671-42e6-9a75-ed70cfc6cec5 service cinder] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:22.234727 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8b86de-d671-42e6-9a75-ed70cfc6cec5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:22.235069 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8b86de-d671-42e6-9a75-ed70cfc6cec5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:22.236941 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5a258f-7308-45e4-9927-eb0341203a57 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:22.243771 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e905488e-fe9e-4df0-9adb-198772f74172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:22.244427 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e905488e-fe9e-4df0-9adb-198772f74172 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:22.244712 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e905488e-fe9e-4df0-9adb-198772f74172 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:22.244985 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e905488e-fe9e-4df0-9adb-198772f74172 admin admin] PATH_INFO: `/v3/users/45454e51dd64431eac6654c20f6526b3` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:22.246266 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e905488e-fe9e-4df0-9adb-198772f74172 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45454e51dd64431eac6654c20f6526b3)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:22.246966 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8b86de-d671-42e6-9a75-ed70cfc6cec5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:22.247982 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8b86de-d671-42e6-9a75-ed70cfc6cec5 service cinder] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:22.248267 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e905488e-fe9e-4df0-9adb-198772f74172 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:22.266330 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:43:22.270547 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1072/2137] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:43:22 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:43:22.320838 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-e905488e-fe9e-4df0-9adb-198772f74172 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45454e51dd64431eac6654c20f6526b3'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:22.329752 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-e905488e-fe9e-4df0-9adb-198772f74172 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45454e51dd64431eac6654c20f6526b3'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:22.358636 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-e905488e-fe9e-4df0-9adb-198772f74172 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45454e51dd64431eac6654c20f6526b3'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:22.363369 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-e905488e-fe9e-4df0-9adb-198772f74172 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45454e51dd64431eac6654c20f6526b3'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:22.373671 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-e905488e-fe9e-4df0-9adb-198772f74172 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45454e51dd64431eac6654c20f6526b3'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:22.382507 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1066/2138] 10.222.0.70 () {58 vars in 1224 bytes} [Tue Aug 2 21:43:22 2022] DELETE /identity/v3/users/45454e51dd64431eac6654c20f6526b3 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:43:22.386803 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c174fa-745d-4b60-bae1-95aabd19515a None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:22.387642 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c174fa-745d-4b60-bae1-95aabd19515a None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:22.388128 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c174fa-745d-4b60-bae1-95aabd19515a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:22.416217 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-e6c174fa-745d-4b60-bae1-95aabd19515a None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:43:22.418121 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-e6c174fa-745d-4b60-bae1-95aabd19515a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:22.452191 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e905488e-fe9e-4df0-9adb-198772f74172 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:22.454397 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-e905488e-fe9e-4df0-9adb-198772f74172 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:22.493277 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1073/2139] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:43:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:43:22.513119 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c174fa-745d-4b60-bae1-95aabd19515a None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:22.515842 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-e6c174fa-745d-4b60-bae1-95aabd19515a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:22.576462 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e905488e-fe9e-4df0-9adb-198772f74172 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:22.584001 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b90117-6a4c-4741-a9fc-0be46da20c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:22.585320 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b90117-6a4c-4741-a9fc-0be46da20c87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:22.585626 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b90117-6a4c-4741-a9fc-0be46da20c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:22.586670 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b90117-6a4c-4741-a9fc-0be46da20c87 admin admin] PATH_INFO: `/v3/users/de0b4cc591f34cba870f2bb5a03e09d8` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:22.589745 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b90117-6a4c-4741-a9fc-0be46da20c87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de0b4cc591f34cba870f2bb5a03e09d8)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:22.592385 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b90117-6a4c-4741-a9fc-0be46da20c87 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:22.603606 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c174fa-745d-4b60-bae1-95aabd19515a None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:22.620131 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293dbbf1-4981-4b0b-9949-8dbd0b3e337e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '723f5f43572a493dae0349070a2adb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:22.620970 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293dbbf1-4981-4b0b-9949-8dbd0b3e337e service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:22.621263 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293dbbf1-4981-4b0b-9949-8dbd0b3e337e service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:22.621629 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293dbbf1-4981-4b0b-9949-8dbd0b3e337e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:22.633804 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293dbbf1-4981-4b0b-9949-8dbd0b3e337e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:22.635908 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293dbbf1-4981-4b0b-9949-8dbd0b3e337e service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:22.648684 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1074/2140] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:43:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:43:22.656263 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-67b90117-6a4c-4741-a9fc-0be46da20c87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de0b4cc591f34cba870f2bb5a03e09d8'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:22.666304 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-67b90117-6a4c-4741-a9fc-0be46da20c87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de0b4cc591f34cba870f2bb5a03e09d8'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:22.680197 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-67b90117-6a4c-4741-a9fc-0be46da20c87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de0b4cc591f34cba870f2bb5a03e09d8'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:22.681534 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-67b90117-6a4c-4741-a9fc-0be46da20c87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de0b4cc591f34cba870f2bb5a03e09d8'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:22.700657 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-67b90117-6a4c-4741-a9fc-0be46da20c87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de0b4cc591f34cba870f2bb5a03e09d8'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:22.722171 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1067/2141] 10.222.0.70 () {58 vars in 1224 bytes} [Tue Aug 2 21:43:22 2022] DELETE /identity/v3/users/de0b4cc591f34cba870f2bb5a03e09d8 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:43:22.727870 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19edc7ed-1339-4803-9129-85c5078cd690 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:22.728162 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19edc7ed-1339-4803-9129-85c5078cd690 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:22.728469 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19edc7ed-1339-4803-9129-85c5078cd690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:22.755631 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-19edc7ed-1339-4803-9129-85c5078cd690 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:43:22.756569 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-19edc7ed-1339-4803-9129-85c5078cd690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:22.767282 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:43:22.808673 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b90117-6a4c-4741-a9fc-0be46da20c87 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:22.811161 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-67b90117-6a4c-4741-a9fc-0be46da20c87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:22.829971 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:43:22.857550 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1075/2142] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:43:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:43:22.870264 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19edc7ed-1339-4803-9129-85c5078cd690 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:22.871917 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-19edc7ed-1339-4803-9129-85c5078cd690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:22.927201 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b90117-6a4c-4741-a9fc-0be46da20c87 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:22.932171 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb889787-5c4f-4012-81e3-2d30fcbed831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:22.932859 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb889787-5c4f-4012-81e3-2d30fcbed831 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:22.933148 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb889787-5c4f-4012-81e3-2d30fcbed831 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:22.933436 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb889787-5c4f-4012-81e3-2d30fcbed831 admin admin] PATH_INFO: `/v3/users/e61888271eb24116b73d146dadd7dcb6` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:22.934642 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb889787-5c4f-4012-81e3-2d30fcbed831 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e61888271eb24116b73d146dadd7dcb6)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:22.936672 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb889787-5c4f-4012-81e3-2d30fcbed831 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:22.960778 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19edc7ed-1339-4803-9129-85c5078cd690 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:22.964938 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d900b732-39f5-4b3c-9c39-c6dc8deeee76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '723f5f43572a493dae0349070a2adb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:22.965569 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d900b732-39f5-4b3c-9c39-c6dc8deeee76 service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:22.965849 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d900b732-39f5-4b3c-9c39-c6dc8deeee76 service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:22.966128 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d900b732-39f5-4b3c-9c39-c6dc8deeee76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:22.978445 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d900b732-39f5-4b3c-9c39-c6dc8deeee76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:22.980260 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d900b732-39f5-4b3c-9c39-c6dc8deeee76 service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:22.991601 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1076/2143] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:43:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 21:43:23.011446 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-eb889787-5c4f-4012-81e3-2d30fcbed831 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e61888271eb24116b73d146dadd7dcb6'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:23.021487 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d900b732-39f5-4b3c-9c39-c6dc8deeee76 service neutron] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:23.022312 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-eb889787-5c4f-4012-81e3-2d30fcbed831 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e61888271eb24116b73d146dadd7dcb6'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:23.023616 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-d900b732-39f5-4b3c-9c39-c6dc8deeee76 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:23.039166 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d900b732-39f5-4b3c-9c39-c6dc8deeee76 service neutron] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:23.043907 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-eb889787-5c4f-4012-81e3-2d30fcbed831 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e61888271eb24116b73d146dadd7dcb6'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:23.044487 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28457623-be5b-45ee-b18b-2d76cce89af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:23.044967 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-eb889787-5c4f-4012-81e3-2d30fcbed831 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e61888271eb24116b73d146dadd7dcb6'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:23.045723 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28457623-be5b-45ee-b18b-2d76cce89af7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:23.045723 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28457623-be5b-45ee-b18b-2d76cce89af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:23.046222 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28457623-be5b-45ee-b18b-2d76cce89af7 admin admin] PATH_INFO: `/v3/projects/9533341ef961418e8f3f3f221c89842d` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:23.047725 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28457623-be5b-45ee-b18b-2d76cce89af7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9533341ef961418e8f3f3f221c89842d)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:23.050400 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28457623-be5b-45ee-b18b-2d76cce89af7 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:23.056534 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-eb889787-5c4f-4012-81e3-2d30fcbed831 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e61888271eb24116b73d146dadd7dcb6'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:23.070142 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1068/2144] 10.222.0.70 () {58 vars in 1224 bytes} [Tue Aug 2 21:43:22 2022] DELETE /identity/v3/users/e61888271eb24116b73d146dadd7dcb6 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:43:23.125439 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-28457623-be5b-45ee-b18b-2d76cce89af7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9533341ef961418e8f3f3f221c89842d', 'request_id': 'req-28457623-be5b-45ee-b18b-2d76cce89af7'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:23.133403 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-28457623-be5b-45ee-b18b-2d76cce89af7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9533341ef961418e8f3f3f221c89842d', 'request_id': 'req-28457623-be5b-45ee-b18b-2d76cce89af7'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:23.142984 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-28457623-be5b-45ee-b18b-2d76cce89af7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9533341ef961418e8f3f3f221c89842d', 'request_id': 'req-28457623-be5b-45ee-b18b-2d76cce89af7'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:23.157425 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-28457623-be5b-45ee-b18b-2d76cce89af7 admin admin] The token cache is being invalidate because project 9533341ef961418e8f3f3f221c89842d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:43:23.158298 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-28457623-be5b-45ee-b18b-2d76cce89af7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:23.159165 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-28457623-be5b-45ee-b18b-2d76cce89af7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:23.169125 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1077/2145] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Aug 2 21:43:23 2022] DELETE /identity/v3/projects/9533341ef961418e8f3f3f221c89842d => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:43:23.425420 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb889787-5c4f-4012-81e3-2d30fcbed831 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:23.426882 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-eb889787-5c4f-4012-81e3-2d30fcbed831 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:23.502030 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb889787-5c4f-4012-81e3-2d30fcbed831 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:23.527522 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28457623-be5b-45ee-b18b-2d76cce89af7 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:23.529330 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-28457623-be5b-45ee-b18b-2d76cce89af7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:23.549990 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:43:23.584665 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17af7488-50bc-409e-bc1a-fa2bf5eb4007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:23.585652 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17af7488-50bc-409e-bc1a-fa2bf5eb4007 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:23.585909 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:43:23.586070 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17af7488-50bc-409e-bc1a-fa2bf5eb4007 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:23.586404 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17af7488-50bc-409e-bc1a-fa2bf5eb4007 admin admin] PATH_INFO: `/v3/projects/cdf0c2f942254083a61dbd3936a2d4ed` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:23.588076 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17af7488-50bc-409e-bc1a-fa2bf5eb4007 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdf0c2f942254083a61dbd3936a2d4ed)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:23.591029 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17af7488-50bc-409e-bc1a-fa2bf5eb4007 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:23.615448 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28457623-be5b-45ee-b18b-2d76cce89af7 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:23.620691 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd03985d-bfc4-4bfb-8ab5-fc9ace03397c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:23.621345 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd03985d-bfc4-4bfb-8ab5-fc9ace03397c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:23.621634 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd03985d-bfc4-4bfb-8ab5-fc9ace03397c admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:23.628695 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd03985d-bfc4-4bfb-8ab5-fc9ace03397c admin admin] PATH_INFO: `/v3/projects/7537c79f6aac43c9a49cbe1e9af531bc` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:23.630351 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd03985d-bfc4-4bfb-8ab5-fc9ace03397c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7537c79f6aac43c9a49cbe1e9af531bc)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:23.633426 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd03985d-bfc4-4bfb-8ab5-fc9ace03397c admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:23.664711 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-17af7488-50bc-409e-bc1a-fa2bf5eb4007 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdf0c2f942254083a61dbd3936a2d4ed', 'request_id': 'req-17af7488-50bc-409e-bc1a-fa2bf5eb4007'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:23.673747 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-17af7488-50bc-409e-bc1a-fa2bf5eb4007 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdf0c2f942254083a61dbd3936a2d4ed', 'request_id': 'req-17af7488-50bc-409e-bc1a-fa2bf5eb4007'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:23.680964 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-17af7488-50bc-409e-bc1a-fa2bf5eb4007 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdf0c2f942254083a61dbd3936a2d4ed', 'request_id': 'req-17af7488-50bc-409e-bc1a-fa2bf5eb4007'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:23.696607 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-bd03985d-bfc4-4bfb-8ab5-fc9ace03397c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7537c79f6aac43c9a49cbe1e9af531bc', 'request_id': 'req-bd03985d-bfc4-4bfb-8ab5-fc9ace03397c'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:23.696838 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-17af7488-50bc-409e-bc1a-fa2bf5eb4007 admin admin] The token cache is being invalidate because project cdf0c2f942254083a61dbd3936a2d4ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:43:23.697233 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-17af7488-50bc-409e-bc1a-fa2bf5eb4007 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:23.697985 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-17af7488-50bc-409e-bc1a-fa2bf5eb4007 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:23.699849 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1069/2146] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Aug 2 21:43:23 2022] DELETE /identity/v3/projects/cdf0c2f942254083a61dbd3936a2d4ed => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:43:23.702614 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-bd03985d-bfc4-4bfb-8ab5-fc9ace03397c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7537c79f6aac43c9a49cbe1e9af531bc', 'request_id': 'req-bd03985d-bfc4-4bfb-8ab5-fc9ace03397c'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:23.704925 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4cf083-b817-42cb-a4d1-3537f152097b None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:23.706876 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4cf083-b817-42cb-a4d1-3537f152097b None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:23.708533 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4cf083-b817-42cb-a4d1-3537f152097b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:23.713098 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-bd03985d-bfc4-4bfb-8ab5-fc9ace03397c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7537c79f6aac43c9a49cbe1e9af531bc', 'request_id': 'req-bd03985d-bfc4-4bfb-8ab5-fc9ace03397c'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:23.735214 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-bd03985d-bfc4-4bfb-8ab5-fc9ace03397c admin admin] The token cache is being invalidate because project 7537c79f6aac43c9a49cbe1e9af531bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:43:23.735694 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-bd03985d-bfc4-4bfb-8ab5-fc9ace03397c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:23.736069 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-4f4cf083-b817-42cb-a4d1-3537f152097b None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:43:23.736851 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-bd03985d-bfc4-4bfb-8ab5-fc9ace03397c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:23.737772 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-4f4cf083-b817-42cb-a4d1-3537f152097b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:23.738892 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1078/2147] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Aug 2 21:43:23 2022] DELETE /identity/v3/projects/7537c79f6aac43c9a49cbe1e9af531bc => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:43:23.742696 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd03985d-bfc4-4bfb-8ab5-fc9ace03397c admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:23.744067 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-bd03985d-bfc4-4bfb-8ab5-fc9ace03397c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:23.860920 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1070/2148] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:43:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:43:23.861906 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd03985d-bfc4-4bfb-8ab5-fc9ace03397c admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:23.867220 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03e1af4-da4b-4f53-8edd-086be7f3edab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:23.867879 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e1af4-da4b-4f53-8edd-086be7f3edab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:23.868165 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e1af4-da4b-4f53-8edd-086be7f3edab admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:23.868472 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03e1af4-da4b-4f53-8edd-086be7f3edab admin admin] PATH_INFO: `/v3/users/a05e022ac55d4ed4b2fa3e6c2b18ea47` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:23.869864 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e304b877-27d5-4660-80ca-e33a0d9b8120 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:23.870002 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03e1af4-da4b-4f53-8edd-086be7f3edab admin admin] RBAC: Authorizing `identity:delete_user(user_id=a05e022ac55d4ed4b2fa3e6c2b18ea47)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:23.870097 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e304b877-27d5-4660-80ca-e33a0d9b8120 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:23.870097 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e304b877-27d5-4660-80ca-e33a0d9b8120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:23.871982 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03e1af4-da4b-4f53-8edd-086be7f3edab admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:23.895916 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-e304b877-27d5-4660-80ca-e33a0d9b8120 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:43:23.899279 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-e304b877-27d5-4660-80ca-e33a0d9b8120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:23.913702 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1071/2149] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:43:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:43:23.914611 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e304b877-27d5-4660-80ca-e33a0d9b8120 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:23.926065 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e304b877-27d5-4660-80ca-e33a0d9b8120 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:23.927295 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-a03e1af4-da4b-4f53-8edd-086be7f3edab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a05e022ac55d4ed4b2fa3e6c2b18ea47'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:23.932475 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b8171a-2eb2-4a07-b166-f8e94e35d716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:23.933147 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b8171a-2eb2-4a07-b166-f8e94e35d716 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:23.933439 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b8171a-2eb2-4a07-b166-f8e94e35d716 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:23.933706 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b8171a-2eb2-4a07-b166-f8e94e35d716 admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:23.934446 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b8171a-2eb2-4a07-b166-f8e94e35d716 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:43:23.934756 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b8171a-2eb2-4a07-b166-f8e94e35d716 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:23.935868 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-a03e1af4-da4b-4f53-8edd-086be7f3edab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a05e022ac55d4ed4b2fa3e6c2b18ea47'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:23.936540 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b8171a-2eb2-4a07-b166-f8e94e35d716 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:23.952439 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1072/2150] 10.222.0.70 () {58 vars in 1153 bytes} [Tue Aug 2 21:43:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:43:23.954457 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b8171a-2eb2-4a07-b166-f8e94e35d716 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:23.955345 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-a03e1af4-da4b-4f53-8edd-086be7f3edab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a05e022ac55d4ed4b2fa3e6c2b18ea47'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:23.958322 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:43:23.965388 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b8171a-2eb2-4a07-b166-f8e94e35d716 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:23.965821 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-a03e1af4-da4b-4f53-8edd-086be7f3edab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a05e022ac55d4ed4b2fa3e6c2b18ea47'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:23.967260 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-a03e1af4-da4b-4f53-8edd-086be7f3edab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a05e022ac55d4ed4b2fa3e6c2b18ea47'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:23.971114 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc78368-9d96-44ff-a43d-efc9ba9452be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:23.971871 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc78368-9d96-44ff-a43d-efc9ba9452be admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:23.972296 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc78368-9d96-44ff-a43d-efc9ba9452be admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:23.972693 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc78368-9d96-44ff-a43d-efc9ba9452be admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:23.974044 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc78368-9d96-44ff-a43d-efc9ba9452be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:23.975512 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1079/2151] 10.222.0.70 () {58 vars in 1224 bytes} [Tue Aug 2 21:43:23 2022] DELETE /identity/v3/users/a05e022ac55d4ed4b2fa3e6c2b18ea47 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:43:23.977088 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc78368-9d96-44ff-a43d-efc9ba9452be admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:24.033337 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1073/2152] 10.222.0.70 () {60 vars in 1153 bytes} [Tue Aug 2 21:43:23 2022] POST /identity/v3/projects => generated 391 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 21:43:24.038188 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03e1af4-da4b-4f53-8edd-086be7f3edab admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:24.039722 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-a03e1af4-da4b-4f53-8edd-086be7f3edab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:24.128159 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03e1af4-da4b-4f53-8edd-086be7f3edab admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:24.214772 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42826071-2e9f-4575-9860-4265f318fc9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:24.215474 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42826071-2e9f-4575-9860-4265f318fc9e admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:24.215766 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42826071-2e9f-4575-9860-4265f318fc9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:24.216049 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42826071-2e9f-4575-9860-4265f318fc9e admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:24.217332 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42826071-2e9f-4575-9860-4265f318fc9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:24.220185 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42826071-2e9f-4575-9860-4265f318fc9e admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:24.249967 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1080/2153] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 2 21:43:24 2022] POST /identity/v3/users => generated 296 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:43:24.254434 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc78368-9d96-44ff-a43d-efc9ba9452be admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:24.269237 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc78368-9d96-44ff-a43d-efc9ba9452be admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:24.276558 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809bb159-e415-4bef-bedc-39b107a5032b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:24.277328 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809bb159-e415-4bef-bedc-39b107a5032b admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:24.277744 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809bb159-e415-4bef-bedc-39b107a5032b admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:24.278034 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809bb159-e415-4bef-bedc-39b107a5032b admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:24.279677 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809bb159-e415-4bef-bedc-39b107a5032b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:24.281938 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809bb159-e415-4bef-bedc-39b107a5032b admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:24.309145 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42826071-2e9f-4575-9860-4265f318fc9e admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:24.310278 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1074/2154] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:43:24 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 21:43:24.317277 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809bb159-e415-4bef-bedc-39b107a5032b admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:24.322008 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42826071-2e9f-4575-9860-4265f318fc9e admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:24.323406 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-809bb159-e415-4bef-bedc-39b107a5032b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:24.331449 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9565182-f87b-4281-ad8c-8bde559857c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:24.332087 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9565182-f87b-4281-ad8c-8bde559857c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:24.332401 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9565182-f87b-4281-ad8c-8bde559857c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:24.333247 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9565182-f87b-4281-ad8c-8bde559857c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:24.333953 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9565182-f87b-4281-ad8c-8bde559857c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:24.335801 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9565182-f87b-4281-ad8c-8bde559857c9 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:24.359002 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809bb159-e415-4bef-bedc-39b107a5032b admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:24.359341 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1081/2155] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:43:24 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 21:43:24.363306 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9565182-f87b-4281-ad8c-8bde559857c9 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:24.370128 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235b9d7f-3fdf-45ea-b691-7d44401415fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:24.370884 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235b9d7f-3fdf-45ea-b691-7d44401415fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:24.371243 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235b9d7f-3fdf-45ea-b691-7d44401415fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:24.371628 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235b9d7f-3fdf-45ea-b691-7d44401415fa admin admin] PATH_INFO: `/v3/projects/a25e43c4bfeb44e5af59a3fd60e50c98` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:24.373106 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235b9d7f-3fdf-45ea-b691-7d44401415fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=a25e43c4bfeb44e5af59a3fd60e50c98)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:24.376174 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235b9d7f-3fdf-45ea-b691-7d44401415fa admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:24.376608 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9565182-f87b-4281-ad8c-8bde559857c9 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:24.382071 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bd575b-2cb4-4202-a052-884bebec62ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:24.382980 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bd575b-2cb4-4202-a052-884bebec62ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:24.383416 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bd575b-2cb4-4202-a052-884bebec62ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:24.383867 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bd575b-2cb4-4202-a052-884bebec62ac admin admin] PATH_INFO: `/v3/projects/93aa51219ccc4be5ab40adbf04388355/users/4f0184e3d56d425bb07e62407f658ca0/roles/462e3381a85c42a9959201f9aa122f7c` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:24.388324 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:43:24.403761 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bd575b-2cb4-4202-a052-884bebec62ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=93aa51219ccc4be5ab40adbf04388355, user_id=4f0184e3d56d425bb07e62407f658ca0, role_id=462e3381a85c42a9959201f9aa122f7c)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:24.408087 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bd575b-2cb4-4202-a052-884bebec62ac admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:24.434809 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1082/2156] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:43:24 2022] PUT /identity/v3/projects/93aa51219ccc4be5ab40adbf04388355/users/4f0184e3d56d425bb07e62407f658ca0/roles/462e3381a85c42a9959201f9aa122f7c => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:43:24.446952 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb8bfe9-6967-4c52-8f52-76da4e8827ab None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:24.447252 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb8bfe9-6967-4c52-8f52-76da4e8827ab None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:24.447397 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-235b9d7f-3fdf-45ea-b691-7d44401415fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a25e43c4bfeb44e5af59a3fd60e50c98', 'request_id': 'req-235b9d7f-3fdf-45ea-b691-7d44401415fa'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:24.447540 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb8bfe9-6967-4c52-8f52-76da4e8827ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:24.463172 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-235b9d7f-3fdf-45ea-b691-7d44401415fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a25e43c4bfeb44e5af59a3fd60e50c98', 'request_id': 'req-235b9d7f-3fdf-45ea-b691-7d44401415fa'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:24.473142 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-235b9d7f-3fdf-45ea-b691-7d44401415fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a25e43c4bfeb44e5af59a3fd60e50c98', 'request_id': 'req-235b9d7f-3fdf-45ea-b691-7d44401415fa'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:24.492274 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-dbb8bfe9-6967-4c52-8f52-76da4e8827ab None None] MFA Rules not processed for user `4f0184e3d56d425bb07e62407f658ca0`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:43:24.493124 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-235b9d7f-3fdf-45ea-b691-7d44401415fa admin admin] The token cache is being invalidate because project a25e43c4bfeb44e5af59a3fd60e50c98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:43:24.493435 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-235b9d7f-3fdf-45ea-b691-7d44401415fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:24.494143 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-235b9d7f-3fdf-45ea-b691-7d44401415fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:24.494336 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-dbb8bfe9-6967-4c52-8f52-76da4e8827ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:24.496094 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1075/2157] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Aug 2 21:43:24 2022] DELETE /identity/v3/projects/a25e43c4bfeb44e5af59a3fd60e50c98 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:43:24.501084 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e249d68e-a37c-4c30-a9aa-ac76d6890920 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:24.501473 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e249d68e-a37c-4c30-a9aa-ac76d6890920 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:24.501871 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e249d68e-a37c-4c30-a9aa-ac76d6890920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:24.525995 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-e249d68e-a37c-4c30-a9aa-ac76d6890920 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:43:24.527292 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-e249d68e-a37c-4c30-a9aa-ac76d6890920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:24.555120 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:43:24.590338 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1083/2158] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:43:24 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:43:24.603230 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb8bfe9-6967-4c52-8f52-76da4e8827ab None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:24.605405 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-dbb8bfe9-6967-4c52-8f52-76da4e8827ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:24.612351 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1076/2159] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:43:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:43:24.617910 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ab28d-3baa-48df-a6cb-f00487c697f5 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:24.618225 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ab28d-3baa-48df-a6cb-f00487c697f5 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:24.618540 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ab28d-3baa-48df-a6cb-f00487c697f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:24.639070 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-1f7ab28d-3baa-48df-a6cb-f00487c697f5 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:43:24.640320 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-1f7ab28d-3baa-48df-a6cb-f00487c697f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:24.648911 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1077/2160] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:43:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:43:24.653464 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7ab28d-3baa-48df-a6cb-f00487c697f5 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:24.664538 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7ab28d-3baa-48df-a6cb-f00487c697f5 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:24.670804 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077bc2a6-76ad-4b74-8ffd-e847ef6f325a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:24.671429 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077bc2a6-76ad-4b74-8ffd-e847ef6f325a admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:24.671763 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077bc2a6-76ad-4b74-8ffd-e847ef6f325a admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:24.672047 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077bc2a6-76ad-4b74-8ffd-e847ef6f325a admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:24.672798 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077bc2a6-76ad-4b74-8ffd-e847ef6f325a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:43:24.673107 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077bc2a6-76ad-4b74-8ffd-e847ef6f325a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:24.675037 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077bc2a6-76ad-4b74-8ffd-e847ef6f325a admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:24.678565 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb8bfe9-6967-4c52-8f52-76da4e8827ab None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:24.682404 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76694b3d-4519-4497-875f-5166411c4633 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '123eb76f95ee4e39905944da701c712d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:24.683158 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76694b3d-4519-4497-875f-5166411c4633 service cinder] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:24.683541 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76694b3d-4519-4497-875f-5166411c4633 service cinder] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:24.684401 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76694b3d-4519-4497-875f-5166411c4633 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:24.692127 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1078/2161] 10.222.0.70 () {58 vars in 1153 bytes} [Tue Aug 2 21:43:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:43:24.694312 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76694b3d-4519-4497-875f-5166411c4633 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:24.695870 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76694b3d-4519-4497-875f-5166411c4633 service cinder] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:24.697220 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077bc2a6-76ad-4b74-8ffd-e847ef6f325a admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:24.705884 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1084/2162] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:43:24 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:43:24.708752 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077bc2a6-76ad-4b74-8ffd-e847ef6f325a admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:24.713502 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad4889d-c0a7-4bda-bebe-6b7051b55649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:24.714113 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad4889d-c0a7-4bda-bebe-6b7051b55649 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:24.714404 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad4889d-c0a7-4bda-bebe-6b7051b55649 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:24.714656 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad4889d-c0a7-4bda-bebe-6b7051b55649 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:24.715328 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad4889d-c0a7-4bda-bebe-6b7051b55649 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:24.717249 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad4889d-c0a7-4bda-bebe-6b7051b55649 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:24.752442 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1079/2163] 10.222.0.70 () {60 vars in 1153 bytes} [Tue Aug 2 21:43:24 2022] POST /identity/v3/projects => generated 381 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 21:43:24.757922 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76694b3d-4519-4497-875f-5166411c4633 service cinder] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:24.770908 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76694b3d-4519-4497-875f-5166411c4633 service cinder] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:24.839138 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e242f8f-bbcc-4672-84b2-e173dd562ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:24.839776 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e242f8f-bbcc-4672-84b2-e173dd562ffd admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:24.840063 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e242f8f-bbcc-4672-84b2-e173dd562ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:24.840392 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e242f8f-bbcc-4672-84b2-e173dd562ffd admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:24.841136 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e242f8f-bbcc-4672-84b2-e173dd562ffd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:24.843016 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e242f8f-bbcc-4672-84b2-e173dd562ffd admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:24.870187 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1085/2164] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 2 21:43:24 2022] POST /identity/v3/users => generated 291 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:43:24.874534 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad4889d-c0a7-4bda-bebe-6b7051b55649 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:24.885326 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad4889d-c0a7-4bda-bebe-6b7051b55649 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:24.891439 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dd0f84-9c2c-4336-b198-99fdc6a4a373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:24.891439 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd0f84-9c2c-4336-b198-99fdc6a4a373 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:24.891687 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd0f84-9c2c-4336-b198-99fdc6a4a373 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:24.892038 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dd0f84-9c2c-4336-b198-99fdc6a4a373 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:24.892883 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dd0f84-9c2c-4336-b198-99fdc6a4a373 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:24.894591 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dd0f84-9c2c-4336-b198-99fdc6a4a373 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:24.913125 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1080/2165] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:43:24 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:43:24.913827 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e242f8f-bbcc-4672-84b2-e173dd562ffd admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:24.924257 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e242f8f-bbcc-4672-84b2-e173dd562ffd admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:24.929401 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667b750f-92cf-49eb-bb0a-4b356a9a458b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:24.930016 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667b750f-92cf-49eb-bb0a-4b356a9a458b admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:24.930292 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667b750f-92cf-49eb-bb0a-4b356a9a458b admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:24.930566 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667b750f-92cf-49eb-bb0a-4b356a9a458b admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:24.931254 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667b750f-92cf-49eb-bb0a-4b356a9a458b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:24.932887 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667b750f-92cf-49eb-bb0a-4b356a9a458b admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:24.945954 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1086/2166] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:43:24 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:43:24.950413 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dd0f84-9c2c-4336-b198-99fdc6a4a373 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:24.968026 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dd0f84-9c2c-4336-b198-99fdc6a4a373 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:24.975478 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe36ec8-17c2-48ba-a8b2-6ea814f70a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:24.976380 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe36ec8-17c2-48ba-a8b2-6ea814f70a3a admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:24.976756 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe36ec8-17c2-48ba-a8b2-6ea814f70a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:24.977110 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe36ec8-17c2-48ba-a8b2-6ea814f70a3a admin admin] PATH_INFO: `/v3/projects/42776f70243644d49f4309a5ed23276a/users/c92fe8a6eb9048d088cead105f90e543/roles/462e3381a85c42a9959201f9aa122f7c` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:24.992156 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b66e12f-d27f-4f5a-9e7d-df29814d2817 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:24.993004 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b66e12f-d27f-4f5a-9e7d-df29814d2817 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:24.993004 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b66e12f-d27f-4f5a-9e7d-df29814d2817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:25.008290 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe36ec8-17c2-48ba-a8b2-6ea814f70a3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=42776f70243644d49f4309a5ed23276a, user_id=c92fe8a6eb9048d088cead105f90e543, role_id=462e3381a85c42a9959201f9aa122f7c)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:25.011186 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe36ec8-17c2-48ba-a8b2-6ea814f70a3a admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:25.019550 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-5b66e12f-d27f-4f5a-9e7d-df29814d2817 None None] MFA Rules not processed for user `3081e110cdd94b8aa51f7bb237aec635`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:43:25.029516 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1081/2167] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:43:24 2022] PUT /identity/v3/projects/42776f70243644d49f4309a5ed23276a/users/c92fe8a6eb9048d088cead105f90e543/roles/462e3381a85c42a9959201f9aa122f7c => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:43:25.033534 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-5b66e12f-d27f-4f5a-9e7d-df29814d2817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:25.040993 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b11cdd-f4cc-41c4-a654-a725fb5d020e None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:25.041292 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b11cdd-f4cc-41c4-a654-a725fb5d020e None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:25.041588 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b11cdd-f4cc-41c4-a654-a725fb5d020e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:25.079406 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-74b11cdd-f4cc-41c4-a654-a725fb5d020e None None] MFA Rules not processed for user `c92fe8a6eb9048d088cead105f90e543`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:43:25.080873 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-74b11cdd-f4cc-41c4-a654-a725fb5d020e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:25.092387 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:43:25.122690 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1087/2168] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:43:24 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:43:25.176385 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1082/2169] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:43:25 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:43:25.181562 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b66e12f-d27f-4f5a-9e7d-df29814d2817 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:25.191640 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:43:25.261053 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b66e12f-d27f-4f5a-9e7d-df29814d2817 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:25.265838 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3633a21-f8bf-4ef0-ada2-6a226be858d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:25.266648 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3633a21-f8bf-4ef0-ada2-6a226be858d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:25.266995 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3633a21-f8bf-4ef0-ada2-6a226be858d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:25.267338 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3633a21-f8bf-4ef0-ada2-6a226be858d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:25.268005 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3633a21-f8bf-4ef0-ada2-6a226be858d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:25.270115 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3633a21-f8bf-4ef0-ada2-6a226be858d5 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:25.300031 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1088/2170] 10.222.0.70 () {60 vars in 1153 bytes} [Tue Aug 2 21:43:25 2022] POST /identity/v3/projects => generated 379 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:43:25.304466 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b11cdd-f4cc-41c4-a654-a725fb5d020e None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:25.315571 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b11cdd-f4cc-41c4-a654-a725fb5d020e None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:25.376682 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd055a1-e5a4-4977-8e4c-d21055ca5c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:25.377119 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd055a1-e5a4-4977-8e4c-d21055ca5c30 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:25.377485 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd055a1-e5a4-4977-8e4c-d21055ca5c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:25.377728 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd055a1-e5a4-4977-8e4c-d21055ca5c30 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:25.378377 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd055a1-e5a4-4977-8e4c-d21055ca5c30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:25.380411 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd055a1-e5a4-4977-8e4c-d21055ca5c30 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:25.404619 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1083/2171] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 2 21:43:25 2022] POST /identity/v3/users => generated 296 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:43:25.408773 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3633a21-f8bf-4ef0-ada2-6a226be858d5 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:25.420198 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3633a21-f8bf-4ef0-ada2-6a226be858d5 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:25.425164 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c89cb0-1a8f-4eff-86c9-c2dccda51b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:25.425920 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c89cb0-1a8f-4eff-86c9-c2dccda51b46 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:25.426259 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c89cb0-1a8f-4eff-86c9-c2dccda51b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:25.427259 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c89cb0-1a8f-4eff-86c9-c2dccda51b46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:25.428024 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c89cb0-1a8f-4eff-86c9-c2dccda51b46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:25.429750 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c89cb0-1a8f-4eff-86c9-c2dccda51b46 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:25.451802 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1089/2172] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:43:25 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:43:25.453393 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd055a1-e5a4-4977-8e4c-d21055ca5c30 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:25.467615 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd055a1-e5a4-4977-8e4c-d21055ca5c30 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:25.472791 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58fb587-48b6-41c2-bcea-50296c069995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:25.474016 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58fb587-48b6-41c2-bcea-50296c069995 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:25.474319 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58fb587-48b6-41c2-bcea-50296c069995 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:25.474696 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58fb587-48b6-41c2-bcea-50296c069995 admin admin] PATH_INFO: `/v3/projects/06a17812662342ada15b558f2ebae8a7/users/c8633e29810c41ad89015fdb82eb3679/roles/3e32dbf75f9b41f5adb9fe59851267bb` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:25.491908 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58fb587-48b6-41c2-bcea-50296c069995 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06a17812662342ada15b558f2ebae8a7, user_id=c8633e29810c41ad89015fdb82eb3679, role_id=3e32dbf75f9b41f5adb9fe59851267bb)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:25.494650 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58fb587-48b6-41c2-bcea-50296c069995 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:25.517784 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1084/2173] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:43:25 2022] PUT /identity/v3/projects/06a17812662342ada15b558f2ebae8a7/users/c8633e29810c41ad89015fdb82eb3679/roles/3e32dbf75f9b41f5adb9fe59851267bb => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:43:25.518404 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c89cb0-1a8f-4eff-86c9-c2dccda51b46 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:25.530799 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c89cb0-1a8f-4eff-86c9-c2dccda51b46 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:25.614585 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735fa115-6136-4faa-bb1b-f9f65365f879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:25.615297 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735fa115-6136-4faa-bb1b-f9f65365f879 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:25.615384 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735fa115-6136-4faa-bb1b-f9f65365f879 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:25.615717 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735fa115-6136-4faa-bb1b-f9f65365f879 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:25.616461 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735fa115-6136-4faa-bb1b-f9f65365f879 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:25.618263 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735fa115-6136-4faa-bb1b-f9f65365f879 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:25.636475 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58fb587-48b6-41c2-bcea-50296c069995 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:25.642327 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1090/2174] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:43:25 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:43:25.648642 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58fb587-48b6-41c2-bcea-50296c069995 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:25.656025 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980c9075-d19f-4618-b928-e96c380c06c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:25.656914 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980c9075-d19f-4618-b928-e96c380c06c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:25.657287 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980c9075-d19f-4618-b928-e96c380c06c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:25.657573 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980c9075-d19f-4618-b928-e96c380c06c9 admin admin] PATH_INFO: `/v3/projects/06a17812662342ada15b558f2ebae8a7/users/c8633e29810c41ad89015fdb82eb3679/roles/3e32dbf75f9b41f5adb9fe59851267bb` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:25.659803 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980c9075-d19f-4618-b928-e96c380c06c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06a17812662342ada15b558f2ebae8a7, user_id=c8633e29810c41ad89015fdb82eb3679, role_id=3e32dbf75f9b41f5adb9fe59851267bb)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:25.663480 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980c9075-d19f-4618-b928-e96c380c06c9 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:25.675674 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1085/2175] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:43:25 2022] PUT /identity/v3/projects/06a17812662342ada15b558f2ebae8a7/users/c8633e29810c41ad89015fdb82eb3679/roles/3e32dbf75f9b41f5adb9fe59851267bb => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:43:25.686531 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ce7c8a-feb2-493e-aa4b-8add2dfd5383 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:25.686821 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ce7c8a-feb2-493e-aa4b-8add2dfd5383 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:25.687111 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ce7c8a-feb2-493e-aa4b-8add2dfd5383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:25.733797 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-47ce7c8a-feb2-493e-aa4b-8add2dfd5383 None None] MFA Rules not processed for user `c8633e29810c41ad89015fdb82eb3679`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:43:25.733797 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-47ce7c8a-feb2-493e-aa4b-8add2dfd5383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:25.820370 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1091/2176] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:43:25 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:43:25.831856 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980c9075-d19f-4618-b928-e96c380c06c9 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:25.903194 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980c9075-d19f-4618-b928-e96c380c06c9 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:25.907106 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dce5d87-f268-4a74-8a34-5c2e4ce95522 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '123eb76f95ee4e39905944da701c712d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:25.907731 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce5d87-f268-4a74-8a34-5c2e4ce95522 service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:25.908016 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce5d87-f268-4a74-8a34-5c2e4ce95522 service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:25.908326 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dce5d87-f268-4a74-8a34-5c2e4ce95522 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:25.918942 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dce5d87-f268-4a74-8a34-5c2e4ce95522 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:25.920457 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dce5d87-f268-4a74-8a34-5c2e4ce95522 service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:25.931362 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1086/2177] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:43:25 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:43:26.463428 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ce7c8a-feb2-493e-aa4b-8add2dfd5383 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:26.470629 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:43:26.558317 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ce7c8a-feb2-493e-aa4b-8add2dfd5383 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:26.563740 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d8b8ed-8b21-4db5-accb-49445ddf5f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:26.564420 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d8b8ed-8b21-4db5-accb-49445ddf5f39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:26.564705 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d8b8ed-8b21-4db5-accb-49445ddf5f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:26.565135 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d8b8ed-8b21-4db5-accb-49445ddf5f39 admin admin] PATH_INFO: `/v3/users/c92fe8a6eb9048d088cead105f90e543` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:26.566578 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d8b8ed-8b21-4db5-accb-49445ddf5f39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c92fe8a6eb9048d088cead105f90e543)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:26.569330 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d8b8ed-8b21-4db5-accb-49445ddf5f39 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:26.624595 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-39d8b8ed-8b21-4db5-accb-49445ddf5f39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c92fe8a6eb9048d088cead105f90e543'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:26.634068 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-39d8b8ed-8b21-4db5-accb-49445ddf5f39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c92fe8a6eb9048d088cead105f90e543'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:26.648940 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-39d8b8ed-8b21-4db5-accb-49445ddf5f39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c92fe8a6eb9048d088cead105f90e543'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:26.661059 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-39d8b8ed-8b21-4db5-accb-49445ddf5f39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c92fe8a6eb9048d088cead105f90e543'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:26.662838 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-39d8b8ed-8b21-4db5-accb-49445ddf5f39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c92fe8a6eb9048d088cead105f90e543'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:26.669534 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1092/2178] 10.222.0.70 () {58 vars in 1224 bytes} [Tue Aug 2 21:43:26 2022] DELETE /identity/v3/users/c92fe8a6eb9048d088cead105f90e543 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:43:26.674077 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e549744-8db6-49fb-bc51-debb2aefb665 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:26.674562 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e549744-8db6-49fb-bc51-debb2aefb665 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:26.674672 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e549744-8db6-49fb-bc51-debb2aefb665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:26.684070 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:43:26.699074 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-1e549744-8db6-49fb-bc51-debb2aefb665 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:43:26.700780 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-1e549744-8db6-49fb-bc51-debb2aefb665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:26.732142 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3572fff-9d03-41c7-b802-d44bde52a71f None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:26.732481 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3572fff-9d03-41c7-b802-d44bde52a71f None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:26.732764 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3572fff-9d03-41c7-b802-d44bde52a71f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:26.753652 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-f3572fff-9d03-41c7-b802-d44bde52a71f None None] MFA Rules not processed for user `6be7b2bcfebd45389ca289c34fbabc3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:43:26.754901 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-f3572fff-9d03-41c7-b802-d44bde52a71f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:26.769775 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1087/2179] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:43:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:43:26.781006 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e549744-8db6-49fb-bc51-debb2aefb665 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:26.782570 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-1e549744-8db6-49fb-bc51-debb2aefb665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:26.821281 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1093/2180] 10.222.0.70 () {58 vars in 1009 bytes} [Tue Aug 2 21:43:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:43:26.836160 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3572fff-9d03-41c7-b802-d44bde52a71f None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:26.837679 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-f3572fff-9d03-41c7-b802-d44bde52a71f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:26.860977 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e549744-8db6-49fb-bc51-debb2aefb665 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:26.865464 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27c9837-4797-4350-bc4e-d7fdc7c6dc0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '723f5f43572a493dae0349070a2adb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:26.866280 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27c9837-4797-4350-bc4e-d7fdc7c6dc0f service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:26.866611 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27c9837-4797-4350-bc4e-d7fdc7c6dc0f service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:26.866893 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27c9837-4797-4350-bc4e-d7fdc7c6dc0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:26.873876 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:43:26.877988 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27c9837-4797-4350-bc4e-d7fdc7c6dc0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:26.879992 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27c9837-4797-4350-bc4e-d7fdc7c6dc0f service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:26.890270 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1088/2181] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:43:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 21:43:26.943728 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3572fff-9d03-41c7-b802-d44bde52a71f None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:26.949413 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6101670-58b7-4637-8fc7-814d1c91a0b8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee7ebf40212465aac997b461a2d10fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:26.950051 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6101670-58b7-4637-8fc7-814d1c91a0b8 service swift] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:26.950335 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6101670-58b7-4637-8fc7-814d1c91a0b8 service swift] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:26.950657 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6101670-58b7-4637-8fc7-814d1c91a0b8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:26.962801 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6101670-58b7-4637-8fc7-814d1c91a0b8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:26.964807 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6101670-58b7-4637-8fc7-814d1c91a0b8 service swift] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:26.974651 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1094/2182] 10.222.0.70 () {60 vars in 1384 bytes} [Tue Aug 2 21:43:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 02 21:43:27.288131 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27c9837-4797-4350-bc4e-d7fdc7c6dc0f service neutron] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:27.290776 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-f27c9837-4797-4350-bc4e-d7fdc7c6dc0f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:27.312869 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27c9837-4797-4350-bc4e-d7fdc7c6dc0f service neutron] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:27.326131 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cf3d8f-9925-4569-99d0-8da85be62d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:27.326856 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cf3d8f-9925-4569-99d0-8da85be62d96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:27.327144 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cf3d8f-9925-4569-99d0-8da85be62d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:27.327420 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cf3d8f-9925-4569-99d0-8da85be62d96 admin admin] PATH_INFO: `/v3/projects/42776f70243644d49f4309a5ed23276a` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:27.329865 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cf3d8f-9925-4569-99d0-8da85be62d96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42776f70243644d49f4309a5ed23276a)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:27.337381 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cf3d8f-9925-4569-99d0-8da85be62d96 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:27.468014 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-e3cf3d8f-9925-4569-99d0-8da85be62d96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42776f70243644d49f4309a5ed23276a', 'request_id': 'req-e3cf3d8f-9925-4569-99d0-8da85be62d96'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:27.486228 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-e3cf3d8f-9925-4569-99d0-8da85be62d96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42776f70243644d49f4309a5ed23276a', 'request_id': 'req-e3cf3d8f-9925-4569-99d0-8da85be62d96'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:27.494698 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-e3cf3d8f-9925-4569-99d0-8da85be62d96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42776f70243644d49f4309a5ed23276a', 'request_id': 'req-e3cf3d8f-9925-4569-99d0-8da85be62d96'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:27.519600 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-e3cf3d8f-9925-4569-99d0-8da85be62d96 admin admin] The token cache is being invalidate because project 42776f70243644d49f4309a5ed23276a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:43:27.519899 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-e3cf3d8f-9925-4569-99d0-8da85be62d96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:27.521072 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-e3cf3d8f-9925-4569-99d0-8da85be62d96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:27.524533 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1089/2183] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Aug 2 21:43:27 2022] DELETE /identity/v3/projects/42776f70243644d49f4309a5ed23276a => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:43:27.528563 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6101670-58b7-4637-8fc7-814d1c91a0b8 service swift] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:27.544848 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6101670-58b7-4637-8fc7-814d1c91a0b8 service swift] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:27.692387 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77003328-f5e6-420d-bde5-a50ed9ca17cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:27.694063 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77003328-f5e6-420d-bde5-a50ed9ca17cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:27.695058 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77003328-f5e6-420d-bde5-a50ed9ca17cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:27.696077 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77003328-f5e6-420d-bde5-a50ed9ca17cb admin admin] PATH_INFO: `/v3/users/c8633e29810c41ad89015fdb82eb3679` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:27.699330 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77003328-f5e6-420d-bde5-a50ed9ca17cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8633e29810c41ad89015fdb82eb3679)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:27.702024 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77003328-f5e6-420d-bde5-a50ed9ca17cb admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:27.784104 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-77003328-f5e6-420d-bde5-a50ed9ca17cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8633e29810c41ad89015fdb82eb3679'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:27.796025 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-77003328-f5e6-420d-bde5-a50ed9ca17cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8633e29810c41ad89015fdb82eb3679'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:27.833392 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-77003328-f5e6-420d-bde5-a50ed9ca17cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8633e29810c41ad89015fdb82eb3679'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:27.856126 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-77003328-f5e6-420d-bde5-a50ed9ca17cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8633e29810c41ad89015fdb82eb3679'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:27.857947 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-77003328-f5e6-420d-bde5-a50ed9ca17cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8633e29810c41ad89015fdb82eb3679'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:27.868985 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1095/2184] 10.222.0.70 () {58 vars in 1224 bytes} [Tue Aug 2 21:43:27 2022] DELETE /identity/v3/users/c8633e29810c41ad89015fdb82eb3679 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:43:28.415049 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cf3d8f-9925-4569-99d0-8da85be62d96 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:28.417350 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-e3cf3d8f-9925-4569-99d0-8da85be62d96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:28.439235 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cf3d8f-9925-4569-99d0-8da85be62d96 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:28.503867 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:43:28.556324 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba559828-98fd-4d7a-87ff-789865f54f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:28.557003 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba559828-98fd-4d7a-87ff-789865f54f8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:28.557289 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba559828-98fd-4d7a-87ff-789865f54f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:28.557584 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba559828-98fd-4d7a-87ff-789865f54f8c admin admin] PATH_INFO: `/v3/projects/06a17812662342ada15b558f2ebae8a7` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:28.558849 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba559828-98fd-4d7a-87ff-789865f54f8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=06a17812662342ada15b558f2ebae8a7)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:28.560818 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba559828-98fd-4d7a-87ff-789865f54f8c admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:28.635549 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ba559828-98fd-4d7a-87ff-789865f54f8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06a17812662342ada15b558f2ebae8a7', 'request_id': 'req-ba559828-98fd-4d7a-87ff-789865f54f8c'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:28.645939 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ba559828-98fd-4d7a-87ff-789865f54f8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06a17812662342ada15b558f2ebae8a7', 'request_id': 'req-ba559828-98fd-4d7a-87ff-789865f54f8c'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:28.654545 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ba559828-98fd-4d7a-87ff-789865f54f8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06a17812662342ada15b558f2ebae8a7', 'request_id': 'req-ba559828-98fd-4d7a-87ff-789865f54f8c'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:28.670444 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ba559828-98fd-4d7a-87ff-789865f54f8c admin admin] The token cache is being invalidate because project 06a17812662342ada15b558f2ebae8a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:43:28.670763 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ba559828-98fd-4d7a-87ff-789865f54f8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:28.671844 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ba559828-98fd-4d7a-87ff-789865f54f8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:28.674262 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1090/2185] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Aug 2 21:43:28 2022] DELETE /identity/v3/projects/06a17812662342ada15b558f2ebae8a7 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:43:28.679666 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c39daee-84d5-4c92-ad41-4a4540f2b487 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:28.680155 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c39daee-84d5-4c92-ad41-4a4540f2b487 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:28.680456 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c39daee-84d5-4c92-ad41-4a4540f2b487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:28.720778 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-7c39daee-84d5-4c92-ad41-4a4540f2b487 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:43:28.726204 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-7c39daee-84d5-4c92-ad41-4a4540f2b487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:28.767470 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:43:28.834042 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1096/2186] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:43:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:43:28.842354 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96f2174-1600-47b8-84b2-b991a7c85cea None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:28.842647 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96f2174-1600-47b8-84b2-b991a7c85cea None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:28.842934 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96f2174-1600-47b8-84b2-b991a7c85cea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:28.878415 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-d96f2174-1600-47b8-84b2-b991a7c85cea None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:43:28.880016 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-d96f2174-1600-47b8-84b2-b991a7c85cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:28.895573 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1091/2187] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:43:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:43:28.896879 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c39daee-84d5-4c92-ad41-4a4540f2b487 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:28.913033 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c39daee-84d5-4c92-ad41-4a4540f2b487 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:28.918748 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129e041f-e35a-40d0-ad01-c3cc69b46da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:28.919392 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129e041f-e35a-40d0-ad01-c3cc69b46da0 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:28.919679 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129e041f-e35a-40d0-ad01-c3cc69b46da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:28.919960 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129e041f-e35a-40d0-ad01-c3cc69b46da0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:28.920708 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129e041f-e35a-40d0-ad01-c3cc69b46da0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:43:28.921021 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129e041f-e35a-40d0-ad01-c3cc69b46da0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:28.922994 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129e041f-e35a-40d0-ad01-c3cc69b46da0 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:28.940978 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1097/2188] 10.222.0.70 () {58 vars in 1153 bytes} [Tue Aug 2 21:43:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:43:28.943396 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96f2174-1600-47b8-84b2-b991a7c85cea None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:28.970762 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96f2174-1600-47b8-84b2-b991a7c85cea None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:28.986921 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb00a1d1-a4ff-4c63-8137-96dabace54bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:28.987689 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb00a1d1-a4ff-4c63-8137-96dabace54bd admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:28.987986 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb00a1d1-a4ff-4c63-8137-96dabace54bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:28.988291 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb00a1d1-a4ff-4c63-8137-96dabace54bd admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:28.990335 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb00a1d1-a4ff-4c63-8137-96dabace54bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:28.993628 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb00a1d1-a4ff-4c63-8137-96dabace54bd admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:29.056414 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129e041f-e35a-40d0-ad01-c3cc69b46da0 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:29.072269 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1092/2189] 10.222.0.70 () {60 vars in 1153 bytes} [Tue Aug 2 21:43:28 2022] POST /identity/v3/projects => generated 377 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:43:29.075338 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129e041f-e35a-40d0-ad01-c3cc69b46da0 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:29.150665 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d1d6f3-b433-4d66-8bbc-5476e8caf185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:29.177293 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d1d6f3-b433-4d66-8bbc-5476e8caf185 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:29.177592 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d1d6f3-b433-4d66-8bbc-5476e8caf185 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:29.180183 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d1d6f3-b433-4d66-8bbc-5476e8caf185 admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:29.180922 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d1d6f3-b433-4d66-8bbc-5476e8caf185 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:29.185814 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d1d6f3-b433-4d66-8bbc-5476e8caf185 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:29.234475 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1098/2190] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 2 21:43:29 2022] POST /identity/v3/users => generated 289 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:43:29.238627 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb00a1d1-a4ff-4c63-8137-96dabace54bd admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:29.257040 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb00a1d1-a4ff-4c63-8137-96dabace54bd admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:29.272283 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2633c0f-d16a-4e64-a8eb-a4f5efbb59df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:29.273055 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2633c0f-d16a-4e64-a8eb-a4f5efbb59df admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:29.273344 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2633c0f-d16a-4e64-a8eb-a4f5efbb59df admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:29.273709 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2633c0f-d16a-4e64-a8eb-a4f5efbb59df admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:29.274936 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2633c0f-d16a-4e64-a8eb-a4f5efbb59df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:29.278376 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2633c0f-d16a-4e64-a8eb-a4f5efbb59df admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:29.315528 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1093/2191] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:43:29 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:43:29.317554 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d1d6f3-b433-4d66-8bbc-5476e8caf185 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:29.336425 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d1d6f3-b433-4d66-8bbc-5476e8caf185 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:29.342378 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2873f989-9e07-4fb7-9435-5216683ea4ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:29.345219 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2873f989-9e07-4fb7-9435-5216683ea4ae admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:29.345537 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2873f989-9e07-4fb7-9435-5216683ea4ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:29.345784 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2873f989-9e07-4fb7-9435-5216683ea4ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:29.347317 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2873f989-9e07-4fb7-9435-5216683ea4ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:29.349054 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2873f989-9e07-4fb7-9435-5216683ea4ae admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:29.371963 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1099/2192] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:43:29 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:43:29.373819 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2633c0f-d16a-4e64-a8eb-a4f5efbb59df admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:29.396985 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2633c0f-d16a-4e64-a8eb-a4f5efbb59df admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:29.403251 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c380c83-0a9c-4606-9488-e5dd0088f7ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:29.405861 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c380c83-0a9c-4606-9488-e5dd0088f7ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:29.406152 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c380c83-0a9c-4606-9488-e5dd0088f7ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:29.406488 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c380c83-0a9c-4606-9488-e5dd0088f7ca admin admin] PATH_INFO: `/v3/projects/7d52d68700494d279f0f46b0f4127234/users/6ed58575202e441db5491c708a50bc37/roles/462e3381a85c42a9959201f9aa122f7c` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:29.432798 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c380c83-0a9c-4606-9488-e5dd0088f7ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d52d68700494d279f0f46b0f4127234, user_id=6ed58575202e441db5491c708a50bc37, role_id=462e3381a85c42a9959201f9aa122f7c)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:29.439993 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c380c83-0a9c-4606-9488-e5dd0088f7ca admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:29.467790 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1094/2193] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:43:29 2022] PUT /identity/v3/projects/7d52d68700494d279f0f46b0f4127234/users/6ed58575202e441db5491c708a50bc37/roles/462e3381a85c42a9959201f9aa122f7c => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:43:29.543691 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d1e9a-9f7c-4a9e-bd3e-244b22e1d114 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:29.544022 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d1e9a-9f7c-4a9e-bd3e-244b22e1d114 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:29.544320 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d1e9a-9f7c-4a9e-bd3e-244b22e1d114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:29.589978 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-b53d1e9a-9f7c-4a9e-bd3e-244b22e1d114 None None] MFA Rules not processed for user `6ed58575202e441db5491c708a50bc37`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:43:29.591940 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-b53d1e9a-9f7c-4a9e-bd3e-244b22e1d114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:29.763850 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1100/2194] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:43:29 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:43:29.768847 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c380c83-0a9c-4606-9488-e5dd0088f7ca admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:29.855227 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:43:29.859619 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c380c83-0a9c-4606-9488-e5dd0088f7ca admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:29.868142 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b7ccf4-962d-474c-a3a0-2308312a61ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:29.871328 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b7ccf4-962d-474c-a3a0-2308312a61ce admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:29.871800 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b7ccf4-962d-474c-a3a0-2308312a61ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:29.872172 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b7ccf4-962d-474c-a3a0-2308312a61ce admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:29.873467 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b7ccf4-962d-474c-a3a0-2308312a61ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:29.877554 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b7ccf4-962d-474c-a3a0-2308312a61ce admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:29.947745 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1095/2195] 10.222.0.70 () {60 vars in 1153 bytes} [Tue Aug 2 21:43:29 2022] POST /identity/v3/projects => generated 377 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:43:29.951914 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53d1e9a-9f7c-4a9e-bd3e-244b22e1d114 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:29.969815 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53d1e9a-9f7c-4a9e-bd3e-244b22e1d114 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:30.054625 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:43:30.149226 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066eb6f8-1aa6-4341-a395-a24caea0f5d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:30.151639 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066eb6f8-1aa6-4341-a395-a24caea0f5d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:30.151639 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066eb6f8-1aa6-4341-a395-a24caea0f5d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:30.151639 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066eb6f8-1aa6-4341-a395-a24caea0f5d7 admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:30.152272 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066eb6f8-1aa6-4341-a395-a24caea0f5d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:30.154387 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066eb6f8-1aa6-4341-a395-a24caea0f5d7 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:30.195886 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1101/2196] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 2 21:43:29 2022] POST /identity/v3/users => generated 289 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 21:43:30.199495 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b7ccf4-962d-474c-a3a0-2308312a61ce admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:30.216341 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b7ccf4-962d-474c-a3a0-2308312a61ce admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:30.242236 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747d2977-f594-4c89-9009-15443bc9e868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:30.242642 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d2977-f594-4c89-9009-15443bc9e868 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:30.242642 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d2977-f594-4c89-9009-15443bc9e868 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:30.242872 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747d2977-f594-4c89-9009-15443bc9e868 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:30.243710 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747d2977-f594-4c89-9009-15443bc9e868 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:30.247484 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747d2977-f594-4c89-9009-15443bc9e868 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:30.299427 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1096/2197] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:43:30 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:43:30.304445 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066eb6f8-1aa6-4341-a395-a24caea0f5d7 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:30.328458 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066eb6f8-1aa6-4341-a395-a24caea0f5d7 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:30.367129 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a1937d-cfda-41da-863d-2727f929617c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:30.367903 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a1937d-cfda-41da-863d-2727f929617c admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:30.369229 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a1937d-cfda-41da-863d-2727f929617c admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:30.370617 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a1937d-cfda-41da-863d-2727f929617c admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:30.372096 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a1937d-cfda-41da-863d-2727f929617c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:30.374640 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a1937d-cfda-41da-863d-2727f929617c admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:30.424155 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1102/2198] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:43:30 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:43:30.427641 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747d2977-f594-4c89-9009-15443bc9e868 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:30.442056 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747d2977-f594-4c89-9009-15443bc9e868 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:30.449652 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133f77a3-a08a-436b-8ea3-842553af4b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:30.451777 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133f77a3-a08a-436b-8ea3-842553af4b81 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:30.452088 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133f77a3-a08a-436b-8ea3-842553af4b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:30.452909 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133f77a3-a08a-436b-8ea3-842553af4b81 admin admin] PATH_INFO: `/v3/projects/c9dbef0fd9a94926b02fe3acfd2069c5/users/dbdceeb83ab840afad96ebab249db4dc/roles/462e3381a85c42a9959201f9aa122f7c` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:30.479585 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133f77a3-a08a-436b-8ea3-842553af4b81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9dbef0fd9a94926b02fe3acfd2069c5, user_id=dbdceeb83ab840afad96ebab249db4dc, role_id=462e3381a85c42a9959201f9aa122f7c)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:30.483339 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133f77a3-a08a-436b-8ea3-842553af4b81 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:30.541079 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1097/2199] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:43:30 2022] PUT /identity/v3/projects/c9dbef0fd9a94926b02fe3acfd2069c5/users/dbdceeb83ab840afad96ebab249db4dc/roles/462e3381a85c42a9959201f9aa122f7c => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:43:30.543098 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4451442-25f2-42e5-855d-e77e6eff5959 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:30.543393 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4451442-25f2-42e5-855d-e77e6eff5959 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:30.543678 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4451442-25f2-42e5-855d-e77e6eff5959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:30.595221 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-c4451442-25f2-42e5-855d-e77e6eff5959 None None] MFA Rules not processed for user `dbdceeb83ab840afad96ebab249db4dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:43:30.597107 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-c4451442-25f2-42e5-855d-e77e6eff5959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:30.686288 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1103/2200] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:43:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:43:30.690919 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133f77a3-a08a-436b-8ea3-842553af4b81 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:30.848693 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133f77a3-a08a-436b-8ea3-842553af4b81 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:30.854808 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5638e097-eebc-4723-adf7-4bacdc488a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:30.855516 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5638e097-eebc-4723-adf7-4bacdc488a5b admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:30.857037 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5638e097-eebc-4723-adf7-4bacdc488a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:30.857396 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5638e097-eebc-4723-adf7-4bacdc488a5b admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:30.858403 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5638e097-eebc-4723-adf7-4bacdc488a5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:30.863844 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5638e097-eebc-4723-adf7-4bacdc488a5b admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:30.919565 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1098/2201] 10.222.0.70 () {60 vars in 1153 bytes} [Tue Aug 2 21:43:30 2022] POST /identity/v3/projects => generated 375 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:43:30.924183 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4451442-25f2-42e5-855d-e77e6eff5959 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:30.948565 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4451442-25f2-42e5-855d-e77e6eff5959 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:31.118540 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8696266d-a933-43dd-998d-8ec5f4653ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:31.119452 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8696266d-a933-43dd-998d-8ec5f4653ecf admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:31.119921 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8696266d-a933-43dd-998d-8ec5f4653ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:31.120390 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8696266d-a933-43dd-998d-8ec5f4653ecf admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:31.121518 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8696266d-a933-43dd-998d-8ec5f4653ecf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:31.123764 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8696266d-a933-43dd-998d-8ec5f4653ecf admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:31.163434 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1104/2202] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 2 21:43:30 2022] POST /identity/v3/users => generated 294 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:43:31.164781 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5638e097-eebc-4723-adf7-4bacdc488a5b admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:31.179228 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5638e097-eebc-4723-adf7-4bacdc488a5b admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:31.184975 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c687558-a9d9-468d-9fc4-bac693d12c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:31.185528 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c687558-a9d9-468d-9fc4-bac693d12c63 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:31.185814 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c687558-a9d9-468d-9fc4-bac693d12c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:31.186099 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c687558-a9d9-468d-9fc4-bac693d12c63 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:31.186807 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c687558-a9d9-468d-9fc4-bac693d12c63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:31.188508 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c687558-a9d9-468d-9fc4-bac693d12c63 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:31.207480 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1099/2203] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:43:31 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:43:31.211922 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8696266d-a933-43dd-998d-8ec5f4653ecf admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:31.226074 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8696266d-a933-43dd-998d-8ec5f4653ecf admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:31.232009 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d543387e-9480-4025-aa0e-ed19a06ff671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:31.232987 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d543387e-9480-4025-aa0e-ed19a06ff671 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:31.233454 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d543387e-9480-4025-aa0e-ed19a06ff671 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:31.233935 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d543387e-9480-4025-aa0e-ed19a06ff671 admin admin] PATH_INFO: `/v3/projects/c7392f1677b346c1b71337bef2086ff2/users/98a697f3c2dc4de699d490d6433d80e3/roles/3e32dbf75f9b41f5adb9fe59851267bb` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:31.260221 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d543387e-9480-4025-aa0e-ed19a06ff671 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7392f1677b346c1b71337bef2086ff2, user_id=98a697f3c2dc4de699d490d6433d80e3, role_id=3e32dbf75f9b41f5adb9fe59851267bb)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:31.262999 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d543387e-9480-4025-aa0e-ed19a06ff671 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:31.297962 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1105/2204] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:43:31 2022] PUT /identity/v3/projects/c7392f1677b346c1b71337bef2086ff2/users/98a697f3c2dc4de699d490d6433d80e3/roles/3e32dbf75f9b41f5adb9fe59851267bb => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:43:31.299386 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c687558-a9d9-468d-9fc4-bac693d12c63 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:31.329335 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c687558-a9d9-468d-9fc4-bac693d12c63 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:31.446776 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c268ada-d067-4c8b-aa76-937fe1357d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:31.447569 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c268ada-d067-4c8b-aa76-937fe1357d5c admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:31.447938 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c268ada-d067-4c8b-aa76-937fe1357d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:31.449400 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c268ada-d067-4c8b-aa76-937fe1357d5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:31.449400 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c268ada-d067-4c8b-aa76-937fe1357d5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:31.451219 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c268ada-d067-4c8b-aa76-937fe1357d5c admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:31.467908 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1100/2205] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:43:31 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:43:31.472595 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d543387e-9480-4025-aa0e-ed19a06ff671 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:31.491994 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d543387e-9480-4025-aa0e-ed19a06ff671 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:31.493612 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:43:31.499595 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8a38e4-23c8-429f-a4ee-5cdc865b9cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:31.500536 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8a38e4-23c8-429f-a4ee-5cdc865b9cc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:31.501097 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8a38e4-23c8-429f-a4ee-5cdc865b9cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:31.501473 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8a38e4-23c8-429f-a4ee-5cdc865b9cc8 admin admin] PATH_INFO: `/v3/projects/c7392f1677b346c1b71337bef2086ff2/users/98a697f3c2dc4de699d490d6433d80e3/roles/3e32dbf75f9b41f5adb9fe59851267bb` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:31.507451 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8a38e4-23c8-429f-a4ee-5cdc865b9cc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7392f1677b346c1b71337bef2086ff2, user_id=98a697f3c2dc4de699d490d6433d80e3, role_id=3e32dbf75f9b41f5adb9fe59851267bb)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:31.510886 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8a38e4-23c8-429f-a4ee-5cdc865b9cc8 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:31.528328 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1106/2206] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:43:31 2022] PUT /identity/v3/projects/c7392f1677b346c1b71337bef2086ff2/users/98a697f3c2dc4de699d490d6433d80e3/roles/3e32dbf75f9b41f5adb9fe59851267bb => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:43:31.538143 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18a9ee7-9140-4626-a3f6-a70b2a37ef0a None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:31.538433 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18a9ee7-9140-4626-a3f6-a70b2a37ef0a None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:31.538712 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18a9ee7-9140-4626-a3f6-a70b2a37ef0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:31.577357 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-e18a9ee7-9140-4626-a3f6-a70b2a37ef0a None None] MFA Rules not processed for user `98a697f3c2dc4de699d490d6433d80e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:43:31.578629 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-e18a9ee7-9140-4626-a3f6-a70b2a37ef0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:31.585609 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:43:31.742850 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1101/2207] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:43:31 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:43:31.756322 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8a38e4-23c8-429f-a4ee-5cdc865b9cc8 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:31.758674 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-0d8a38e4-23c8-429f-a4ee-5cdc865b9cc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:31.867230 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8a38e4-23c8-429f-a4ee-5cdc865b9cc8 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:31.867230 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6040cbf6-ac8b-4815-89ee-732b22a0f036 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '123eb76f95ee4e39905944da701c712d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:31.867230 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6040cbf6-ac8b-4815-89ee-732b22a0f036 service cinder] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:31.867230 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6040cbf6-ac8b-4815-89ee-732b22a0f036 service cinder] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:31.867763 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6040cbf6-ac8b-4815-89ee-732b22a0f036 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:31.935756 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6040cbf6-ac8b-4815-89ee-732b22a0f036 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:31.937620 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6040cbf6-ac8b-4815-89ee-732b22a0f036 service cinder] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:31.949724 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1107/2208] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:43:31 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:43:33.822971 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18a9ee7-9140-4626-a3f6-a70b2a37ef0a None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:33.850492 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18a9ee7-9140-4626-a3f6-a70b2a37ef0a None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:33.854471 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69662145-45a7-4c75-b560-2a8c1de4a64f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '123eb76f95ee4e39905944da701c712d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:33.855256 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69662145-45a7-4c75-b560-2a8c1de4a64f service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:33.857556 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69662145-45a7-4c75-b560-2a8c1de4a64f service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:33.857556 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69662145-45a7-4c75-b560-2a8c1de4a64f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:33.967745 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69662145-45a7-4c75-b560-2a8c1de4a64f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:33.969720 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69662145-45a7-4c75-b560-2a8c1de4a64f service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:33.984275 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1102/2209] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:43:33 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:43:34.935102 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6040cbf6-ac8b-4815-89ee-732b22a0f036 service cinder] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:34.950700 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6040cbf6-ac8b-4815-89ee-732b22a0f036 service cinder] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:34.958063 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cff6b6a-e420-42db-8152-008f15f00df4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '123eb76f95ee4e39905944da701c712d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:34.959394 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cff6b6a-e420-42db-8152-008f15f00df4 service cinder] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:34.959951 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cff6b6a-e420-42db-8152-008f15f00df4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:34.960474 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cff6b6a-e420-42db-8152-008f15f00df4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:34.977667 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cff6b6a-e420-42db-8152-008f15f00df4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:34.979777 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cff6b6a-e420-42db-8152-008f15f00df4 service cinder] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:34.993383 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1108/2210] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:43:34 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:43:36.078311 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69662145-45a7-4c75-b560-2a8c1de4a64f service cinder] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:36.081696 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-69662145-45a7-4c75-b560-2a8c1de4a64f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:36.187353 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69662145-45a7-4c75-b560-2a8c1de4a64f service cinder] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:36.208429 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217d2ae4-fbd0-4a08-9c3a-0a14acce8bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:36.209415 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217d2ae4-fbd0-4a08-9c3a-0a14acce8bd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:36.209842 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217d2ae4-fbd0-4a08-9c3a-0a14acce8bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:36.210129 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217d2ae4-fbd0-4a08-9c3a-0a14acce8bd5 admin admin] PATH_INFO: `/v3/users/4f0184e3d56d425bb07e62407f658ca0` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:36.211465 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217d2ae4-fbd0-4a08-9c3a-0a14acce8bd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f0184e3d56d425bb07e62407f658ca0)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:36.213922 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217d2ae4-fbd0-4a08-9c3a-0a14acce8bd5 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:36.279980 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:43:36.284166 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-217d2ae4-fbd0-4a08-9c3a-0a14acce8bd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f0184e3d56d425bb07e62407f658ca0'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:36.295690 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-217d2ae4-fbd0-4a08-9c3a-0a14acce8bd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f0184e3d56d425bb07e62407f658ca0'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:36.337350 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-217d2ae4-fbd0-4a08-9c3a-0a14acce8bd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f0184e3d56d425bb07e62407f658ca0'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:36.338615 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-217d2ae4-fbd0-4a08-9c3a-0a14acce8bd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f0184e3d56d425bb07e62407f658ca0'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:36.349671 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-217d2ae4-fbd0-4a08-9c3a-0a14acce8bd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f0184e3d56d425bb07e62407f658ca0'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:36.358437 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1103/2211] 10.222.0.70 () {58 vars in 1224 bytes} [Tue Aug 2 21:43:36 2022] DELETE /identity/v3/users/4f0184e3d56d425bb07e62407f658ca0 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:43:36.363313 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ba10b5-07df-4534-940d-8ab58eebb2b7 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:36.365093 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ba10b5-07df-4534-940d-8ab58eebb2b7 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:36.366078 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ba10b5-07df-4534-940d-8ab58eebb2b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:36.402104 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-42ba10b5-07df-4534-940d-8ab58eebb2b7 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:43:36.403379 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-42ba10b5-07df-4534-940d-8ab58eebb2b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:36.519254 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1109/2212] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:43:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:43:36.528797 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217d2ae4-fbd0-4a08-9c3a-0a14acce8bd5 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:36.530242 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-217d2ae4-fbd0-4a08-9c3a-0a14acce8bd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:36.611924 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217d2ae4-fbd0-4a08-9c3a-0a14acce8bd5 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:36.617075 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c679c67-5f23-4e88-80fd-add8ac1b225e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '723f5f43572a493dae0349070a2adb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:36.617709 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c679c67-5f23-4e88-80fd-add8ac1b225e service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:36.617996 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c679c67-5f23-4e88-80fd-add8ac1b225e service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:36.618278 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c679c67-5f23-4e88-80fd-add8ac1b225e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:36.628950 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c679c67-5f23-4e88-80fd-add8ac1b225e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:36.630991 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c679c67-5f23-4e88-80fd-add8ac1b225e service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:36.643636 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1104/2213] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:43:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:43:37.054847 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ba10b5-07df-4534-940d-8ab58eebb2b7 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:37.056771 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-42ba10b5-07df-4534-940d-8ab58eebb2b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:37.076710 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ba10b5-07df-4534-940d-8ab58eebb2b7 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:37.084124 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6207b106-e9cb-489f-809d-38b46bc92232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:37.085364 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6207b106-e9cb-489f-809d-38b46bc92232 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:37.086038 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6207b106-e9cb-489f-809d-38b46bc92232 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:37.087116 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6207b106-e9cb-489f-809d-38b46bc92232 admin admin] PATH_INFO: `/v3/projects/93aa51219ccc4be5ab40adbf04388355` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:37.088584 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6207b106-e9cb-489f-809d-38b46bc92232 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93aa51219ccc4be5ab40adbf04388355)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:37.102888 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6207b106-e9cb-489f-809d-38b46bc92232 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:37.143390 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:43:37.166850 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-6207b106-e9cb-489f-809d-38b46bc92232 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93aa51219ccc4be5ab40adbf04388355', 'request_id': 'req-6207b106-e9cb-489f-809d-38b46bc92232'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:37.173235 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-6207b106-e9cb-489f-809d-38b46bc92232 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93aa51219ccc4be5ab40adbf04388355', 'request_id': 'req-6207b106-e9cb-489f-809d-38b46bc92232'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:37.184314 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-6207b106-e9cb-489f-809d-38b46bc92232 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93aa51219ccc4be5ab40adbf04388355', 'request_id': 'req-6207b106-e9cb-489f-809d-38b46bc92232'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:37.201074 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-6207b106-e9cb-489f-809d-38b46bc92232 admin admin] The token cache is being invalidate because project 93aa51219ccc4be5ab40adbf04388355 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:43:37.201466 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-6207b106-e9cb-489f-809d-38b46bc92232 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:37.202241 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-6207b106-e9cb-489f-809d-38b46bc92232 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:37.203871 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1110/2214] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Aug 2 21:43:37 2022] DELETE /identity/v3/projects/93aa51219ccc4be5ab40adbf04388355 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:43:39.180645 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c679c67-5f23-4e88-80fd-add8ac1b225e service neutron] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:39.182254 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-5c679c67-5f23-4e88-80fd-add8ac1b225e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:39.196614 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c679c67-5f23-4e88-80fd-add8ac1b225e service neutron] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:39.266900 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cc5c72-116b-4280-8f2d-61c4f84dd880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:39.267857 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cc5c72-116b-4280-8f2d-61c4f84dd880 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:39.268191 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cc5c72-116b-4280-8f2d-61c4f84dd880 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:39.268609 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cc5c72-116b-4280-8f2d-61c4f84dd880 admin admin] PATH_INFO: `/v3/users/6ed58575202e441db5491c708a50bc37` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:39.270378 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cc5c72-116b-4280-8f2d-61c4f84dd880 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ed58575202e441db5491c708a50bc37)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:39.272387 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cc5c72-116b-4280-8f2d-61c4f84dd880 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:39.354273 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-16cc5c72-116b-4280-8f2d-61c4f84dd880 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ed58575202e441db5491c708a50bc37'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:39.364759 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-16cc5c72-116b-4280-8f2d-61c4f84dd880 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ed58575202e441db5491c708a50bc37'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:39.387481 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:43:39.402469 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-16cc5c72-116b-4280-8f2d-61c4f84dd880 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ed58575202e441db5491c708a50bc37'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:39.403917 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-16cc5c72-116b-4280-8f2d-61c4f84dd880 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ed58575202e441db5491c708a50bc37'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:39.414533 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-16cc5c72-116b-4280-8f2d-61c4f84dd880 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ed58575202e441db5491c708a50bc37'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:39.422880 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1105/2215] 10.222.0.70 () {58 vars in 1224 bytes} [Tue Aug 2 21:43:39 2022] DELETE /identity/v3/users/6ed58575202e441db5491c708a50bc37 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:43:39.427955 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec4278d-df86-4d10-9f5a-a922bf5c6076 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:39.428507 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec4278d-df86-4d10-9f5a-a922bf5c6076 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:39.428594 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec4278d-df86-4d10-9f5a-a922bf5c6076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:39.450373 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-fec4278d-df86-4d10-9f5a-a922bf5c6076 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:43:39.451743 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-fec4278d-df86-4d10-9f5a-a922bf5c6076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:39.514242 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1111/2216] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:43:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:43:39.524709 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cc5c72-116b-4280-8f2d-61c4f84dd880 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:39.526285 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-16cc5c72-116b-4280-8f2d-61c4f84dd880 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:39.609680 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cc5c72-116b-4280-8f2d-61c4f84dd880 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:39.614434 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13a5186-7f02-45a7-875c-f3cfaf932bb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '723f5f43572a493dae0349070a2adb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:39.615127 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13a5186-7f02-45a7-875c-f3cfaf932bb4 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:39.615415 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13a5186-7f02-45a7-875c-f3cfaf932bb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:39.615691 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13a5186-7f02-45a7-875c-f3cfaf932bb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:39.629604 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13a5186-7f02-45a7-875c-f3cfaf932bb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:39.631992 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13a5186-7f02-45a7-875c-f3cfaf932bb4 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:39.645689 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1106/2217] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:43:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:43:40.192006 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec4278d-df86-4d10-9f5a-a922bf5c6076 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:40.193804 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-fec4278d-df86-4d10-9f5a-a922bf5c6076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:40.205771 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec4278d-df86-4d10-9f5a-a922bf5c6076 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:40.211113 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81a7510-1a06-4269-a9c0-108f3195c897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:40.211773 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81a7510-1a06-4269-a9c0-108f3195c897 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:40.212060 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81a7510-1a06-4269-a9c0-108f3195c897 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:40.212377 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81a7510-1a06-4269-a9c0-108f3195c897 admin admin] PATH_INFO: `/v3/projects/7d52d68700494d279f0f46b0f4127234` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:40.213572 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81a7510-1a06-4269-a9c0-108f3195c897 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d52d68700494d279f0f46b0f4127234)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:40.215521 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81a7510-1a06-4269-a9c0-108f3195c897 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:40.275318 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-c81a7510-1a06-4269-a9c0-108f3195c897 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d52d68700494d279f0f46b0f4127234', 'request_id': 'req-c81a7510-1a06-4269-a9c0-108f3195c897'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:40.281001 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-c81a7510-1a06-4269-a9c0-108f3195c897 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d52d68700494d279f0f46b0f4127234', 'request_id': 'req-c81a7510-1a06-4269-a9c0-108f3195c897'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:40.297780 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-c81a7510-1a06-4269-a9c0-108f3195c897 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d52d68700494d279f0f46b0f4127234', 'request_id': 'req-c81a7510-1a06-4269-a9c0-108f3195c897'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:40.309683 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-c81a7510-1a06-4269-a9c0-108f3195c897 admin admin] The token cache is being invalidate because project 7d52d68700494d279f0f46b0f4127234 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:43:40.309976 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-c81a7510-1a06-4269-a9c0-108f3195c897 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:40.310622 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-c81a7510-1a06-4269-a9c0-108f3195c897 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:40.312157 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1112/2218] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Aug 2 21:43:40 2022] DELETE /identity/v3/projects/7d52d68700494d279f0f46b0f4127234 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:43:40.316338 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13a5186-7f02-45a7-875c-f3cfaf932bb4 service neutron] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:40.326981 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13a5186-7f02-45a7-875c-f3cfaf932bb4 service neutron] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:40.389204 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604e455b-7be3-4cfc-a518-7ebac23ae86e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:40.390358 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604e455b-7be3-4cfc-a518-7ebac23ae86e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:40.390872 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604e455b-7be3-4cfc-a518-7ebac23ae86e admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:40.391358 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604e455b-7be3-4cfc-a518-7ebac23ae86e admin admin] PATH_INFO: `/v3/users/dbdceeb83ab840afad96ebab249db4dc` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:40.392947 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604e455b-7be3-4cfc-a518-7ebac23ae86e admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbdceeb83ab840afad96ebab249db4dc)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:40.398136 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604e455b-7be3-4cfc-a518-7ebac23ae86e admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:40.457825 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-604e455b-7be3-4cfc-a518-7ebac23ae86e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbdceeb83ab840afad96ebab249db4dc'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:40.465812 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-604e455b-7be3-4cfc-a518-7ebac23ae86e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbdceeb83ab840afad96ebab249db4dc'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:40.478326 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-604e455b-7be3-4cfc-a518-7ebac23ae86e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbdceeb83ab840afad96ebab249db4dc'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:40.479274 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-604e455b-7be3-4cfc-a518-7ebac23ae86e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbdceeb83ab840afad96ebab249db4dc'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:40.486202 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-604e455b-7be3-4cfc-a518-7ebac23ae86e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbdceeb83ab840afad96ebab249db4dc'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:40.495339 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1107/2219] 10.222.0.70 () {58 vars in 1224 bytes} [Tue Aug 2 21:43:40 2022] DELETE /identity/v3/users/dbdceeb83ab840afad96ebab249db4dc => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:43:41.216106 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81a7510-1a06-4269-a9c0-108f3195c897 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:41.217614 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-c81a7510-1a06-4269-a9c0-108f3195c897 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:41.232579 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81a7510-1a06-4269-a9c0-108f3195c897 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:41.294778 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:43:41.327599 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1d4a62-9c0e-4efa-a74a-b8276c533154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:41.328599 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d4a62-9c0e-4efa-a74a-b8276c533154 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:41.329169 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d4a62-9c0e-4efa-a74a-b8276c533154 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:41.329599 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1d4a62-9c0e-4efa-a74a-b8276c533154 admin admin] PATH_INFO: `/v3/projects/c9dbef0fd9a94926b02fe3acfd2069c5` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:41.331904 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1d4a62-9c0e-4efa-a74a-b8276c533154 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9dbef0fd9a94926b02fe3acfd2069c5)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:41.335060 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1d4a62-9c0e-4efa-a74a-b8276c533154 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:41.404333 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-3b1d4a62-9c0e-4efa-a74a-b8276c533154 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9dbef0fd9a94926b02fe3acfd2069c5', 'request_id': 'req-3b1d4a62-9c0e-4efa-a74a-b8276c533154'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:41.413611 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-3b1d4a62-9c0e-4efa-a74a-b8276c533154 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9dbef0fd9a94926b02fe3acfd2069c5', 'request_id': 'req-3b1d4a62-9c0e-4efa-a74a-b8276c533154'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:41.421654 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-3b1d4a62-9c0e-4efa-a74a-b8276c533154 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9dbef0fd9a94926b02fe3acfd2069c5', 'request_id': 'req-3b1d4a62-9c0e-4efa-a74a-b8276c533154'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:41.434013 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-3b1d4a62-9c0e-4efa-a74a-b8276c533154 admin admin] The token cache is being invalidate because project c9dbef0fd9a94926b02fe3acfd2069c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:43:41.434306 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-3b1d4a62-9c0e-4efa-a74a-b8276c533154 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:41.434942 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-3b1d4a62-9c0e-4efa-a74a-b8276c533154 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:41.436520 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1113/2220] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Aug 2 21:43:41 2022] DELETE /identity/v3/projects/c9dbef0fd9a94926b02fe3acfd2069c5 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:43:41.440404 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604e455b-7be3-4cfc-a518-7ebac23ae86e admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:41.441919 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-604e455b-7be3-4cfc-a518-7ebac23ae86e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:41.451302 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:43:41.455581 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604e455b-7be3-4cfc-a518-7ebac23ae86e admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:41.517151 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83027d9-e444-4286-815e-265bc61c7b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:41.517815 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83027d9-e444-4286-815e-265bc61c7b1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:41.518146 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83027d9-e444-4286-815e-265bc61c7b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:41.518430 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83027d9-e444-4286-815e-265bc61c7b1c admin admin] PATH_INFO: `/v3/users/98a697f3c2dc4de699d490d6433d80e3` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:41.520158 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83027d9-e444-4286-815e-265bc61c7b1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=98a697f3c2dc4de699d490d6433d80e3)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:41.522328 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83027d9-e444-4286-815e-265bc61c7b1c admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:41.570308 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-b83027d9-e444-4286-815e-265bc61c7b1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98a697f3c2dc4de699d490d6433d80e3'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:41.579099 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-b83027d9-e444-4286-815e-265bc61c7b1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98a697f3c2dc4de699d490d6433d80e3'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:41.592191 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-b83027d9-e444-4286-815e-265bc61c7b1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98a697f3c2dc4de699d490d6433d80e3'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:41.592930 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-b83027d9-e444-4286-815e-265bc61c7b1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98a697f3c2dc4de699d490d6433d80e3'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:41.600837 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-b83027d9-e444-4286-815e-265bc61c7b1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98a697f3c2dc4de699d490d6433d80e3'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:41.607860 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1108/2221] 10.222.0.70 () {58 vars in 1224 bytes} [Tue Aug 2 21:43:41 2022] DELETE /identity/v3/users/98a697f3c2dc4de699d490d6433d80e3 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:43:41.903375 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1d4a62-9c0e-4efa-a74a-b8276c533154 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:41.904924 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-3b1d4a62-9c0e-4efa-a74a-b8276c533154 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:41.918920 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1d4a62-9c0e-4efa-a74a-b8276c533154 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:41.980147 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55096d65-f2ee-4579-b769-b57d6b5aba8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:41.980918 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55096d65-f2ee-4579-b769-b57d6b5aba8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:41.981285 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55096d65-f2ee-4579-b769-b57d6b5aba8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:41.981612 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55096d65-f2ee-4579-b769-b57d6b5aba8a admin admin] PATH_INFO: `/v3/projects/c7392f1677b346c1b71337bef2086ff2` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:41.982887 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55096d65-f2ee-4579-b769-b57d6b5aba8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7392f1677b346c1b71337bef2086ff2)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:41.984897 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55096d65-f2ee-4579-b769-b57d6b5aba8a admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:42.034935 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-55096d65-f2ee-4579-b769-b57d6b5aba8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7392f1677b346c1b71337bef2086ff2', 'request_id': 'req-55096d65-f2ee-4579-b769-b57d6b5aba8a'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:42.040879 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-55096d65-f2ee-4579-b769-b57d6b5aba8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7392f1677b346c1b71337bef2086ff2', 'request_id': 'req-55096d65-f2ee-4579-b769-b57d6b5aba8a'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:42.049504 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-55096d65-f2ee-4579-b769-b57d6b5aba8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7392f1677b346c1b71337bef2086ff2', 'request_id': 'req-55096d65-f2ee-4579-b769-b57d6b5aba8a'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:42.057805 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:43:42.062208 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-55096d65-f2ee-4579-b769-b57d6b5aba8a admin admin] The token cache is being invalidate because project c7392f1677b346c1b71337bef2086ff2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:43:42.062885 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-55096d65-f2ee-4579-b769-b57d6b5aba8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:42.063688 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-55096d65-f2ee-4579-b769-b57d6b5aba8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:43:42.065605 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1114/2222] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Aug 2 21:43:41 2022] DELETE /identity/v3/projects/c7392f1677b346c1b71337bef2086ff2 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:43:42.071104 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4d7c46-2637-4680-94b9-fa9572213a5d None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:42.071470 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4d7c46-2637-4680-94b9-fa9572213a5d None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:42.071818 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4d7c46-2637-4680-94b9-fa9572213a5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:42.092798 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-bd4d7c46-2637-4680-94b9-fa9572213a5d None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:43:42.094001 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-bd4d7c46-2637-4680-94b9-fa9572213a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:42.164865 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1109/2223] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:43:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:43:42.172530 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd88d94-0f8a-4bc2-ad04-49eec5f59ab4 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:42.172913 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd88d94-0f8a-4bc2-ad04-49eec5f59ab4 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:42.173261 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd88d94-0f8a-4bc2-ad04-49eec5f59ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:42.195114 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-dbd88d94-0f8a-4bc2-ad04-49eec5f59ab4 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:43:42.196513 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-dbd88d94-0f8a-4bc2-ad04-49eec5f59ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:42.205347 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1115/2224] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:43:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:43:42.209702 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4d7c46-2637-4680-94b9-fa9572213a5d None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:42.224525 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4d7c46-2637-4680-94b9-fa9572213a5d None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:42.231672 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5b5e68-526f-4ed8-9b51-f67b08bc2277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:42.232431 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5b5e68-526f-4ed8-9b51-f67b08bc2277 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:42.232785 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5b5e68-526f-4ed8-9b51-f67b08bc2277 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:42.233127 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5b5e68-526f-4ed8-9b51-f67b08bc2277 admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:42.233906 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5b5e68-526f-4ed8-9b51-f67b08bc2277 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:43:42.234282 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5b5e68-526f-4ed8-9b51-f67b08bc2277 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:42.236017 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5b5e68-526f-4ed8-9b51-f67b08bc2277 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:42.248912 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1110/2225] 10.222.0.70 () {58 vars in 1153 bytes} [Tue Aug 2 21:43:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:43:42.253250 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd88d94-0f8a-4bc2-ad04-49eec5f59ab4 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:42.263352 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd88d94-0f8a-4bc2-ad04-49eec5f59ab4 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:42.268350 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f994b6fd-b9f1-42f1-ae74-3aeedfe8f5bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:42.268915 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f994b6fd-b9f1-42f1-ae74-3aeedfe8f5bc admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:42.269204 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f994b6fd-b9f1-42f1-ae74-3aeedfe8f5bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:42.269487 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f994b6fd-b9f1-42f1-ae74-3aeedfe8f5bc admin admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:42.270211 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f994b6fd-b9f1-42f1-ae74-3aeedfe8f5bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:42.272203 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f994b6fd-b9f1-42f1-ae74-3aeedfe8f5bc admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:42.304343 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1116/2226] 10.222.0.70 () {60 vars in 1153 bytes} [Tue Aug 2 21:43:42 2022] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:43:42.308420 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5b5e68-526f-4ed8-9b51-f67b08bc2277 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:42.320405 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5b5e68-526f-4ed8-9b51-f67b08bc2277 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:42.328345 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:43:42.380856 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1866096e-05ec-489d-8914-4c11ef3035f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:42.381520 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1866096e-05ec-489d-8914-4c11ef3035f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:42.381917 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1866096e-05ec-489d-8914-4c11ef3035f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:42.382388 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1866096e-05ec-489d-8914-4c11ef3035f6 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:42.382866 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1866096e-05ec-489d-8914-4c11ef3035f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:42.384837 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1866096e-05ec-489d-8914-4c11ef3035f6 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:42.406555 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1111/2227] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 2 21:43:42 2022] POST /identity/v3/users => generated 292 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:43:42.410874 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f994b6fd-b9f1-42f1-ae74-3aeedfe8f5bc admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:42.421320 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f994b6fd-b9f1-42f1-ae74-3aeedfe8f5bc admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:42.427133 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac7b610-e9be-40e6-b97d-4abc1406ae7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:42.427771 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac7b610-e9be-40e6-b97d-4abc1406ae7a admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:42.428110 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac7b610-e9be-40e6-b97d-4abc1406ae7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:42.428429 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac7b610-e9be-40e6-b97d-4abc1406ae7a admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:42.429159 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac7b610-e9be-40e6-b97d-4abc1406ae7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:42.430769 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac7b610-e9be-40e6-b97d-4abc1406ae7a admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:42.441186 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1117/2228] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:43:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:43:42.446306 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1866096e-05ec-489d-8914-4c11ef3035f6 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:42.456305 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1866096e-05ec-489d-8914-4c11ef3035f6 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:42.460930 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedfaa3b-38f2-4d1b-b138-eb6f8fbb7ecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:42.461531 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedfaa3b-38f2-4d1b-b138-eb6f8fbb7ecf admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:42.461815 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedfaa3b-38f2-4d1b-b138-eb6f8fbb7ecf admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:42.462092 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedfaa3b-38f2-4d1b-b138-eb6f8fbb7ecf admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:42.462780 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedfaa3b-38f2-4d1b-b138-eb6f8fbb7ecf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:42.464416 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedfaa3b-38f2-4d1b-b138-eb6f8fbb7ecf admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:42.475399 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1112/2229] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:43:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:43:42.479689 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac7b610-e9be-40e6-b97d-4abc1406ae7a admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:42.490268 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac7b610-e9be-40e6-b97d-4abc1406ae7a admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:42.494834 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7a1ccd-4aa9-4768-ad95-d3b22dbbce0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:42.495485 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7a1ccd-4aa9-4768-ad95-d3b22dbbce0d admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:42.495770 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7a1ccd-4aa9-4768-ad95-d3b22dbbce0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:42.496048 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7a1ccd-4aa9-4768-ad95-d3b22dbbce0d admin admin] PATH_INFO: `/v3/projects/e113381d9819474198c261274e679da2/users/4ef0895d195b463688f59525e075dcbc/roles/462e3381a85c42a9959201f9aa122f7c` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:42.510606 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7a1ccd-4aa9-4768-ad95-d3b22dbbce0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e113381d9819474198c261274e679da2, user_id=4ef0895d195b463688f59525e075dcbc, role_id=462e3381a85c42a9959201f9aa122f7c)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:42.513295 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7a1ccd-4aa9-4768-ad95-d3b22dbbce0d admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:42.525775 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1118/2230] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:43:42 2022] PUT /identity/v3/projects/e113381d9819474198c261274e679da2/users/4ef0895d195b463688f59525e075dcbc/roles/462e3381a85c42a9959201f9aa122f7c => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:43:42.530679 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2db3f9e-b2eb-4c48-9308-5e9e57615a87 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:42.530958 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2db3f9e-b2eb-4c48-9308-5e9e57615a87 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:42.531238 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2db3f9e-b2eb-4c48-9308-5e9e57615a87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:42.550704 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-b2db3f9e-b2eb-4c48-9308-5e9e57615a87 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:43:42.552618 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-b2db3f9e-b2eb-4c48-9308-5e9e57615a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:42.610239 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1113/2231] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:43:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:43:42.620222 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7a1ccd-4aa9-4768-ad95-d3b22dbbce0d admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:42.621914 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-bc7a1ccd-4aa9-4768-ad95-d3b22dbbce0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:42.677849 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7a1ccd-4aa9-4768-ad95-d3b22dbbce0d admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:42.681595 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a6e248-b1c5-4d8e-b876-67d4909baf13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '723f5f43572a493dae0349070a2adb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:42.682206 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6e248-b1c5-4d8e-b876-67d4909baf13 service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:42.682490 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6e248-b1c5-4d8e-b876-67d4909baf13 service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:42.682768 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6e248-b1c5-4d8e-b876-67d4909baf13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:42.691667 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a6e248-b1c5-4d8e-b876-67d4909baf13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:42.693198 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a6e248-b1c5-4d8e-b876-67d4909baf13 service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:42.703042 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1119/2232] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:43:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:43:44.293834 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60038ba5-c792-43ed-b137-c8a49c83cea4 None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:44.294344 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60038ba5-c792-43ed-b137-c8a49c83cea4 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:44.294622 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60038ba5-c792-43ed-b137-c8a49c83cea4 None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:44.296313 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1114/2233] 10.222.0.70 () {54 vars in 921 bytes} [Tue Aug 2 21:43:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:43:44.305718 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d31786-afc8-4c39-a805-8967c77b46ee None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:44.306175 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d31786-afc8-4c39-a805-8967c77b46ee None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:44.306382 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d31786-afc8-4c39-a805-8967c77b46ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:44.335284 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-d3d31786-afc8-4c39-a805-8967c77b46ee None None] MFA Rules not processed for user `87dd5c1c5e854d4b96e0b7dad6aa3719`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:43:44.336691 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-d3d31786-afc8-4c39-a805-8967c77b46ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:44.449489 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1120/2234] 10.222.0.70 () {58 vars in 1018 bytes} [Tue Aug 2 21:43:44 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:43:44.456298 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60038ba5-c792-43ed-b137-c8a49c83cea4 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:44.469535 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-60038ba5-c792-43ed-b137-c8a49c83cea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:44.546116 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60038ba5-c792-43ed-b137-c8a49c83cea4 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:44.551243 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ddf4a4-ee6c-42d2-ba1f-0836d8ac9be2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'accb7ab8b4f447389ed394a48fc27619', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:44.552287 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ddf4a4-ee6c-42d2-ba1f-0836d8ac9be2 service glance] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:44.552655 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ddf4a4-ee6c-42d2-ba1f-0836d8ac9be2 service glance] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:44.552975 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ddf4a4-ee6c-42d2-ba1f-0836d8ac9be2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:44.564665 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ddf4a4-ee6c-42d2-ba1f-0836d8ac9be2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:44.566514 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ddf4a4-ee6c-42d2-ba1f-0836d8ac9be2 service glance] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:44.580552 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1115/2235] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:43:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 21:43:44.654576 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1103c835-bd58-470b-a8d9-3c40208e3f1e None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:44.654883 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1103c835-bd58-470b-a8d9-3c40208e3f1e None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:44.655163 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1103c835-bd58-470b-a8d9-3c40208e3f1e None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:44.656617 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1121/2236] 10.222.0.70 () {54 vars in 921 bytes} [Tue Aug 2 21:43:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:43:44.662092 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74d10cb-b1d8-4634-870d-f0a642f29a7c None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:44.662401 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74d10cb-b1d8-4634-870d-f0a642f29a7c None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:44.662673 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74d10cb-b1d8-4634-870d-f0a642f29a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:44.687431 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-a74d10cb-b1d8-4634-870d-f0a642f29a7c None None] MFA Rules not processed for user `723f5f43572a493dae0349070a2adb5e`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:43:44.693650 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-a74d10cb-b1d8-4634-870d-f0a642f29a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:44.703641 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1116/2237] 10.222.0.70 () {58 vars in 1018 bytes} [Tue Aug 2 21:43:44 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:43:44.716119 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1103c835-bd58-470b-a8d9-3c40208e3f1e None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:44.728384 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1103c835-bd58-470b-a8d9-3c40208e3f1e None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:44.734421 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1149b59-047f-45ac-8528-85fb6a3fbcfe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '723f5f43572a493dae0349070a2adb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:44.734421 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1149b59-047f-45ac-8528-85fb6a3fbcfe service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:44.734421 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1149b59-047f-45ac-8528-85fb6a3fbcfe service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:44.734421 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1149b59-047f-45ac-8528-85fb6a3fbcfe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:44.757856 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1149b59-047f-45ac-8528-85fb6a3fbcfe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:44.759258 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1149b59-047f-45ac-8528-85fb6a3fbcfe service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:44.768410 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1122/2238] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:43:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:43:44.862066 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e4a4d8-60d7-4776-b128-d8a7710a4d3f None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:44.862608 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e4a4d8-60d7-4776-b128-d8a7710a4d3f None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:44.864754 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e4a4d8-60d7-4776-b128-d8a7710a4d3f None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:44.865117 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1117/2239] 10.222.0.70 () {54 vars in 921 bytes} [Tue Aug 2 21:43:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:43:44.873338 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523d51b9-5c2a-4c96-a6ab-9f81e85de36a None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:44.873634 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523d51b9-5c2a-4c96-a6ab-9f81e85de36a None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:44.873918 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523d51b9-5c2a-4c96-a6ab-9f81e85de36a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:44.895432 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-523d51b9-5c2a-4c96-a6ab-9f81e85de36a None None] MFA Rules not processed for user `87dd5c1c5e854d4b96e0b7dad6aa3719`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:43:44.896799 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-523d51b9-5c2a-4c96-a6ab-9f81e85de36a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:44.910662 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1123/2240] 10.222.0.70 () {58 vars in 1018 bytes} [Tue Aug 2 21:43:44 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:43:44.921327 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e4a4d8-60d7-4776-b128-d8a7710a4d3f None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:44.933962 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e4a4d8-60d7-4776-b128-d8a7710a4d3f None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:44.943792 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf1735b-52eb-4da8-b204-1d39ffe0c4be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '723f5f43572a493dae0349070a2adb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:44.944390 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf1735b-52eb-4da8-b204-1d39ffe0c4be service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:44.944680 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf1735b-52eb-4da8-b204-1d39ffe0c4be service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:44.944955 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf1735b-52eb-4da8-b204-1d39ffe0c4be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:44.962802 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf1735b-52eb-4da8-b204-1d39ffe0c4be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:44.964280 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf1735b-52eb-4da8-b204-1d39ffe0c4be service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:44.983941 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1118/2241] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:43:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:43:47.581187 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8a36bf-a0bd-460a-9277-571830937f36 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:47.581636 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8a36bf-a0bd-460a-9277-571830937f36 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:47.581865 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8a36bf-a0bd-460a-9277-571830937f36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:47.608091 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:43:47.618018 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-7c8a36bf-a0bd-460a-9277-571830937f36 None None] MFA Rules not processed for user `4ef0895d195b463688f59525e075dcbc`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:43:47.619787 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-7c8a36bf-a0bd-460a-9277-571830937f36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:47.692984 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1124/2242] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:43:47 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:43:47.697653 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf1735b-52eb-4da8-b204-1d39ffe0c4be service neutron] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:47.710079 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf1735b-52eb-4da8-b204-1d39ffe0c4be service neutron] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:47.731889 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6f1d2f-d7a2-4cda-9b4e-ac85db4c0e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:47.732815 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6f1d2f-d7a2-4cda-9b4e-ac85db4c0e34 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:47.745163 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6f1d2f-d7a2-4cda-9b4e-ac85db4c0e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:47.745483 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6f1d2f-d7a2-4cda-9b4e-ac85db4c0e34 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:47.746223 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6f1d2f-d7a2-4cda-9b4e-ac85db4c0e34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:47.748474 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6f1d2f-d7a2-4cda-9b4e-ac85db4c0e34 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:47.760800 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:43:47.783762 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8a36bf-a0bd-460a-9277-571830937f36 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:47.790721 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1119/2243] 10.222.0.70 () {60 vars in 1153 bytes} [Tue Aug 2 21:43:47 2022] POST /identity/v3/projects => generated 383 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:43:47.796437 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8a36bf-a0bd-460a-9277-571830937f36 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:47.821968 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796f944f-3870-4e5a-89af-15af62af3ba4 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:47.822362 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796f944f-3870-4e5a-89af-15af62af3ba4 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:47.822735 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796f944f-3870-4e5a-89af-15af62af3ba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:47.850915 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-796f944f-3870-4e5a-89af-15af62af3ba4 None None] MFA Rules not processed for user `6be7b2bcfebd45389ca289c34fbabc3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:43:47.852140 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-796f944f-3870-4e5a-89af-15af62af3ba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:47.867994 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd83ee1-a9c0-4343-8a57-1bd3b96be1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:47.868668 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd83ee1-a9c0-4343-8a57-1bd3b96be1f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:47.868956 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd83ee1-a9c0-4343-8a57-1bd3b96be1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:47.869236 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd83ee1-a9c0-4343-8a57-1bd3b96be1f5 admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:47.870548 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd83ee1-a9c0-4343-8a57-1bd3b96be1f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:47.872554 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd83ee1-a9c0-4343-8a57-1bd3b96be1f5 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:47.896818 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1125/2244] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 2 21:43:47 2022] POST /identity/v3/users => generated 298 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:43:47.900730 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd83ee1-a9c0-4343-8a57-1bd3b96be1f5 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:47.912799 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd83ee1-a9c0-4343-8a57-1bd3b96be1f5 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:47.919276 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1120/2245] 10.222.0.70 () {58 vars in 1009 bytes} [Tue Aug 2 21:43:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:43:47.919828 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b19ba2f-7f8d-48dc-a72a-1db8d13e1114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:47.920508 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b19ba2f-7f8d-48dc-a72a-1db8d13e1114 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:47.920800 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b19ba2f-7f8d-48dc-a72a-1db8d13e1114 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:47.921081 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b19ba2f-7f8d-48dc-a72a-1db8d13e1114 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:47.921960 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b19ba2f-7f8d-48dc-a72a-1db8d13e1114 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:47.923672 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b19ba2f-7f8d-48dc-a72a-1db8d13e1114 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:47.939571 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1126/2246] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:43:47 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 21:43:47.941509 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796f944f-3870-4e5a-89af-15af62af3ba4 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:47.951232 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b19ba2f-7f8d-48dc-a72a-1db8d13e1114 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:47.953092 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-0b19ba2f-7f8d-48dc-a72a-1db8d13e1114 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:47.954482 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796f944f-3870-4e5a-89af-15af62af3ba4 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:47.959853 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4f479c-c877-4741-adf9-fcc4024848ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:47.960907 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4f479c-c877-4741-adf9-fcc4024848ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:47.961494 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4f479c-c877-4741-adf9-fcc4024848ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:47.962091 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4f479c-c877-4741-adf9-fcc4024848ed admin admin] PATH_INFO: `/v3/projects/75dc6be64dd342f29692aec7d4e3b670/users/3a788f50faaf4259a5c7e178a1b68330/roles/3e32dbf75f9b41f5adb9fe59851267bb` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:47.979545 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4f479c-c877-4741-adf9-fcc4024848ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=75dc6be64dd342f29692aec7d4e3b670, user_id=3a788f50faaf4259a5c7e178a1b68330, role_id=3e32dbf75f9b41f5adb9fe59851267bb)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:47.982308 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4f479c-c877-4741-adf9-fcc4024848ed admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:47.999417 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1121/2247] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:43:47 2022] PUT /identity/v3/projects/75dc6be64dd342f29692aec7d4e3b670/users/3a788f50faaf4259a5c7e178a1b68330/roles/3e32dbf75f9b41f5adb9fe59851267bb => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:43:48.003627 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4f479c-c877-4741-adf9-fcc4024848ed admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:48.035970 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b19ba2f-7f8d-48dc-a72a-1db8d13e1114 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:48.056978 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:43:48.080098 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4f479c-c877-4741-adf9-fcc4024848ed admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:48.087261 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a20e5d-70d9-45a4-8696-c7677aeb06db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:48.087907 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a20e5d-70d9-45a4-8696-c7677aeb06db admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:48.088587 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a20e5d-70d9-45a4-8696-c7677aeb06db admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:48.088874 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a20e5d-70d9-45a4-8696-c7677aeb06db admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:48.089949 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a20e5d-70d9-45a4-8696-c7677aeb06db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:48.091616 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a20e5d-70d9-45a4-8696-c7677aeb06db admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:48.106657 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1122/2248] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:43:48 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:43:48.107710 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a20e5d-70d9-45a4-8696-c7677aeb06db admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:48.112972 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2823661-9769-4859-a500-e0d81e3c8ae3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee7ebf40212465aac997b461a2d10fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:48.113713 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2823661-9769-4859-a500-e0d81e3c8ae3 service swift] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:48.115190 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2823661-9769-4859-a500-e0d81e3c8ae3 service swift] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:48.115534 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2823661-9769-4859-a500-e0d81e3c8ae3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:48.118428 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a20e5d-70d9-45a4-8696-c7677aeb06db admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:48.124623 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff80ded-265f-4783-b359-5e4816915b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:48.125303 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff80ded-265f-4783-b359-5e4816915b01 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:48.125937 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff80ded-265f-4783-b359-5e4816915b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:48.126226 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff80ded-265f-4783-b359-5e4816915b01 admin admin] PATH_INFO: `/v3/projects/75dc6be64dd342f29692aec7d4e3b670/users/3a788f50faaf4259a5c7e178a1b68330/roles/3e32dbf75f9b41f5adb9fe59851267bb` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:48.128512 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff80ded-265f-4783-b359-5e4816915b01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75dc6be64dd342f29692aec7d4e3b670, user_id=3a788f50faaf4259a5c7e178a1b68330, role_id=3e32dbf75f9b41f5adb9fe59851267bb)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:48.131339 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff80ded-265f-4783-b359-5e4816915b01 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:48.142601 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1123/2249] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:43:48 2022] PUT /identity/v3/projects/75dc6be64dd342f29692aec7d4e3b670/users/3a788f50faaf4259a5c7e178a1b68330/roles/3e32dbf75f9b41f5adb9fe59851267bb => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:43:48.201658 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2823661-9769-4859-a500-e0d81e3c8ae3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:48.203743 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2823661-9769-4859-a500-e0d81e3c8ae3 service swift] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:48.215684 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1127/2250] 10.222.0.70 () {60 vars in 1384 bytes} [Tue Aug 2 21:43:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 02 21:43:55.142622 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a626c5-7fcd-4343-b67f-7a7e2f13f478 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:55.143139 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a626c5-7fcd-4343-b67f-7a7e2f13f478 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:55.143239 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a626c5-7fcd-4343-b67f-7a7e2f13f478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:55.177352 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-60a626c5-7fcd-4343-b67f-7a7e2f13f478 None None] MFA Rules not processed for user `3a788f50faaf4259a5c7e178a1b68330`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:43:55.178720 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-60a626c5-7fcd-4343-b67f-7a7e2f13f478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:55.324261 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:43:55.375018 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1124/2251] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:43:55 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:43:55.385145 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2823661-9769-4859-a500-e0d81e3c8ae3 service swift] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:55.469365 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2823661-9769-4859-a500-e0d81e3c8ae3 service swift] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:55.533936 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a89474-ca54-4847-a61f-3265ffdfb078 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'accb7ab8b4f447389ed394a48fc27619', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:55.534872 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a89474-ca54-4847-a61f-3265ffdfb078 service glance] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:55.535329 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a89474-ca54-4847-a61f-3265ffdfb078 service glance] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:55.535863 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a89474-ca54-4847-a61f-3265ffdfb078 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:55.585857 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:43:55.617064 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a89474-ca54-4847-a61f-3265ffdfb078 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:55.620807 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a89474-ca54-4847-a61f-3265ffdfb078 service glance] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:55.632203 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1128/2252] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:43:55 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:43:55.793282 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707326de-9ac4-4af1-ae20-28ecd78b7ebd None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:55.793576 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707326de-9ac4-4af1-ae20-28ecd78b7ebd None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:55.793867 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707326de-9ac4-4af1-ae20-28ecd78b7ebd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:55.842556 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-707326de-9ac4-4af1-ae20-28ecd78b7ebd None None] MFA Rules not processed for user `6be7b2bcfebd45389ca289c34fbabc3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:43:55.843815 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-707326de-9ac4-4af1-ae20-28ecd78b7ebd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:43:55.982757 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1125/2253] 10.222.0.70 () {58 vars in 1009 bytes} [Tue Aug 2 21:43:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:43:56.006112 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a89474-ca54-4847-a61f-3265ffdfb078 service glance] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:43:56.118994 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a89474-ca54-4847-a61f-3265ffdfb078 service glance] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:43:56.127337 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a739d312-408b-41c4-b832-2b0a8c9af6fe service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee7ebf40212465aac997b461a2d10fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:43:56.127990 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a739d312-408b-41c4-b832-2b0a8c9af6fe service swift] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:43:56.128311 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a739d312-408b-41c4-b832-2b0a8c9af6fe service swift] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:43:56.128619 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a739d312-408b-41c4-b832-2b0a8c9af6fe service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:43:56.143864 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a739d312-408b-41c4-b832-2b0a8c9af6fe service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:43:56.146159 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a739d312-408b-41c4-b832-2b0a8c9af6fe service swift] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:43:56.164612 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1129/2254] 10.222.0.70 () {60 vars in 1384 bytes} [Tue Aug 2 21:43:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 02 21:44:05.045841 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743cfa3b-afd7-46fd-85f4-3ac3c7c19fd3 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:44:05.046439 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743cfa3b-afd7-46fd-85f4-3ac3c7c19fd3 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:44:05.046439 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743cfa3b-afd7-46fd-85f4-3ac3c7c19fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:44:05.066616 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-743cfa3b-afd7-46fd-85f4-3ac3c7c19fd3 None None] MFA Rules not processed for user `4ef0895d195b463688f59525e075dcbc`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:44:05.067826 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-743cfa3b-afd7-46fd-85f4-3ac3c7c19fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:44:05.074898 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1126/2255] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:44:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:44:05.886589 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a739d312-408b-41c4-b832-2b0a8c9af6fe service swift] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:44:05.888304 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-a739d312-408b-41c4-b832-2b0a8c9af6fe service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:44:05.965192 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a739d312-408b-41c4-b832-2b0a8c9af6fe service swift] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:44:05.970847 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddec675-3114-41af-8876-69640f0879b4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83fcd951771e42959506b70b0137003f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:44:05.971620 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddec675-3114-41af-8876-69640f0879b4 service placement] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:44:05.971909 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddec675-3114-41af-8876-69640f0879b4 service placement] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:44:05.972747 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddec675-3114-41af-8876-69640f0879b4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:44:05.974506 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-cddec675-3114-41af-8876-69640f0879b4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:44:05.988876 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddec675-3114-41af-8876-69640f0879b4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:44:05.990743 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddec675-3114-41af-8876-69640f0879b4 service placement] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:44:06.000977 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1130/2256] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:44:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:44:06.636695 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3c7626-fa55-445a-a199-4f2929c27024 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:44:06.637172 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3c7626-fa55-445a-a199-4f2929c27024 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:44:06.637297 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3c7626-fa55-445a-a199-4f2929c27024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:44:06.657645 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-9a3c7626-fa55-445a-a199-4f2929c27024 None None] MFA Rules not processed for user `6be7b2bcfebd45389ca289c34fbabc3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:44:06.659045 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-9a3c7626-fa55-445a-a199-4f2929c27024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:44:06.666598 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1127/2257] 10.222.0.70 () {58 vars in 967 bytes} [Tue Aug 2 21:44:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:44:06.680155 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddec675-3114-41af-8876-69640f0879b4 service placement] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:44:06.692680 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddec675-3114-41af-8876-69640f0879b4 service placement] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:44:06.704179 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9570980-b827-4be2-8146-d6f83611b911 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee7ebf40212465aac997b461a2d10fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:44:06.704807 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9570980-b827-4be2-8146-d6f83611b911 service swift] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:44:06.705106 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9570980-b827-4be2-8146-d6f83611b911 service swift] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:44:06.705422 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9570980-b827-4be2-8146-d6f83611b911 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:44:06.715283 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9570980-b827-4be2-8146-d6f83611b911 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:44:06.716923 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9570980-b827-4be2-8146-d6f83611b911 service swift] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:44:06.725714 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1131/2258] 10.222.0.70 () {60 vars in 1384 bytes} [Tue Aug 2 21:44:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 02 21:44:08.616372 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9566fb24-ac1a-49a7-af41-a9d6206081a1 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:44:08.616843 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9566fb24-ac1a-49a7-af41-a9d6206081a1 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:44:08.616935 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9566fb24-ac1a-49a7-af41-a9d6206081a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:44:08.639975 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-9566fb24-ac1a-49a7-af41-a9d6206081a1 None None] MFA Rules not processed for user `6be7b2bcfebd45389ca289c34fbabc3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:44:08.641254 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-9566fb24-ac1a-49a7-af41-a9d6206081a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:44:08.650487 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1128/2259] 10.222.0.70 () {58 vars in 1009 bytes} [Tue Aug 2 21:44:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:44:08.665097 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9570980-b827-4be2-8146-d6f83611b911 service swift] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:44:08.678954 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9570980-b827-4be2-8146-d6f83611b911 service swift] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:44:08.685085 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab11fa5-fa40-428e-8d5c-33a96fd697a2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee7ebf40212465aac997b461a2d10fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:44:08.685941 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab11fa5-fa40-428e-8d5c-33a96fd697a2 service swift] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:44:08.686088 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab11fa5-fa40-428e-8d5c-33a96fd697a2 service swift] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:44:08.686244 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab11fa5-fa40-428e-8d5c-33a96fd697a2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:44:08.695928 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab11fa5-fa40-428e-8d5c-33a96fd697a2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:44:08.697601 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab11fa5-fa40-428e-8d5c-33a96fd697a2 service swift] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:44:08.707412 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1132/2260] 10.222.0.70 () {60 vars in 1384 bytes} [Tue Aug 2 21:44:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 02 21:44:18.631825 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=43 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:44:18.706398 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=88 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:44:33.656673 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5581e05-4ad0-4b99-a49a-bd9087600703 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:44:33.657121 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5581e05-4ad0-4b99-a49a-bd9087600703 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:44:33.657406 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5581e05-4ad0-4b99-a49a-bd9087600703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:44:33.677908 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-e5581e05-4ad0-4b99-a49a-bd9087600703 None None] MFA Rules not processed for user `54c59604553a491b9276bd45b3a2f6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:44:33.679216 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-e5581e05-4ad0-4b99-a49a-bd9087600703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:44:33.738013 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1129/2261] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:44:33 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:44:35.134604 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab11fa5-fa40-428e-8d5c-33a96fd697a2 service swift] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:44:35.136596 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-bab11fa5-fa40-428e-8d5c-33a96fd697a2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:44:35.196528 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab11fa5-fa40-428e-8d5c-33a96fd697a2 service swift] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:44:35.200157 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fa4121-2550-4f13-a2e2-5da72be96c42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '723f5f43572a493dae0349070a2adb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:44:35.200805 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fa4121-2550-4f13-a2e2-5da72be96c42 service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:44:35.201091 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fa4121-2550-4f13-a2e2-5da72be96c42 service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:44:35.201371 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fa4121-2550-4f13-a2e2-5da72be96c42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:44:35.210876 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fa4121-2550-4f13-a2e2-5da72be96c42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:44:35.212652 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fa4121-2550-4f13-a2e2-5da72be96c42 service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:44:35.222107 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1133/2262] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:44:35 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 21:44:43.730822 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=25 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:44:45.222343 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=26 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:44:48.740071 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ece7af2-049c-409f-b9da-978471044243 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:44:48.740669 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ece7af2-049c-409f-b9da-978471044243 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:44:48.740775 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ece7af2-049c-409f-b9da-978471044243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:44:48.761922 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-3ece7af2-049c-409f-b9da-978471044243 None None] MFA Rules not processed for user `3081e110cdd94b8aa51f7bb237aec635`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:44:48.763181 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-3ece7af2-049c-409f-b9da-978471044243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:44:48.854118 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1130/2263] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:44:48 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:44:58.474962 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0904401a-473c-4fe8-a838-ec938e28fd89 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:44:58.475519 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0904401a-473c-4fe8-a838-ec938e28fd89 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:44:58.476369 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0904401a-473c-4fe8-a838-ec938e28fd89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:44:58.496328 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-0904401a-473c-4fe8-a838-ec938e28fd89 None None] MFA Rules not processed for user `05fc0253234e42e7acbcc2f0959ac0db`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:44:58.497553 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-0904401a-473c-4fe8-a838-ec938e28fd89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:44:58.562384 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1134/2264] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:44:58 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:44:58.844169 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=25 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:45:08.549930 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=25 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:45:19.884067 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d72dff-89ba-40ef-9daa-28303a5257b4 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:45:19.884610 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d72dff-89ba-40ef-9daa-28303a5257b4 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:45:19.884722 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d72dff-89ba-40ef-9daa-28303a5257b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:45:19.903575 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-27d72dff-89ba-40ef-9daa-28303a5257b4 None None] MFA Rules not processed for user `182daeeee91b4594b4eab1c28cba5067`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:45:19.904786 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-27d72dff-89ba-40ef-9daa-28303a5257b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:45:19.960371 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1131/2265] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:45:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:45:29.953065 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=25 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:45:51.128510 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c42b8d-b908-4490-b3b9-5d7aae77f3aa None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:45:51.129137 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c42b8d-b908-4490-b3b9-5d7aae77f3aa None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:45:51.129137 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c42b8d-b908-4490-b3b9-5d7aae77f3aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:45:51.148179 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-07c42b8d-b908-4490-b3b9-5d7aae77f3aa None None] MFA Rules not processed for user `54c59604553a491b9276bd45b3a2f6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:45:51.149414 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-07c42b8d-b908-4490-b3b9-5d7aae77f3aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:45:51.157702 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1135/2266] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:45:51 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:45:58.341616 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d72dff-89ba-40ef-9daa-28303a5257b4 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:45:58.351611 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d72dff-89ba-40ef-9daa-28303a5257b4 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:45:58.355437 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4738942d-a608-48d4-b594-5b24684c6dc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '723f5f43572a493dae0349070a2adb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:45:58.356048 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4738942d-a608-48d4-b594-5b24684c6dc5 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:45:58.356360 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4738942d-a608-48d4-b594-5b24684c6dc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:45:58.356633 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4738942d-a608-48d4-b594-5b24684c6dc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:45:58.358498 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-4738942d-a608-48d4-b594-5b24684c6dc5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:45:58.424699 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4738942d-a608-48d4-b594-5b24684c6dc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:45:58.426661 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4738942d-a608-48d4-b594-5b24684c6dc5 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:45:58.437063 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1132/2267] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:45:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:46:00.092605 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c42b8d-b908-4490-b3b9-5d7aae77f3aa None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:00.102876 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c42b8d-b908-4490-b3b9-5d7aae77f3aa None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:00.107145 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c94f9b-4f71-4fba-ab35-f285d0fd3e4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '723f5f43572a493dae0349070a2adb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:00.107762 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c94f9b-4f71-4fba-ab35-f285d0fd3e4a service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:00.108045 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c94f9b-4f71-4fba-ab35-f285d0fd3e4a service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:00.108357 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c94f9b-4f71-4fba-ab35-f285d0fd3e4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:00.110162 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-f7c94f9b-4f71-4fba-ab35-f285d0fd3e4a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:46:00.186141 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c94f9b-4f71-4fba-ab35-f285d0fd3e4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:00.188011 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c94f9b-4f71-4fba-ab35-f285d0fd3e4a service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:00.200660 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1136/2268] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:46:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:46:00.295260 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4738942d-a608-48d4-b594-5b24684c6dc5 service neutron] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:00.298079 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-4738942d-a608-48d4-b594-5b24684c6dc5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:46:00.316773 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4738942d-a608-48d4-b594-5b24684c6dc5 service neutron] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:00.321480 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e405aa-7e5f-467d-9c17-85c8a52532a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:00.322187 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e405aa-7e5f-467d-9c17-85c8a52532a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:00.322665 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e405aa-7e5f-467d-9c17-85c8a52532a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:00.322944 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e405aa-7e5f-467d-9c17-85c8a52532a4 admin admin] PATH_INFO: `/v3/users/3081e110cdd94b8aa51f7bb237aec635` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:00.324344 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e405aa-7e5f-467d-9c17-85c8a52532a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3081e110cdd94b8aa51f7bb237aec635)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:00.326782 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e405aa-7e5f-467d-9c17-85c8a52532a4 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:00.389000 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-91e405aa-7e5f-467d-9c17-85c8a52532a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3081e110cdd94b8aa51f7bb237aec635'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:00.397646 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-91e405aa-7e5f-467d-9c17-85c8a52532a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3081e110cdd94b8aa51f7bb237aec635'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:00.411232 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-91e405aa-7e5f-467d-9c17-85c8a52532a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3081e110cdd94b8aa51f7bb237aec635'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:00.411903 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-91e405aa-7e5f-467d-9c17-85c8a52532a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3081e110cdd94b8aa51f7bb237aec635'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:00.418854 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-91e405aa-7e5f-467d-9c17-85c8a52532a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3081e110cdd94b8aa51f7bb237aec635'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:00.424946 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1133/2269] 10.222.0.70 () {58 vars in 1224 bytes} [Tue Aug 2 21:46:00 2022] DELETE /identity/v3/users/3081e110cdd94b8aa51f7bb237aec635 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:46:00.598501 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c94f9b-4f71-4fba-ab35-f285d0fd3e4a service neutron] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:00.610265 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c94f9b-4f71-4fba-ab35-f285d0fd3e4a service neutron] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:00.669897 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51045bb9-24ba-4228-aaff-5cbfc9261e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:00.670536 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51045bb9-24ba-4228-aaff-5cbfc9261e8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:00.670955 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51045bb9-24ba-4228-aaff-5cbfc9261e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:00.671229 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51045bb9-24ba-4228-aaff-5cbfc9261e8d admin admin] PATH_INFO: `/v3/projects/b845596f9c074dc0ab26374cb98a5665` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:00.672419 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51045bb9-24ba-4228-aaff-5cbfc9261e8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b845596f9c074dc0ab26374cb98a5665)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:00.674337 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51045bb9-24ba-4228-aaff-5cbfc9261e8d admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:00.719269 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-51045bb9-24ba-4228-aaff-5cbfc9261e8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b845596f9c074dc0ab26374cb98a5665', 'request_id': 'req-51045bb9-24ba-4228-aaff-5cbfc9261e8d'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:00.725269 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-51045bb9-24ba-4228-aaff-5cbfc9261e8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b845596f9c074dc0ab26374cb98a5665', 'request_id': 'req-51045bb9-24ba-4228-aaff-5cbfc9261e8d'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:00.732689 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-51045bb9-24ba-4228-aaff-5cbfc9261e8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b845596f9c074dc0ab26374cb98a5665', 'request_id': 'req-51045bb9-24ba-4228-aaff-5cbfc9261e8d'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:00.743628 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-51045bb9-24ba-4228-aaff-5cbfc9261e8d admin admin] The token cache is being invalidate because project b845596f9c074dc0ab26374cb98a5665 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:46:00.743913 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-51045bb9-24ba-4228-aaff-5cbfc9261e8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:00.744588 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-51045bb9-24ba-4228-aaff-5cbfc9261e8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:00.746076 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1137/2270] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Aug 2 21:46:00 2022] DELETE /identity/v3/projects/b845596f9c074dc0ab26374cb98a5665 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:46:00.751048 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfafb1c-2637-4291-9f9d-1c61a263a2a7 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:00.751339 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfafb1c-2637-4291-9f9d-1c61a263a2a7 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:00.751623 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfafb1c-2637-4291-9f9d-1c61a263a2a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:00.775051 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-bcfafb1c-2637-4291-9f9d-1c61a263a2a7 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:46:00.776638 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-bcfafb1c-2637-4291-9f9d-1c61a263a2a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:46:00.842523 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1134/2271] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:46:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:46:00.850524 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75696737-d847-4f2e-8cc5-8bfbdb491e36 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:00.850814 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75696737-d847-4f2e-8cc5-8bfbdb491e36 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:00.851095 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75696737-d847-4f2e-8cc5-8bfbdb491e36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:00.872125 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-75696737-d847-4f2e-8cc5-8bfbdb491e36 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:46:00.873421 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-75696737-d847-4f2e-8cc5-8bfbdb491e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:46:00.882903 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1138/2272] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:46:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:46:00.887353 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfafb1c-2637-4291-9f9d-1c61a263a2a7 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:00.897456 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfafb1c-2637-4291-9f9d-1c61a263a2a7 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:00.902149 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916ef6d5-6fe7-4bf8-ba8b-f1a669ab5dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:00.902918 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916ef6d5-6fe7-4bf8-ba8b-f1a669ab5dbf admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:00.903050 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916ef6d5-6fe7-4bf8-ba8b-f1a669ab5dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:00.903311 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916ef6d5-6fe7-4bf8-ba8b-f1a669ab5dbf admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:00.904037 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916ef6d5-6fe7-4bf8-ba8b-f1a669ab5dbf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:46:00.904391 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916ef6d5-6fe7-4bf8-ba8b-f1a669ab5dbf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:00.906911 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916ef6d5-6fe7-4bf8-ba8b-f1a669ab5dbf admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:00.908981 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:46:00.922876 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1135/2273] 10.222.0.70 () {58 vars in 1153 bytes} [Tue Aug 2 21:46:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:46:00.927634 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75696737-d847-4f2e-8cc5-8bfbdb491e36 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:00.932160 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:46:00.939177 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75696737-d847-4f2e-8cc5-8bfbdb491e36 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:00.945100 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5f3c55-f099-4d48-8b62-5787b1c2021d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:00.945787 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5f3c55-f099-4d48-8b62-5787b1c2021d admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:00.946136 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5f3c55-f099-4d48-8b62-5787b1c2021d admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:00.946480 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5f3c55-f099-4d48-8b62-5787b1c2021d admin admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:00.947222 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5f3c55-f099-4d48-8b62-5787b1c2021d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:00.949274 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5f3c55-f099-4d48-8b62-5787b1c2021d admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:00.978502 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1139/2274] 10.222.0.70 () {60 vars in 1153 bytes} [Tue Aug 2 21:46:00 2022] POST /identity/v3/projects => generated 405 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:46:00.982996 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916ef6d5-6fe7-4bf8-ba8b-f1a669ab5dbf admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:00.993859 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916ef6d5-6fe7-4bf8-ba8b-f1a669ab5dbf admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:01.054648 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37d8580-6620-46b2-9ed9-9dc7bcc07c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:01.055277 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37d8580-6620-46b2-9ed9-9dc7bcc07c1a admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:01.055563 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37d8580-6620-46b2-9ed9-9dc7bcc07c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:01.055842 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37d8580-6620-46b2-9ed9-9dc7bcc07c1a admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:01.056538 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37d8580-6620-46b2-9ed9-9dc7bcc07c1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:01.061038 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37d8580-6620-46b2-9ed9-9dc7bcc07c1a admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:01.086892 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1136/2275] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 2 21:46:00 2022] POST /identity/v3/users => generated 303 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 21:46:01.090909 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5f3c55-f099-4d48-8b62-5787b1c2021d admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:01.101531 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5f3c55-f099-4d48-8b62-5787b1c2021d admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:01.106495 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dd0084-01ab-4274-b863-ba054bfbf899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:01.107099 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dd0084-01ab-4274-b863-ba054bfbf899 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:01.107383 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dd0084-01ab-4274-b863-ba054bfbf899 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:01.107659 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dd0084-01ab-4274-b863-ba054bfbf899 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:01.108383 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dd0084-01ab-4274-b863-ba054bfbf899 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:01.110267 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dd0084-01ab-4274-b863-ba054bfbf899 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:01.120787 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1140/2276] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:46:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:46:01.124674 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37d8580-6620-46b2-9ed9-9dc7bcc07c1a admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:01.134435 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37d8580-6620-46b2-9ed9-9dc7bcc07c1a admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:01.139066 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d4cedf-6a0e-4e90-b8a0-3690f0143265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:01.139663 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d4cedf-6a0e-4e90-b8a0-3690f0143265 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:01.139945 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d4cedf-6a0e-4e90-b8a0-3690f0143265 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:01.140223 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d4cedf-6a0e-4e90-b8a0-3690f0143265 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:01.140966 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d4cedf-6a0e-4e90-b8a0-3690f0143265 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:01.142557 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d4cedf-6a0e-4e90-b8a0-3690f0143265 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:01.154715 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1137/2277] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:46:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:46:01.158755 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dd0084-01ab-4274-b863-ba054bfbf899 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:01.169359 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dd0084-01ab-4274-b863-ba054bfbf899 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:01.174024 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0252b9f7-2324-4161-8b9a-5628405dbea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:01.174671 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0252b9f7-2324-4161-8b9a-5628405dbea1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:01.174957 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0252b9f7-2324-4161-8b9a-5628405dbea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:01.175238 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0252b9f7-2324-4161-8b9a-5628405dbea1 admin admin] PATH_INFO: `/v3/projects/fd8957eba26f41b19a14995e8a45f953/users/8148e6939e884f339cd35d5866fd0382/roles/462e3381a85c42a9959201f9aa122f7c` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:01.189421 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0252b9f7-2324-4161-8b9a-5628405dbea1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd8957eba26f41b19a14995e8a45f953, user_id=8148e6939e884f339cd35d5866fd0382, role_id=462e3381a85c42a9959201f9aa122f7c)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:01.192099 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0252b9f7-2324-4161-8b9a-5628405dbea1 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:01.204986 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1141/2278] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:46:01 2022] PUT /identity/v3/projects/fd8957eba26f41b19a14995e8a45f953/users/8148e6939e884f339cd35d5866fd0382/roles/462e3381a85c42a9959201f9aa122f7c => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:46:01.210469 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476badea-6abf-4236-9925-74560290bf0d None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:01.210761 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476badea-6abf-4236-9925-74560290bf0d None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:01.211089 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476badea-6abf-4236-9925-74560290bf0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:01.230724 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-476badea-6abf-4236-9925-74560290bf0d None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:46:01.232222 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-476badea-6abf-4236-9925-74560290bf0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:46:01.295538 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1138/2279] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:46:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:46:01.305356 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0252b9f7-2324-4161-8b9a-5628405dbea1 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:01.307142 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-0252b9f7-2324-4161-8b9a-5628405dbea1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:46:01.369970 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0252b9f7-2324-4161-8b9a-5628405dbea1 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:01.377174 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9768e0de-0890-43a9-a7b7-850b6274573e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '723f5f43572a493dae0349070a2adb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:01.377816 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9768e0de-0890-43a9-a7b7-850b6274573e service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:01.378103 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9768e0de-0890-43a9-a7b7-850b6274573e service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:01.378381 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9768e0de-0890-43a9-a7b7-850b6274573e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:01.388565 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9768e0de-0890-43a9-a7b7-850b6274573e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:01.390024 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9768e0de-0890-43a9-a7b7-850b6274573e service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:01.403639 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1142/2280] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:46:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:46:02.030419 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f55cd-b7b5-45c6-b203-7a3b54a157b2 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:02.030850 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f55cd-b7b5-45c6-b203-7a3b54a157b2 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:02.031131 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f55cd-b7b5-45c6-b203-7a3b54a157b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:02.067190 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-485f55cd-b7b5-45c6-b203-7a3b54a157b2 None None] MFA Rules not processed for user `8148e6939e884f339cd35d5866fd0382`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:46:02.068448 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-485f55cd-b7b5-45c6-b203-7a3b54a157b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:46:02.149032 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9768e0de-0890-43a9-a7b7-850b6274573e service neutron] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:02.159673 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9768e0de-0890-43a9-a7b7-850b6274573e service neutron] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:02.164827 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1139/2281] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:46:02 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:46:02.164977 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596fe7d3-26a9-4cb8-9936-78fea2c625ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '723f5f43572a493dae0349070a2adb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:02.164977 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596fe7d3-26a9-4cb8-9936-78fea2c625ff service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:02.165204 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596fe7d3-26a9-4cb8-9936-78fea2c625ff service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:02.165328 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596fe7d3-26a9-4cb8-9936-78fea2c625ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:02.166285 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485f55cd-b7b5-45c6-b203-7a3b54a157b2 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:02.167132 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-596fe7d3-26a9-4cb8-9936-78fea2c625ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:46:02.172958 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:46:02.181424 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485f55cd-b7b5-45c6-b203-7a3b54a157b2 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:02.186792 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c3f3a7-53d8-46fb-866c-60271ce0b182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:02.187418 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c3f3a7-53d8-46fb-866c-60271ce0b182 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:02.187732 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c3f3a7-53d8-46fb-866c-60271ce0b182 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:02.188008 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c3f3a7-53d8-46fb-866c-60271ce0b182 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:02.188739 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c3f3a7-53d8-46fb-866c-60271ce0b182 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:02.190755 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c3f3a7-53d8-46fb-866c-60271ce0b182 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:02.228856 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1140/2282] 10.222.0.70 () {60 vars in 1153 bytes} [Tue Aug 2 21:46:02 2022] POST /identity/v3/projects => generated 405 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:46:02.230081 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c3f3a7-53d8-46fb-866c-60271ce0b182 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:02.254881 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596fe7d3-26a9-4cb8-9936-78fea2c625ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:02.256497 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596fe7d3-26a9-4cb8-9936-78fea2c625ff service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:02.272432 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1143/2283] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:46:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 21:46:02.315678 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c3f3a7-53d8-46fb-866c-60271ce0b182 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:02.321142 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6b92ac-7cd2-4dad-a067-8515ef3ffd1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:02.321779 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6b92ac-7cd2-4dad-a067-8515ef3ffd1a admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:02.322067 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6b92ac-7cd2-4dad-a067-8515ef3ffd1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:02.322349 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6b92ac-7cd2-4dad-a067-8515ef3ffd1a admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:02.323024 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6b92ac-7cd2-4dad-a067-8515ef3ffd1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:02.325037 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6b92ac-7cd2-4dad-a067-8515ef3ffd1a admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:02.351060 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1141/2284] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 2 21:46:02 2022] POST /identity/v3/users => generated 309 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:46:02.352605 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596fe7d3-26a9-4cb8-9936-78fea2c625ff service neutron] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:02.364405 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596fe7d3-26a9-4cb8-9936-78fea2c625ff service neutron] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:02.371441 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b1e482-fed5-43f8-b38e-12e67eb0b3a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:02.371623 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b1e482-fed5-43f8-b38e-12e67eb0b3a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:02.372069 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b1e482-fed5-43f8-b38e-12e67eb0b3a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:02.372575 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b1e482-fed5-43f8-b38e-12e67eb0b3a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:02.373619 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b1e482-fed5-43f8-b38e-12e67eb0b3a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:02.375936 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b1e482-fed5-43f8-b38e-12e67eb0b3a8 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:02.389735 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1144/2285] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:46:02 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:46:02.393719 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6b92ac-7cd2-4dad-a067-8515ef3ffd1a admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:02.409331 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6b92ac-7cd2-4dad-a067-8515ef3ffd1a admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:02.414837 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538396ef-6558-40f9-905c-aa6b8cfe5532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:02.415519 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538396ef-6558-40f9-905c-aa6b8cfe5532 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:02.415804 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538396ef-6558-40f9-905c-aa6b8cfe5532 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:02.416083 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538396ef-6558-40f9-905c-aa6b8cfe5532 admin admin] PATH_INFO: `/v3/projects/824b108476ed4588a5d73a56764900f7/users/ef2717d45cd647dca7db631c1bd22707/roles/3e32dbf75f9b41f5adb9fe59851267bb` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:02.432930 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538396ef-6558-40f9-905c-aa6b8cfe5532 admin admin] RBAC: Authorizing `identity:create_grant(project_id=824b108476ed4588a5d73a56764900f7, user_id=ef2717d45cd647dca7db631c1bd22707, role_id=3e32dbf75f9b41f5adb9fe59851267bb)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:02.435669 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538396ef-6558-40f9-905c-aa6b8cfe5532 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:02.449175 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1142/2286] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:46:02 2022] PUT /identity/v3/projects/824b108476ed4588a5d73a56764900f7/users/ef2717d45cd647dca7db631c1bd22707/roles/3e32dbf75f9b41f5adb9fe59851267bb => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:46:02.453121 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b1e482-fed5-43f8-b38e-12e67eb0b3a8 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:02.465604 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b1e482-fed5-43f8-b38e-12e67eb0b3a8 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:02.489585 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:46:02.531643 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2bee0f-3396-4840-a437-c561efff3425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:02.532293 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2bee0f-3396-4840-a437-c561efff3425 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:02.532582 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2bee0f-3396-4840-a437-c561efff3425 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:02.532862 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2bee0f-3396-4840-a437-c561efff3425 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:02.533558 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2bee0f-3396-4840-a437-c561efff3425 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:02.535308 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2bee0f-3396-4840-a437-c561efff3425 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:02.548333 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1145/2287] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:46:02 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 21:46:02.549455 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538396ef-6558-40f9-905c-aa6b8cfe5532 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:02.560777 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538396ef-6558-40f9-905c-aa6b8cfe5532 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:02.568506 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9cb240-6ecd-4999-b1eb-62c19e2205cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:02.569193 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9cb240-6ecd-4999-b1eb-62c19e2205cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:02.569477 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9cb240-6ecd-4999-b1eb-62c19e2205cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:02.569754 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9cb240-6ecd-4999-b1eb-62c19e2205cd admin admin] PATH_INFO: `/v3/projects/824b108476ed4588a5d73a56764900f7/users/ef2717d45cd647dca7db631c1bd22707/roles/3e32dbf75f9b41f5adb9fe59851267bb` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:02.571723 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9cb240-6ecd-4999-b1eb-62c19e2205cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=824b108476ed4588a5d73a56764900f7, user_id=ef2717d45cd647dca7db631c1bd22707, role_id=3e32dbf75f9b41f5adb9fe59851267bb)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:02.574391 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9cb240-6ecd-4999-b1eb-62c19e2205cd admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:02.587818 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1143/2288] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:46:02 2022] PUT /identity/v3/projects/824b108476ed4588a5d73a56764900f7/users/ef2717d45cd647dca7db631c1bd22707/roles/3e32dbf75f9b41f5adb9fe59851267bb => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:46:03.253631 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac6368-4156-46bf-a7ea-c8f4576b96d0 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:03.254150 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac6368-4156-46bf-a7ea-c8f4576b96d0 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:03.254254 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ac6368-4156-46bf-a7ea-c8f4576b96d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:03.285579 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-10ac6368-4156-46bf-a7ea-c8f4576b96d0 None None] MFA Rules not processed for user `ef2717d45cd647dca7db631c1bd22707`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:46:03.286984 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-10ac6368-4156-46bf-a7ea-c8f4576b96d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:46:03.366276 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1146/2289] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:46:03 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:46:04.738830 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9cb240-6ecd-4999-b1eb-62c19e2205cd admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:04.804568 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9cb240-6ecd-4999-b1eb-62c19e2205cd admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:04.810167 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dcf4a8-363a-41bd-9dab-340645daa521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:04.811164 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dcf4a8-363a-41bd-9dab-340645daa521 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:04.811456 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dcf4a8-363a-41bd-9dab-340645daa521 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:04.811763 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dcf4a8-363a-41bd-9dab-340645daa521 admin admin] PATH_INFO: `/v3/users/8148e6939e884f339cd35d5866fd0382` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:04.812984 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dcf4a8-363a-41bd-9dab-340645daa521 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8148e6939e884f339cd35d5866fd0382)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:04.816604 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dcf4a8-363a-41bd-9dab-340645daa521 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:04.864149 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=89,keystone:INSERT=6,keystone:DELETE=5 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:46:04.875019 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-d5dcf4a8-363a-41bd-9dab-340645daa521 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8148e6939e884f339cd35d5866fd0382'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:04.884784 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-d5dcf4a8-363a-41bd-9dab-340645daa521 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8148e6939e884f339cd35d5866fd0382'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:04.897987 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-d5dcf4a8-363a-41bd-9dab-340645daa521 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8148e6939e884f339cd35d5866fd0382'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:04.898681 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-d5dcf4a8-363a-41bd-9dab-340645daa521 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8148e6939e884f339cd35d5866fd0382'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:04.905969 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-d5dcf4a8-363a-41bd-9dab-340645daa521 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8148e6939e884f339cd35d5866fd0382'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:04.917525 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1144/2290] 10.222.0.70 () {58 vars in 1224 bytes} [Tue Aug 2 21:46:04 2022] DELETE /identity/v3/users/8148e6939e884f339cd35d5866fd0382 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:46:05.307466 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ac6368-4156-46bf-a7ea-c8f4576b96d0 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:05.321368 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ac6368-4156-46bf-a7ea-c8f4576b96d0 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:05.397595 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cb1e32-5ed0-4538-a08c-998878feef87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:05.398388 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cb1e32-5ed0-4538-a08c-998878feef87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:05.398659 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cb1e32-5ed0-4538-a08c-998878feef87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:05.399014 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cb1e32-5ed0-4538-a08c-998878feef87 admin admin] PATH_INFO: `/v3/projects/fd8957eba26f41b19a14995e8a45f953` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:05.400279 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cb1e32-5ed0-4538-a08c-998878feef87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd8957eba26f41b19a14995e8a45f953)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:05.402363 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cb1e32-5ed0-4538-a08c-998878feef87 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:05.460265 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:46:05.464704 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-33cb1e32-5ed0-4538-a08c-998878feef87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd8957eba26f41b19a14995e8a45f953', 'request_id': 'req-33cb1e32-5ed0-4538-a08c-998878feef87'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:05.473715 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-33cb1e32-5ed0-4538-a08c-998878feef87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd8957eba26f41b19a14995e8a45f953', 'request_id': 'req-33cb1e32-5ed0-4538-a08c-998878feef87'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:05.484657 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-33cb1e32-5ed0-4538-a08c-998878feef87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd8957eba26f41b19a14995e8a45f953', 'request_id': 'req-33cb1e32-5ed0-4538-a08c-998878feef87'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:05.504177 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-33cb1e32-5ed0-4538-a08c-998878feef87 admin admin] The token cache is being invalidate because project fd8957eba26f41b19a14995e8a45f953 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:46:05.504653 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-33cb1e32-5ed0-4538-a08c-998878feef87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:05.505392 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-33cb1e32-5ed0-4538-a08c-998878feef87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:05.510479 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1147/2291] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Aug 2 21:46:05 2022] DELETE /identity/v3/projects/fd8957eba26f41b19a14995e8a45f953 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:46:05.511692 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dcf4a8-363a-41bd-9dab-340645daa521 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:05.513563 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-d5dcf4a8-363a-41bd-9dab-340645daa521 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:46:05.530784 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dcf4a8-363a-41bd-9dab-340645daa521 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:05.595495 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f00d9cd-b44c-430d-8f26-251fe28e5644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:05.596186 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f00d9cd-b44c-430d-8f26-251fe28e5644 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:05.596504 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f00d9cd-b44c-430d-8f26-251fe28e5644 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:05.596783 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f00d9cd-b44c-430d-8f26-251fe28e5644 admin admin] PATH_INFO: `/v3/users/ef2717d45cd647dca7db631c1bd22707` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:05.598522 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f00d9cd-b44c-430d-8f26-251fe28e5644 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef2717d45cd647dca7db631c1bd22707)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:05.600546 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f00d9cd-b44c-430d-8f26-251fe28e5644 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:05.656263 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-2f00d9cd-b44c-430d-8f26-251fe28e5644 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef2717d45cd647dca7db631c1bd22707'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:05.665035 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-2f00d9cd-b44c-430d-8f26-251fe28e5644 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef2717d45cd647dca7db631c1bd22707'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:05.678296 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-2f00d9cd-b44c-430d-8f26-251fe28e5644 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef2717d45cd647dca7db631c1bd22707'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:05.679129 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-2f00d9cd-b44c-430d-8f26-251fe28e5644 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef2717d45cd647dca7db631c1bd22707'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:05.685987 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-2f00d9cd-b44c-430d-8f26-251fe28e5644 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef2717d45cd647dca7db631c1bd22707'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:05.692664 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1145/2292] 10.222.0.70 () {58 vars in 1224 bytes} [Tue Aug 2 21:46:05 2022] DELETE /identity/v3/users/ef2717d45cd647dca7db631c1bd22707 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:46:05.870222 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cb1e32-5ed0-4538-a08c-998878feef87 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:05.877793 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-33cb1e32-5ed0-4538-a08c-998878feef87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:46:05.897751 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cb1e32-5ed0-4538-a08c-998878feef87 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:05.964274 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fffd610-c4eb-4405-9629-00619c6ab49f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:05.964957 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fffd610-c4eb-4405-9629-00619c6ab49f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:05.965245 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fffd610-c4eb-4405-9629-00619c6ab49f admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:05.965527 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fffd610-c4eb-4405-9629-00619c6ab49f admin admin] PATH_INFO: `/v3/projects/824b108476ed4588a5d73a56764900f7` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:05.966712 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fffd610-c4eb-4405-9629-00619c6ab49f admin admin] RBAC: Authorizing `identity:delete_project(project_id=824b108476ed4588a5d73a56764900f7)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:05.968729 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fffd610-c4eb-4405-9629-00619c6ab49f admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:06.019033 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-4fffd610-c4eb-4405-9629-00619c6ab49f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '824b108476ed4588a5d73a56764900f7', 'request_id': 'req-4fffd610-c4eb-4405-9629-00619c6ab49f'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:06.024902 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-4fffd610-c4eb-4405-9629-00619c6ab49f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '824b108476ed4588a5d73a56764900f7', 'request_id': 'req-4fffd610-c4eb-4405-9629-00619c6ab49f'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:06.034382 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-4fffd610-c4eb-4405-9629-00619c6ab49f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '824b108476ed4588a5d73a56764900f7', 'request_id': 'req-4fffd610-c4eb-4405-9629-00619c6ab49f'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:06.046774 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-4fffd610-c4eb-4405-9629-00619c6ab49f admin admin] The token cache is being invalidate because project 824b108476ed4588a5d73a56764900f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:46:06.047067 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-4fffd610-c4eb-4405-9629-00619c6ab49f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:06.047711 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-4fffd610-c4eb-4405-9629-00619c6ab49f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:06.049385 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1148/2293] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Aug 2 21:46:05 2022] DELETE /identity/v3/projects/824b108476ed4588a5d73a56764900f7 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:46:06.055354 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc1beac-a0b7-4cce-ab0c-5d42b9317bcb None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:06.055816 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc1beac-a0b7-4cce-ab0c-5d42b9317bcb None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:06.055940 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc1beac-a0b7-4cce-ab0c-5d42b9317bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:06.075534 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-8dc1beac-a0b7-4cce-ab0c-5d42b9317bcb None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:46:06.076785 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-8dc1beac-a0b7-4cce-ab0c-5d42b9317bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:46:06.102739 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:46:06.139518 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1146/2294] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:46:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:46:06.147160 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394c18b9-5f21-4a46-a577-9fc5f38dcbae None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:06.147517 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394c18b9-5f21-4a46-a577-9fc5f38dcbae None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:06.147865 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394c18b9-5f21-4a46-a577-9fc5f38dcbae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:06.169286 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-394c18b9-5f21-4a46-a577-9fc5f38dcbae None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:46:06.170501 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-394c18b9-5f21-4a46-a577-9fc5f38dcbae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:46:06.179174 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1149/2295] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:46:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:46:06.183366 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc1beac-a0b7-4cce-ab0c-5d42b9317bcb None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:06.193104 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc1beac-a0b7-4cce-ab0c-5d42b9317bcb None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:06.197656 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440fe25d-1053-4ce4-a970-1cd604f78605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:06.198263 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440fe25d-1053-4ce4-a970-1cd604f78605 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:06.198546 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440fe25d-1053-4ce4-a970-1cd604f78605 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:06.198821 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440fe25d-1053-4ce4-a970-1cd604f78605 admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:06.199516 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440fe25d-1053-4ce4-a970-1cd604f78605 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:46:06.199827 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440fe25d-1053-4ce4-a970-1cd604f78605 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:06.201462 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440fe25d-1053-4ce4-a970-1cd604f78605 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:06.218402 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1147/2296] 10.222.0.70 () {58 vars in 1153 bytes} [Tue Aug 2 21:46:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:46:06.219529 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394c18b9-5f21-4a46-a577-9fc5f38dcbae None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:06.230723 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394c18b9-5f21-4a46-a577-9fc5f38dcbae None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:06.235802 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a37902-daf1-40c2-bca2-fa243fc5be0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:06.236454 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a37902-daf1-40c2-bca2-fa243fc5be0b admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:06.236739 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a37902-daf1-40c2-bca2-fa243fc5be0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:06.237014 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a37902-daf1-40c2-bca2-fa243fc5be0b admin admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:06.237723 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a37902-daf1-40c2-bca2-fa243fc5be0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:06.240314 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a37902-daf1-40c2-bca2-fa243fc5be0b admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:06.274777 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1150/2297] 10.222.0.70 () {60 vars in 1153 bytes} [Tue Aug 2 21:46:06 2022] POST /identity/v3/projects => generated 381 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:46:06.276523 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440fe25d-1053-4ce4-a970-1cd604f78605 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:06.292975 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440fe25d-1053-4ce4-a970-1cd604f78605 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:06.376811 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef0b2cd-2d5e-46d4-b84a-24913b34730c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:06.377437 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef0b2cd-2d5e-46d4-b84a-24913b34730c admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:06.377718 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef0b2cd-2d5e-46d4-b84a-24913b34730c admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:06.377995 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef0b2cd-2d5e-46d4-b84a-24913b34730c admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:06.378696 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef0b2cd-2d5e-46d4-b84a-24913b34730c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:06.380654 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef0b2cd-2d5e-46d4-b84a-24913b34730c admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:06.403029 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1148/2298] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 2 21:46:06 2022] POST /identity/v3/users => generated 291 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 21:46:06.407021 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a37902-daf1-40c2-bca2-fa243fc5be0b admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:06.418227 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a37902-daf1-40c2-bca2-fa243fc5be0b admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:06.423102 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0748f7a4-ceef-40d1-bf79-cecc1c6c31ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:06.423781 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0748f7a4-ceef-40d1-bf79-cecc1c6c31ea admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:06.424140 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0748f7a4-ceef-40d1-bf79-cecc1c6c31ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:06.424523 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0748f7a4-ceef-40d1-bf79-cecc1c6c31ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:06.425300 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0748f7a4-ceef-40d1-bf79-cecc1c6c31ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:06.426961 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0748f7a4-ceef-40d1-bf79-cecc1c6c31ea admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:06.437550 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1151/2299] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:46:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:46:06.441670 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef0b2cd-2d5e-46d4-b84a-24913b34730c admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:06.452007 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef0b2cd-2d5e-46d4-b84a-24913b34730c admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:06.457470 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36774334-0bbe-4254-8446-63b54aa34ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:06.458098 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36774334-0bbe-4254-8446-63b54aa34ba2 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:06.458368 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36774334-0bbe-4254-8446-63b54aa34ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:06.458763 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36774334-0bbe-4254-8446-63b54aa34ba2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:06.459468 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36774334-0bbe-4254-8446-63b54aa34ba2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:06.461137 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36774334-0bbe-4254-8446-63b54aa34ba2 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:06.472912 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1149/2300] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:46:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:46:06.477183 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0748f7a4-ceef-40d1-bf79-cecc1c6c31ea admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:06.487546 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0748f7a4-ceef-40d1-bf79-cecc1c6c31ea admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:06.492382 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dd2c94-f0fa-464c-a74b-de1d87ac080f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:06.493127 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dd2c94-f0fa-464c-a74b-de1d87ac080f admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:06.493663 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dd2c94-f0fa-464c-a74b-de1d87ac080f admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:06.493943 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dd2c94-f0fa-464c-a74b-de1d87ac080f admin admin] PATH_INFO: `/v3/projects/8abaab4ce582491bbdbb297e9ccb8794/users/86fd84f7a19d4eb58dd87bddf8305680/roles/462e3381a85c42a9959201f9aa122f7c` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:06.508776 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dd2c94-f0fa-464c-a74b-de1d87ac080f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8abaab4ce582491bbdbb297e9ccb8794, user_id=86fd84f7a19d4eb58dd87bddf8305680, role_id=462e3381a85c42a9959201f9aa122f7c)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:06.511523 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dd2c94-f0fa-464c-a74b-de1d87ac080f admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:06.521517 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:46:06.526791 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1152/2301] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:46:06 2022] PUT /identity/v3/projects/8abaab4ce582491bbdbb297e9ccb8794/users/86fd84f7a19d4eb58dd87bddf8305680/roles/462e3381a85c42a9959201f9aa122f7c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:46:06.536765 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c3f1c7-ebbc-4930-890c-879c2b92ae2d None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:06.537146 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c3f1c7-ebbc-4930-890c-879c2b92ae2d None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:06.537426 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c3f1c7-ebbc-4930-890c-879c2b92ae2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:06.566683 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-12c3f1c7-ebbc-4930-890c-879c2b92ae2d None None] MFA Rules not processed for user `86fd84f7a19d4eb58dd87bddf8305680`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:46:06.567899 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-12c3f1c7-ebbc-4930-890c-879c2b92ae2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:46:06.649010 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1150/2302] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:46:06 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:46:06.653025 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dd2c94-f0fa-464c-a74b-de1d87ac080f admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:06.752694 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dd2c94-f0fa-464c-a74b-de1d87ac080f admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:06.758607 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fa7db1-dfdf-47e6-b4ed-439c7dbe4d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:06.759543 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fa7db1-dfdf-47e6-b4ed-439c7dbe4d5f admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:06.760051 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fa7db1-dfdf-47e6-b4ed-439c7dbe4d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:06.760464 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fa7db1-dfdf-47e6-b4ed-439c7dbe4d5f admin admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:06.761255 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fa7db1-dfdf-47e6-b4ed-439c7dbe4d5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:06.763724 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fa7db1-dfdf-47e6-b4ed-439c7dbe4d5f admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:06.807446 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1153/2303] 10.222.0.70 () {60 vars in 1153 bytes} [Tue Aug 2 21:46:06 2022] POST /identity/v3/projects => generated 381 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 21:46:06.808276 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c3f1c7-ebbc-4930-890c-879c2b92ae2d None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:06.823621 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c3f1c7-ebbc-4930-890c-879c2b92ae2d None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:06.852936 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:46:06.891708 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743bc5e2-8896-4fae-a351-1a67bb009076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:06.892469 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743bc5e2-8896-4fae-a351-1a67bb009076 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:06.892862 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743bc5e2-8896-4fae-a351-1a67bb009076 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:06.893236 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743bc5e2-8896-4fae-a351-1a67bb009076 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:06.894097 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743bc5e2-8896-4fae-a351-1a67bb009076 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:06.896657 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743bc5e2-8896-4fae-a351-1a67bb009076 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:06.918023 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1151/2304] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 2 21:46:06 2022] POST /identity/v3/users => generated 297 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:46:06.921999 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fa7db1-dfdf-47e6-b4ed-439c7dbe4d5f admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:06.932385 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fa7db1-dfdf-47e6-b4ed-439c7dbe4d5f admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:06.937064 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a2e94e-5300-4e91-b59b-c4c26ba70f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:06.937679 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a2e94e-5300-4e91-b59b-c4c26ba70f38 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:06.937966 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a2e94e-5300-4e91-b59b-c4c26ba70f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:06.938243 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a2e94e-5300-4e91-b59b-c4c26ba70f38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:06.938935 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a2e94e-5300-4e91-b59b-c4c26ba70f38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:06.940616 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a2e94e-5300-4e91-b59b-c4c26ba70f38 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:06.952285 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1154/2305] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:46:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:46:06.958631 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743bc5e2-8896-4fae-a351-1a67bb009076 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:06.969104 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743bc5e2-8896-4fae-a351-1a67bb009076 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:06.976741 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff3f61b-9e36-4748-ba5d-dd4b3087899d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:06.977490 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff3f61b-9e36-4748-ba5d-dd4b3087899d admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:06.977833 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff3f61b-9e36-4748-ba5d-dd4b3087899d admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:06.978171 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff3f61b-9e36-4748-ba5d-dd4b3087899d admin admin] PATH_INFO: `/v3/projects/d5b37b30f35042b0aa5c7a8ae7e50378/users/141775c5cc954882bec8cbf179847e9a/roles/3e32dbf75f9b41f5adb9fe59851267bb` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:06.994028 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff3f61b-9e36-4748-ba5d-dd4b3087899d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5b37b30f35042b0aa5c7a8ae7e50378, user_id=141775c5cc954882bec8cbf179847e9a, role_id=3e32dbf75f9b41f5adb9fe59851267bb)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:06.996777 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff3f61b-9e36-4748-ba5d-dd4b3087899d admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:07.010762 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1152/2306] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:46:06 2022] PUT /identity/v3/projects/d5b37b30f35042b0aa5c7a8ae7e50378/users/141775c5cc954882bec8cbf179847e9a/roles/3e32dbf75f9b41f5adb9fe59851267bb => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:46:07.014816 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a2e94e-5300-4e91-b59b-c4c26ba70f38 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:07.025572 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a2e94e-5300-4e91-b59b-c4c26ba70f38 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:07.091772 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f766d9e6-579d-429e-b943-60751f2d9d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:07.092516 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f766d9e6-579d-429e-b943-60751f2d9d02 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:07.092865 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f766d9e6-579d-429e-b943-60751f2d9d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:07.093202 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f766d9e6-579d-429e-b943-60751f2d9d02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:07.093971 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f766d9e6-579d-429e-b943-60751f2d9d02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:07.096954 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f766d9e6-579d-429e-b943-60751f2d9d02 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:07.109097 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1155/2307] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:46:07 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:46:07.113904 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff3f61b-9e36-4748-ba5d-dd4b3087899d admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:07.126056 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff3f61b-9e36-4748-ba5d-dd4b3087899d admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:07.131818 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1665d3a2-cb75-40d2-877e-0e185c03aa9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:07.132533 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1665d3a2-cb75-40d2-877e-0e185c03aa9f admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:07.132819 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1665d3a2-cb75-40d2-877e-0e185c03aa9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:07.133096 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1665d3a2-cb75-40d2-877e-0e185c03aa9f admin admin] PATH_INFO: `/v3/projects/d5b37b30f35042b0aa5c7a8ae7e50378/users/141775c5cc954882bec8cbf179847e9a/roles/3e32dbf75f9b41f5adb9fe59851267bb` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:07.135129 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1665d3a2-cb75-40d2-877e-0e185c03aa9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5b37b30f35042b0aa5c7a8ae7e50378, user_id=141775c5cc954882bec8cbf179847e9a, role_id=3e32dbf75f9b41f5adb9fe59851267bb)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:07.137961 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1665d3a2-cb75-40d2-877e-0e185c03aa9f admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:07.149749 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1153/2308] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:46:07 2022] PUT /identity/v3/projects/d5b37b30f35042b0aa5c7a8ae7e50378/users/141775c5cc954882bec8cbf179847e9a/roles/3e32dbf75f9b41f5adb9fe59851267bb => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:46:07.160889 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9831544-8239-48c5-a420-4a987d26affa None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:07.161182 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9831544-8239-48c5-a420-4a987d26affa None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:07.161465 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9831544-8239-48c5-a420-4a987d26affa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:07.191661 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-e9831544-8239-48c5-a420-4a987d26affa None None] MFA Rules not processed for user `141775c5cc954882bec8cbf179847e9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:46:07.192907 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-e9831544-8239-48c5-a420-4a987d26affa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:46:07.260982 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:46:07.273450 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1156/2309] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:46:07 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:46:07.286466 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1665d3a2-cb75-40d2-877e-0e185c03aa9f admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:07.288538 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-1665d3a2-cb75-40d2-877e-0e185c03aa9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:46:07.360142 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1665d3a2-cb75-40d2-877e-0e185c03aa9f admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:07.363958 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b904436-48ad-414b-b4ee-96f4f1d77915 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '123eb76f95ee4e39905944da701c712d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:07.364715 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b904436-48ad-414b-b4ee-96f4f1d77915 service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:07.365067 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b904436-48ad-414b-b4ee-96f4f1d77915 service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:07.365405 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b904436-48ad-414b-b4ee-96f4f1d77915 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:07.375262 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b904436-48ad-414b-b4ee-96f4f1d77915 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:07.376773 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b904436-48ad-414b-b4ee-96f4f1d77915 service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:07.387814 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1154/2310] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:46:07 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 21:46:07.473460 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9831544-8239-48c5-a420-4a987d26affa None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:07.483774 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9831544-8239-48c5-a420-4a987d26affa None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:07.487569 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6f074c-3814-4f15-9ab0-9c9136a40b43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '123eb76f95ee4e39905944da701c712d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:07.488395 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6f074c-3814-4f15-9ab0-9c9136a40b43 service cinder] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:07.488665 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6f074c-3814-4f15-9ab0-9c9136a40b43 service cinder] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:07.488950 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6f074c-3814-4f15-9ab0-9c9136a40b43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:07.548430 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6f074c-3814-4f15-9ab0-9c9136a40b43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:07.549897 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6f074c-3814-4f15-9ab0-9c9136a40b43 service cinder] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:07.558733 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1157/2311] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:46:07 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:46:14.335647 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b904436-48ad-414b-b4ee-96f4f1d77915 service cinder] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:14.398455 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b904436-48ad-414b-b4ee-96f4f1d77915 service cinder] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:14.403021 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e64eda-9582-478b-8828-bac3bced58b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:14.403656 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e64eda-9582-478b-8828-bac3bced58b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:14.403948 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e64eda-9582-478b-8828-bac3bced58b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:14.404225 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e64eda-9582-478b-8828-bac3bced58b7 admin admin] PATH_INFO: `/v3/users/86fd84f7a19d4eb58dd87bddf8305680` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:14.405423 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e64eda-9582-478b-8828-bac3bced58b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86fd84f7a19d4eb58dd87bddf8305680)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:14.407363 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e64eda-9582-478b-8828-bac3bced58b7 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:14.431597 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=91,keystone:INSERT=5,keystone:DELETE=4 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:46:14.456171 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-66e64eda-9582-478b-8828-bac3bced58b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86fd84f7a19d4eb58dd87bddf8305680'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:14.463960 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-66e64eda-9582-478b-8828-bac3bced58b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86fd84f7a19d4eb58dd87bddf8305680'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:14.476752 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-66e64eda-9582-478b-8828-bac3bced58b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86fd84f7a19d4eb58dd87bddf8305680'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:14.477427 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-66e64eda-9582-478b-8828-bac3bced58b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86fd84f7a19d4eb58dd87bddf8305680'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:14.484462 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-66e64eda-9582-478b-8828-bac3bced58b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86fd84f7a19d4eb58dd87bddf8305680'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:14.490855 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1155/2312] 10.222.0.70 () {58 vars in 1224 bytes} [Tue Aug 2 21:46:14 2022] DELETE /identity/v3/users/86fd84f7a19d4eb58dd87bddf8305680 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:46:14.495423 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5791a3-acbd-482d-826b-7e273daa1b64 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:14.495880 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5791a3-acbd-482d-826b-7e273daa1b64 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:14.495998 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5791a3-acbd-482d-826b-7e273daa1b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:14.516135 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-cc5791a3-acbd-482d-826b-7e273daa1b64 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:46:14.517486 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-cc5791a3-acbd-482d-826b-7e273daa1b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:46:14.577981 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1158/2313] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:46:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:46:14.587761 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e64eda-9582-478b-8828-bac3bced58b7 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:14.589189 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-66e64eda-9582-478b-8828-bac3bced58b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:46:14.646853 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e64eda-9582-478b-8828-bac3bced58b7 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:14.650516 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f644b0dd-242b-4e05-a747-5a93b1aa6acd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '723f5f43572a493dae0349070a2adb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:14.651134 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f644b0dd-242b-4e05-a747-5a93b1aa6acd service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:14.651418 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f644b0dd-242b-4e05-a747-5a93b1aa6acd service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:14.651696 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f644b0dd-242b-4e05-a747-5a93b1aa6acd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:14.661335 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f644b0dd-242b-4e05-a747-5a93b1aa6acd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:14.662770 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f644b0dd-242b-4e05-a747-5a93b1aa6acd service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:14.672157 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1156/2314] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:46:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:46:14.938362 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5791a3-acbd-482d-826b-7e273daa1b64 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:14.939724 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-cc5791a3-acbd-482d-826b-7e273daa1b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:46:14.954128 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5791a3-acbd-482d-826b-7e273daa1b64 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:14.958793 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0a2833-0b68-432f-8c21-fc1e7335da5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:14.959447 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0a2833-0b68-432f-8c21-fc1e7335da5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:14.959732 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0a2833-0b68-432f-8c21-fc1e7335da5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:14.960161 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0a2833-0b68-432f-8c21-fc1e7335da5d admin admin] PATH_INFO: `/v3/projects/8abaab4ce582491bbdbb297e9ccb8794` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:14.961392 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0a2833-0b68-432f-8c21-fc1e7335da5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8abaab4ce582491bbdbb297e9ccb8794)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:14.963344 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0a2833-0b68-432f-8c21-fc1e7335da5d admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:15.020976 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-ea0a2833-0b68-432f-8c21-fc1e7335da5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8abaab4ce582491bbdbb297e9ccb8794', 'request_id': 'req-ea0a2833-0b68-432f-8c21-fc1e7335da5d'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:15.035334 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-ea0a2833-0b68-432f-8c21-fc1e7335da5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8abaab4ce582491bbdbb297e9ccb8794', 'request_id': 'req-ea0a2833-0b68-432f-8c21-fc1e7335da5d'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:15.044258 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-ea0a2833-0b68-432f-8c21-fc1e7335da5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8abaab4ce582491bbdbb297e9ccb8794', 'request_id': 'req-ea0a2833-0b68-432f-8c21-fc1e7335da5d'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:15.063064 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-ea0a2833-0b68-432f-8c21-fc1e7335da5d admin admin] The token cache is being invalidate because project 8abaab4ce582491bbdbb297e9ccb8794 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:46:15.063462 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-ea0a2833-0b68-432f-8c21-fc1e7335da5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:15.064049 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-ea0a2833-0b68-432f-8c21-fc1e7335da5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:15.065942 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1159/2315] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Aug 2 21:46:14 2022] DELETE /identity/v3/projects/8abaab4ce582491bbdbb297e9ccb8794 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:46:15.069725 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f644b0dd-242b-4e05-a747-5a93b1aa6acd service neutron] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:15.080021 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f644b0dd-242b-4e05-a747-5a93b1aa6acd service neutron] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:15.141447 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e015948f-375a-4b88-ad50-cd12534535ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:15.142015 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e015948f-375a-4b88-ad50-cd12534535ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:15.142297 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e015948f-375a-4b88-ad50-cd12534535ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:15.142577 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e015948f-375a-4b88-ad50-cd12534535ab admin admin] PATH_INFO: `/v3/users/141775c5cc954882bec8cbf179847e9a` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:15.143746 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e015948f-375a-4b88-ad50-cd12534535ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=141775c5cc954882bec8cbf179847e9a)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:15.145729 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e015948f-375a-4b88-ad50-cd12534535ab admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:15.191768 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-e015948f-375a-4b88-ad50-cd12534535ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '141775c5cc954882bec8cbf179847e9a'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:15.193386 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:46:15.199793 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-e015948f-375a-4b88-ad50-cd12534535ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '141775c5cc954882bec8cbf179847e9a'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:15.213865 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-e015948f-375a-4b88-ad50-cd12534535ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '141775c5cc954882bec8cbf179847e9a'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:15.214579 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-e015948f-375a-4b88-ad50-cd12534535ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '141775c5cc954882bec8cbf179847e9a'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:15.221802 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-e015948f-375a-4b88-ad50-cd12534535ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '141775c5cc954882bec8cbf179847e9a'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:15.228528 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1157/2316] 10.222.0.70 () {58 vars in 1224 bytes} [Tue Aug 2 21:46:15 2022] DELETE /identity/v3/users/141775c5cc954882bec8cbf179847e9a => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:46:15.501371 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0a2833-0b68-432f-8c21-fc1e7335da5d admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:15.502908 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-ea0a2833-0b68-432f-8c21-fc1e7335da5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:46:15.516059 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0a2833-0b68-432f-8c21-fc1e7335da5d admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:15.531082 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:46:15.577640 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd10577-075e-4bf3-8c8c-b9c7b9615433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:15.578283 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd10577-075e-4bf3-8c8c-b9c7b9615433 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:15.578567 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd10577-075e-4bf3-8c8c-b9c7b9615433 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:15.578844 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd10577-075e-4bf3-8c8c-b9c7b9615433 admin admin] PATH_INFO: `/v3/projects/d5b37b30f35042b0aa5c7a8ae7e50378` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:15.579990 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd10577-075e-4bf3-8c8c-b9c7b9615433 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5b37b30f35042b0aa5c7a8ae7e50378)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:15.582462 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd10577-075e-4bf3-8c8c-b9c7b9615433 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:15.628008 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-0fd10577-075e-4bf3-8c8c-b9c7b9615433 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5b37b30f35042b0aa5c7a8ae7e50378', 'request_id': 'req-0fd10577-075e-4bf3-8c8c-b9c7b9615433'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:15.633494 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-0fd10577-075e-4bf3-8c8c-b9c7b9615433 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5b37b30f35042b0aa5c7a8ae7e50378', 'request_id': 'req-0fd10577-075e-4bf3-8c8c-b9c7b9615433'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:15.640787 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-0fd10577-075e-4bf3-8c8c-b9c7b9615433 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5b37b30f35042b0aa5c7a8ae7e50378', 'request_id': 'req-0fd10577-075e-4bf3-8c8c-b9c7b9615433'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:15.653054 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-0fd10577-075e-4bf3-8c8c-b9c7b9615433 admin admin] The token cache is being invalidate because project d5b37b30f35042b0aa5c7a8ae7e50378 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:46:15.653345 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-0fd10577-075e-4bf3-8c8c-b9c7b9615433 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:15.653984 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-0fd10577-075e-4bf3-8c8c-b9c7b9615433 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:15.655490 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1160/2317] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Aug 2 21:46:15 2022] DELETE /identity/v3/projects/d5b37b30f35042b0aa5c7a8ae7e50378 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:46:15.661079 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef3f444-bee5-4de9-b3cb-f418dfeaa542 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:15.661557 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef3f444-bee5-4de9-b3cb-f418dfeaa542 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:15.661653 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef3f444-bee5-4de9-b3cb-f418dfeaa542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:15.680951 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-8ef3f444-bee5-4de9-b3cb-f418dfeaa542 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:46:15.682164 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-8ef3f444-bee5-4de9-b3cb-f418dfeaa542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:46:15.740843 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1158/2318] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:46:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:46:15.748848 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1679ca09-a9fc-4e89-93a4-12c8af214212 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:15.749145 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1679ca09-a9fc-4e89-93a4-12c8af214212 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:15.749429 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1679ca09-a9fc-4e89-93a4-12c8af214212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:15.770165 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-1679ca09-a9fc-4e89-93a4-12c8af214212 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:46:15.771374 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-1679ca09-a9fc-4e89-93a4-12c8af214212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:46:15.779279 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1161/2319] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:46:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:46:15.783521 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef3f444-bee5-4de9-b3cb-f418dfeaa542 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:15.793721 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef3f444-bee5-4de9-b3cb-f418dfeaa542 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:15.798449 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f97678d-1e4d-47a7-9ade-258e551cea7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:15.799060 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f97678d-1e4d-47a7-9ade-258e551cea7f admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:15.799344 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f97678d-1e4d-47a7-9ade-258e551cea7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:15.799623 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f97678d-1e4d-47a7-9ade-258e551cea7f admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:15.800362 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f97678d-1e4d-47a7-9ade-258e551cea7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:46:15.800673 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f97678d-1e4d-47a7-9ade-258e551cea7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:15.802288 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f97678d-1e4d-47a7-9ade-258e551cea7f admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:15.813842 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1159/2320] 10.222.0.70 () {58 vars in 1153 bytes} [Tue Aug 2 21:46:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:46:15.818625 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1679ca09-a9fc-4e89-93a4-12c8af214212 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:15.827957 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1679ca09-a9fc-4e89-93a4-12c8af214212 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:15.833213 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b089d540-3965-4e12-9717-936566d5c0a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:15.833820 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b089d540-3965-4e12-9717-936566d5c0a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:15.834104 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b089d540-3965-4e12-9717-936566d5c0a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:15.834379 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b089d540-3965-4e12-9717-936566d5c0a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:15.835054 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b089d540-3965-4e12-9717-936566d5c0a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:15.837003 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b089d540-3965-4e12-9717-936566d5c0a9 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:15.863946 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1162/2321] 10.222.0.70 () {60 vars in 1153 bytes} [Tue Aug 2 21:46:15 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 21:46:15.868155 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f97678d-1e4d-47a7-9ade-258e551cea7f admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:15.888021 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f97678d-1e4d-47a7-9ade-258e551cea7f admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:15.944492 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc4551b-e730-4dea-90be-78e189cb57a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:15.945116 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc4551b-e730-4dea-90be-78e189cb57a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:15.945402 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc4551b-e730-4dea-90be-78e189cb57a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:15.945681 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc4551b-e730-4dea-90be-78e189cb57a4 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:15.946377 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc4551b-e730-4dea-90be-78e189cb57a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:15.948349 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc4551b-e730-4dea-90be-78e189cb57a4 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:15.969447 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1160/2322] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 2 21:46:15 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 21:46:15.973739 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b089d540-3965-4e12-9717-936566d5c0a9 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:15.984222 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b089d540-3965-4e12-9717-936566d5c0a9 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:15.989001 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482f2c9b-9406-45e3-b288-e7c979884959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:15.989638 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482f2c9b-9406-45e3-b288-e7c979884959 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:15.989920 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482f2c9b-9406-45e3-b288-e7c979884959 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:15.990194 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482f2c9b-9406-45e3-b288-e7c979884959 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:15.990928 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482f2c9b-9406-45e3-b288-e7c979884959 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:15.992516 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482f2c9b-9406-45e3-b288-e7c979884959 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:16.002315 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1163/2323] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:46:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:46:16.006644 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc4551b-e730-4dea-90be-78e189cb57a4 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:16.016410 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc4551b-e730-4dea-90be-78e189cb57a4 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:16.021610 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f40c31-846b-45f8-a4aa-ff66397d12c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:16.022203 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f40c31-846b-45f8-a4aa-ff66397d12c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:16.022486 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f40c31-846b-45f8-a4aa-ff66397d12c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:16.022766 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f40c31-846b-45f8-a4aa-ff66397d12c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:16.023450 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f40c31-846b-45f8-a4aa-ff66397d12c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:16.025207 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f40c31-846b-45f8-a4aa-ff66397d12c6 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:16.035931 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1161/2324] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:46:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:46:16.040205 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482f2c9b-9406-45e3-b288-e7c979884959 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:16.050196 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482f2c9b-9406-45e3-b288-e7c979884959 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:16.054765 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c58cf0-8444-4f1f-8b87-0510abd294e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:16.055419 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c58cf0-8444-4f1f-8b87-0510abd294e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:16.055708 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c58cf0-8444-4f1f-8b87-0510abd294e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:16.055991 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c58cf0-8444-4f1f-8b87-0510abd294e7 admin admin] PATH_INFO: `/v3/projects/11e802d8ebc6405b854f773548ec44d0/users/6fe92846a12f41c88c09f023337a6e91/roles/462e3381a85c42a9959201f9aa122f7c` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:16.071373 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c58cf0-8444-4f1f-8b87-0510abd294e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11e802d8ebc6405b854f773548ec44d0, user_id=6fe92846a12f41c88c09f023337a6e91, role_id=462e3381a85c42a9959201f9aa122f7c)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:16.074134 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c58cf0-8444-4f1f-8b87-0510abd294e7 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:16.087735 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1164/2325] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:46:16 2022] PUT /identity/v3/projects/11e802d8ebc6405b854f773548ec44d0/users/6fe92846a12f41c88c09f023337a6e91/roles/462e3381a85c42a9959201f9aa122f7c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:46:16.099002 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef3f2cf-978b-4a96-83ef-85faa4eb2b14 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:16.099292 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef3f2cf-978b-4a96-83ef-85faa4eb2b14 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:16.099571 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef3f2cf-978b-4a96-83ef-85faa4eb2b14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:16.127200 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-aef3f2cf-978b-4a96-83ef-85faa4eb2b14 None None] MFA Rules not processed for user `6fe92846a12f41c88c09f023337a6e91`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:46:16.129022 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-aef3f2cf-978b-4a96-83ef-85faa4eb2b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:46:16.145085 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:46:16.196834 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1162/2326] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:46:16 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:46:16.201393 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c58cf0-8444-4f1f-8b87-0510abd294e7 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:16.252541 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:46:16.275834 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c58cf0-8444-4f1f-8b87-0510abd294e7 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:16.280913 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1078a15-7fe9-48fb-841f-9451dc85e3f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:16.281946 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1078a15-7fe9-48fb-841f-9451dc85e3f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:16.282256 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1078a15-7fe9-48fb-841f-9451dc85e3f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:16.282534 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1078a15-7fe9-48fb-841f-9451dc85e3f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:16.283270 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1078a15-7fe9-48fb-841f-9451dc85e3f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:16.285307 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1078a15-7fe9-48fb-841f-9451dc85e3f0 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:16.324740 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1165/2327] 10.222.0.70 () {60 vars in 1153 bytes} [Tue Aug 2 21:46:16 2022] POST /identity/v3/projects => generated 387 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:46:16.329067 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef3f2cf-978b-4a96-83ef-85faa4eb2b14 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:16.343764 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef3f2cf-978b-4a96-83ef-85faa4eb2b14 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:16.417232 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487ef387-c9b0-423e-a2ce-03f5542d8d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:16.417864 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487ef387-c9b0-423e-a2ce-03f5542d8d5a admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:16.418162 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487ef387-c9b0-423e-a2ce-03f5542d8d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:16.418409 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487ef387-c9b0-423e-a2ce-03f5542d8d5a admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:16.419107 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487ef387-c9b0-423e-a2ce-03f5542d8d5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:16.421215 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487ef387-c9b0-423e-a2ce-03f5542d8d5a admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:16.443949 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1163/2328] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 2 21:46:16 2022] POST /identity/v3/users => generated 294 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 21:46:16.448414 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1078a15-7fe9-48fb-841f-9451dc85e3f0 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:16.461814 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1078a15-7fe9-48fb-841f-9451dc85e3f0 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:16.466833 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18434cfe-10cb-4417-9870-4e3591c1fb11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:16.467507 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18434cfe-10cb-4417-9870-4e3591c1fb11 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:16.467818 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18434cfe-10cb-4417-9870-4e3591c1fb11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:16.468072 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18434cfe-10cb-4417-9870-4e3591c1fb11 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:16.468810 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18434cfe-10cb-4417-9870-4e3591c1fb11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:16.470426 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18434cfe-10cb-4417-9870-4e3591c1fb11 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:16.482640 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1166/2329] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:46:16 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:46:16.486858 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487ef387-c9b0-423e-a2ce-03f5542d8d5a admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:16.498996 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487ef387-c9b0-423e-a2ce-03f5542d8d5a admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:16.504453 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e4146b-d924-4f62-af66-295145b8d1f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:16.505104 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e4146b-d924-4f62-af66-295145b8d1f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:16.505444 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e4146b-d924-4f62-af66-295145b8d1f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:16.505759 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e4146b-d924-4f62-af66-295145b8d1f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:16.507265 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e4146b-d924-4f62-af66-295145b8d1f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:16.509241 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e4146b-d924-4f62-af66-295145b8d1f9 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:16.521035 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1164/2330] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:46:16 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 21:46:16.525126 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18434cfe-10cb-4417-9870-4e3591c1fb11 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:16.535793 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18434cfe-10cb-4417-9870-4e3591c1fb11 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:16.540590 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9630da-86e2-43af-9dbf-5b2e87038f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:16.541319 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9630da-86e2-43af-9dbf-5b2e87038f5d admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:16.541676 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9630da-86e2-43af-9dbf-5b2e87038f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:16.542047 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9630da-86e2-43af-9dbf-5b2e87038f5d admin admin] PATH_INFO: `/v3/projects/05f9c41071d1489dbd303e61ebdc3588/users/829a1129a7d04bb183261140f8f20517/roles/462e3381a85c42a9959201f9aa122f7c` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:16.557556 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9630da-86e2-43af-9dbf-5b2e87038f5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=05f9c41071d1489dbd303e61ebdc3588, user_id=829a1129a7d04bb183261140f8f20517, role_id=462e3381a85c42a9959201f9aa122f7c)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:16.560867 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9630da-86e2-43af-9dbf-5b2e87038f5d admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:16.574974 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1167/2331] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:46:16 2022] PUT /identity/v3/projects/05f9c41071d1489dbd303e61ebdc3588/users/829a1129a7d04bb183261140f8f20517/roles/462e3381a85c42a9959201f9aa122f7c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:46:16.585252 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8d2cec-dbad-4320-9cf2-9614072b4307 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:16.585625 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8d2cec-dbad-4320-9cf2-9614072b4307 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:16.585978 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8d2cec-dbad-4320-9cf2-9614072b4307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:16.617059 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-2a8d2cec-dbad-4320-9cf2-9614072b4307 None None] MFA Rules not processed for user `829a1129a7d04bb183261140f8f20517`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:46:16.618300 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-2a8d2cec-dbad-4320-9cf2-9614072b4307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:46:16.700037 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1165/2332] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:46:16 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:46:16.704483 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9630da-86e2-43af-9dbf-5b2e87038f5d admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:16.759756 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d5a39c-1c51-450e-bcf0-375d38f46cc7 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:16.760099 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d5a39c-1c51-450e-bcf0-375d38f46cc7 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:16.760403 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d5a39c-1c51-450e-bcf0-375d38f46cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:16.780708 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9630da-86e2-43af-9dbf-5b2e87038f5d admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:16.785240 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-88d5a39c-1c51-450e-bcf0-375d38f46cc7 None None] MFA Rules not processed for user `6be7b2bcfebd45389ca289c34fbabc3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:46:16.786421 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0297029e-24c0-49a8-b1a2-1c8bce6f330a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:16.786570 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-88d5a39c-1c51-450e-bcf0-375d38f46cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:46:16.787046 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0297029e-24c0-49a8-b1a2-1c8bce6f330a admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:16.787330 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0297029e-24c0-49a8-b1a2-1c8bce6f330a admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:16.787765 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0297029e-24c0-49a8-b1a2-1c8bce6f330a admin admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:16.788475 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0297029e-24c0-49a8-b1a2-1c8bce6f330a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:16.790512 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0297029e-24c0-49a8-b1a2-1c8bce6f330a admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:16.808931 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:46:16.825068 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1168/2333] 10.222.0.70 () {60 vars in 1153 bytes} [Tue Aug 2 21:46:16 2022] POST /identity/v3/projects => generated 387 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:46:16.827507 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0297029e-24c0-49a8-b1a2-1c8bce6f330a admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:16.847950 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1166/2334] 10.222.0.70 () {58 vars in 1009 bytes} [Tue Aug 2 21:46:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:46:16.890993 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d5a39c-1c51-450e-bcf0-375d38f46cc7 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:16.892520 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-88d5a39c-1c51-450e-bcf0-375d38f46cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:46:16.894481 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0297029e-24c0-49a8-b1a2-1c8bce6f330a admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:16.899750 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58e886a-ad56-4eab-be55-b06aaf7fcdf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:16.900411 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e886a-ad56-4eab-be55-b06aaf7fcdf5 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:16.900696 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e886a-ad56-4eab-be55-b06aaf7fcdf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:16.900971 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e886a-ad56-4eab-be55-b06aaf7fcdf5 admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:16.901628 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58e886a-ad56-4eab-be55-b06aaf7fcdf5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:16.903612 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58e886a-ad56-4eab-be55-b06aaf7fcdf5 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:16.927535 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1169/2335] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 2 21:46:16 2022] POST /identity/v3/users => generated 300 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 21:46:16.931426 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58e886a-ad56-4eab-be55-b06aaf7fcdf5 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:16.941255 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58e886a-ad56-4eab-be55-b06aaf7fcdf5 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:16.949346 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca5a585-bb89-4f2a-8e0e-8d4df1ba9986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:16.949346 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca5a585-bb89-4f2a-8e0e-8d4df1ba9986 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:16.949673 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca5a585-bb89-4f2a-8e0e-8d4df1ba9986 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:16.949917 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca5a585-bb89-4f2a-8e0e-8d4df1ba9986 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:16.950612 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca5a585-bb89-4f2a-8e0e-8d4df1ba9986 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:16.952282 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca5a585-bb89-4f2a-8e0e-8d4df1ba9986 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:16.954551 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:46:16.967292 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1170/2336] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:46:16 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 21:46:16.969432 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca5a585-bb89-4f2a-8e0e-8d4df1ba9986 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:16.975310 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d5a39c-1c51-450e-bcf0-375d38f46cc7 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:16.979793 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca5a585-bb89-4f2a-8e0e-8d4df1ba9986 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:16.984422 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf9e856-4673-4b9e-8a62-82cc245e7299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:16.985062 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf9e856-4673-4b9e-8a62-82cc245e7299 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:16.985337 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf9e856-4673-4b9e-8a62-82cc245e7299 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:16.985608 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf9e856-4673-4b9e-8a62-82cc245e7299 admin admin] PATH_INFO: `/v3/projects/82eb8a3c706c4c9ebfaeeed9df7636aa/users/4ca2530fe0ce47abbe70d52a6fbeb5fd/roles/3e32dbf75f9b41f5adb9fe59851267bb` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:17.001424 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf9e856-4673-4b9e-8a62-82cc245e7299 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82eb8a3c706c4c9ebfaeeed9df7636aa, user_id=4ca2530fe0ce47abbe70d52a6fbeb5fd, role_id=3e32dbf75f9b41f5adb9fe59851267bb)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:17.004373 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf9e856-4673-4b9e-8a62-82cc245e7299 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:17.017133 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1171/2337] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:46:16 2022] PUT /identity/v3/projects/82eb8a3c706c4c9ebfaeeed9df7636aa/users/4ca2530fe0ce47abbe70d52a6fbeb5fd/roles/3e32dbf75f9b41f5adb9fe59851267bb => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:46:17.021700 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf9e856-4673-4b9e-8a62-82cc245e7299 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:17.038325 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c2e2a9-8149-4812-828c-d872a3945639 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee7ebf40212465aac997b461a2d10fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:17.038958 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c2e2a9-8149-4812-828c-d872a3945639 service swift] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:17.039244 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c2e2a9-8149-4812-828c-d872a3945639 service swift] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:17.039547 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c2e2a9-8149-4812-828c-d872a3945639 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:17.084415 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf9e856-4673-4b9e-8a62-82cc245e7299 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:17.089102 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ac2e05-52ce-4a8d-bc01-4a99770e66d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:17.089720 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ac2e05-52ce-4a8d-bc01-4a99770e66d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:17.090003 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ac2e05-52ce-4a8d-bc01-4a99770e66d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:17.090276 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ac2e05-52ce-4a8d-bc01-4a99770e66d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:17.090995 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ac2e05-52ce-4a8d-bc01-4a99770e66d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:17.092646 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ac2e05-52ce-4a8d-bc01-4a99770e66d7 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:17.097747 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c2e2a9-8149-4812-828c-d872a3945639 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:17.099350 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c2e2a9-8149-4812-828c-d872a3945639 service swift] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:17.102928 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1172/2338] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:46:17 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 21:46:17.107467 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ac2e05-52ce-4a8d-bc01-4a99770e66d7 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:17.108585 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1167/2339] 10.222.0.70 () {60 vars in 1384 bytes} [Tue Aug 2 21:46:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 02 21:46:17.117424 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ac2e05-52ce-4a8d-bc01-4a99770e66d7 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:17.122254 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69621861-46fa-4771-b046-e290571ac198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:17.122871 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69621861-46fa-4771-b046-e290571ac198 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:17.123068 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69621861-46fa-4771-b046-e290571ac198 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:17.123335 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69621861-46fa-4771-b046-e290571ac198 admin admin] PATH_INFO: `/v3/projects/82eb8a3c706c4c9ebfaeeed9df7636aa/users/4ca2530fe0ce47abbe70d52a6fbeb5fd/roles/3e32dbf75f9b41f5adb9fe59851267bb` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:17.125391 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69621861-46fa-4771-b046-e290571ac198 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82eb8a3c706c4c9ebfaeeed9df7636aa, user_id=4ca2530fe0ce47abbe70d52a6fbeb5fd, role_id=3e32dbf75f9b41f5adb9fe59851267bb)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:17.128048 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69621861-46fa-4771-b046-e290571ac198 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:17.150144 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1173/2340] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:46:17 2022] PUT /identity/v3/projects/82eb8a3c706c4c9ebfaeeed9df7636aa/users/4ca2530fe0ce47abbe70d52a6fbeb5fd/roles/3e32dbf75f9b41f5adb9fe59851267bb => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:46:17.160622 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab639943-fc2a-4e54-91e2-3e94b2c0f877 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:17.161461 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab639943-fc2a-4e54-91e2-3e94b2c0f877 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:17.161725 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab639943-fc2a-4e54-91e2-3e94b2c0f877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:17.191949 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-ab639943-fc2a-4e54-91e2-3e94b2c0f877 None None] MFA Rules not processed for user `4ca2530fe0ce47abbe70d52a6fbeb5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:46:17.193234 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-ab639943-fc2a-4e54-91e2-3e94b2c0f877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:46:17.197582 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:46:17.294424 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1168/2341] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:46:17 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:46:17.311718 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69621861-46fa-4771-b046-e290571ac198 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:17.313613 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-69621861-46fa-4771-b046-e290571ac198 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:46:17.387562 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69621861-46fa-4771-b046-e290571ac198 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:17.392288 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525863cf-36a9-465f-b59d-738715de0c7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '123eb76f95ee4e39905944da701c712d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:17.393087 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525863cf-36a9-465f-b59d-738715de0c7e service cinder] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:17.393479 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525863cf-36a9-465f-b59d-738715de0c7e service cinder] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:17.393897 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525863cf-36a9-465f-b59d-738715de0c7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:17.410628 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525863cf-36a9-465f-b59d-738715de0c7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:17.412262 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525863cf-36a9-465f-b59d-738715de0c7e service cinder] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:17.426759 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1174/2342] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:46:17 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 21:46:18.066628 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab639943-fc2a-4e54-91e2-3e94b2c0f877 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:18.068086 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-ab639943-fc2a-4e54-91e2-3e94b2c0f877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:46:18.084856 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab639943-fc2a-4e54-91e2-3e94b2c0f877 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:18.088524 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2ed19c-c132-4f67-a6e0-d0f09c0f649f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '123eb76f95ee4e39905944da701c712d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:18.089151 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2ed19c-c132-4f67-a6e0-d0f09c0f649f service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:18.089432 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2ed19c-c132-4f67-a6e0-d0f09c0f649f service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:18.089737 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2ed19c-c132-4f67-a6e0-d0f09c0f649f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:18.161043 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2ed19c-c132-4f67-a6e0-d0f09c0f649f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:18.163037 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2ed19c-c132-4f67-a6e0-d0f09c0f649f service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:18.173470 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1169/2343] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:46:18 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:46:18.599254 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525863cf-36a9-465f-b59d-738715de0c7e service cinder] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:18.601641 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-525863cf-36a9-465f-b59d-738715de0c7e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:46:18.711934 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:46:18.733836 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525863cf-36a9-465f-b59d-738715de0c7e service cinder] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:18.741263 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a521fee9-243a-4537-90f8-f7b90fdde74a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87dd5c1c5e854d4b96e0b7dad6aa3719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:18.742548 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a521fee9-243a-4537-90f8-f7b90fdde74a service nova] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:18.742942 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a521fee9-243a-4537-90f8-f7b90fdde74a service nova] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:18.743438 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a521fee9-243a-4537-90f8-f7b90fdde74a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:18.745393 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-a521fee9-243a-4537-90f8-f7b90fdde74a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:46:18.815522 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a521fee9-243a-4537-90f8-f7b90fdde74a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:18.819670 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a521fee9-243a-4537-90f8-f7b90fdde74a service nova] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:18.829927 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1175/2344] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:46:18 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:46:22.563536 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2ed19c-c132-4f67-a6e0-d0f09c0f649f service cinder] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:22.575112 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2ed19c-c132-4f67-a6e0-d0f09c0f649f service cinder] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:22.579393 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a078b5-d8de-4291-b132-1f0bd7643e3f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '123eb76f95ee4e39905944da701c712d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:22.580097 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a078b5-d8de-4291-b132-1f0bd7643e3f service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:22.580534 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a078b5-d8de-4291-b132-1f0bd7643e3f service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:22.580887 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a078b5-d8de-4291-b132-1f0bd7643e3f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:22.657480 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a078b5-d8de-4291-b132-1f0bd7643e3f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:22.659309 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a078b5-d8de-4291-b132-1f0bd7643e3f service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:22.673717 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1170/2345] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:46:22 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 21:46:25.198329 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a521fee9-243a-4537-90f8-f7b90fdde74a service nova] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:25.356619 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a521fee9-243a-4537-90f8-f7b90fdde74a service nova] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:25.361494 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9963c859-ca92-4b9f-810b-1181416e4989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:25.362777 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9963c859-ca92-4b9f-810b-1181416e4989 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:25.363174 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9963c859-ca92-4b9f-810b-1181416e4989 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:25.363548 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9963c859-ca92-4b9f-810b-1181416e4989 admin admin] PATH_INFO: `/v3/users/6fe92846a12f41c88c09f023337a6e91` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:25.364991 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9963c859-ca92-4b9f-810b-1181416e4989 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6fe92846a12f41c88c09f023337a6e91)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:25.367259 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9963c859-ca92-4b9f-810b-1181416e4989 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:25.466966 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-9963c859-ca92-4b9f-810b-1181416e4989 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6fe92846a12f41c88c09f023337a6e91'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:25.479155 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-9963c859-ca92-4b9f-810b-1181416e4989 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6fe92846a12f41c88c09f023337a6e91'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:25.496087 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-9963c859-ca92-4b9f-810b-1181416e4989 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6fe92846a12f41c88c09f023337a6e91'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:25.507302 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-9963c859-ca92-4b9f-810b-1181416e4989 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6fe92846a12f41c88c09f023337a6e91'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:25.507994 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-9963c859-ca92-4b9f-810b-1181416e4989 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6fe92846a12f41c88c09f023337a6e91'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:25.518428 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1176/2346] 10.222.0.70 () {58 vars in 1224 bytes} [Tue Aug 2 21:46:25 2022] DELETE /identity/v3/users/6fe92846a12f41c88c09f023337a6e91 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:46:25.520498 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011225bd-2bd9-4d19-9bc1-49d64e92922b None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:25.521305 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011225bd-2bd9-4d19-9bc1-49d64e92922b None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:25.521582 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011225bd-2bd9-4d19-9bc1-49d64e92922b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:25.563796 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-011225bd-2bd9-4d19-9bc1-49d64e92922b None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:46:25.564677 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-011225bd-2bd9-4d19-9bc1-49d64e92922b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:46:25.734991 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:46:25.822138 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1171/2347] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:46:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:46:25.823885 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9963c859-ca92-4b9f-810b-1181416e4989 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:25.825457 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-9963c859-ca92-4b9f-810b-1181416e4989 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:46:25.872903 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:46:25.976921 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9963c859-ca92-4b9f-810b-1181416e4989 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:25.982731 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301f3ba8-06b3-4463-a978-b34fe525c81d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '723f5f43572a493dae0349070a2adb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:25.982731 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301f3ba8-06b3-4463-a978-b34fe525c81d service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:25.982731 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301f3ba8-06b3-4463-a978-b34fe525c81d service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:25.983120 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301f3ba8-06b3-4463-a978-b34fe525c81d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:25.995509 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301f3ba8-06b3-4463-a978-b34fe525c81d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:25.996975 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301f3ba8-06b3-4463-a978-b34fe525c81d service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:26.021668 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1177/2348] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:46:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:46:26.474044 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011225bd-2bd9-4d19-9bc1-49d64e92922b None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:26.475860 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-011225bd-2bd9-4d19-9bc1-49d64e92922b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:46:26.497223 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011225bd-2bd9-4d19-9bc1-49d64e92922b None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:26.509674 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f604bd4e-7a33-4ff3-9f51-b78816da3bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:26.510497 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f604bd4e-7a33-4ff3-9f51-b78816da3bfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:26.511287 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f604bd4e-7a33-4ff3-9f51-b78816da3bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:26.511575 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f604bd4e-7a33-4ff3-9f51-b78816da3bfa admin admin] PATH_INFO: `/v3/projects/11e802d8ebc6405b854f773548ec44d0` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:26.517202 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f604bd4e-7a33-4ff3-9f51-b78816da3bfa admin admin] RBAC: Authorizing `identity:delete_project(project_id=11e802d8ebc6405b854f773548ec44d0)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:26.519250 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f604bd4e-7a33-4ff3-9f51-b78816da3bfa admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:26.636007 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-f604bd4e-7a33-4ff3-9f51-b78816da3bfa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11e802d8ebc6405b854f773548ec44d0', 'request_id': 'req-f604bd4e-7a33-4ff3-9f51-b78816da3bfa'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:26.656325 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-f604bd4e-7a33-4ff3-9f51-b78816da3bfa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11e802d8ebc6405b854f773548ec44d0', 'request_id': 'req-f604bd4e-7a33-4ff3-9f51-b78816da3bfa'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:26.663903 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-f604bd4e-7a33-4ff3-9f51-b78816da3bfa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11e802d8ebc6405b854f773548ec44d0', 'request_id': 'req-f604bd4e-7a33-4ff3-9f51-b78816da3bfa'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:26.677867 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-f604bd4e-7a33-4ff3-9f51-b78816da3bfa admin admin] The token cache is being invalidate because project 11e802d8ebc6405b854f773548ec44d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:46:26.678507 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-f604bd4e-7a33-4ff3-9f51-b78816da3bfa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:26.679331 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-f604bd4e-7a33-4ff3-9f51-b78816da3bfa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:26.681489 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1172/2349] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Aug 2 21:46:26 2022] DELETE /identity/v3/projects/11e802d8ebc6405b854f773548ec44d0 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:46:26.685457 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301f3ba8-06b3-4463-a978-b34fe525c81d service neutron] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:26.714602 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301f3ba8-06b3-4463-a978-b34fe525c81d service neutron] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:26.832830 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b60baf-6062-4b3b-b8d6-dd2a0a2f4977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:26.833802 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b60baf-6062-4b3b-b8d6-dd2a0a2f4977 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:26.834088 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b60baf-6062-4b3b-b8d6-dd2a0a2f4977 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:26.834394 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b60baf-6062-4b3b-b8d6-dd2a0a2f4977 admin admin] PATH_INFO: `/v3/users/829a1129a7d04bb183261140f8f20517` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:26.836429 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b60baf-6062-4b3b-b8d6-dd2a0a2f4977 admin admin] RBAC: Authorizing `identity:delete_user(user_id=829a1129a7d04bb183261140f8f20517)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:26.838483 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b60baf-6062-4b3b-b8d6-dd2a0a2f4977 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:26.935378 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-56b60baf-6062-4b3b-b8d6-dd2a0a2f4977 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '829a1129a7d04bb183261140f8f20517'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:26.943855 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-56b60baf-6062-4b3b-b8d6-dd2a0a2f4977 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '829a1129a7d04bb183261140f8f20517'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:26.962347 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-56b60baf-6062-4b3b-b8d6-dd2a0a2f4977 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '829a1129a7d04bb183261140f8f20517'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:26.970437 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-56b60baf-6062-4b3b-b8d6-dd2a0a2f4977 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '829a1129a7d04bb183261140f8f20517'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:26.973459 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-56b60baf-6062-4b3b-b8d6-dd2a0a2f4977 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '829a1129a7d04bb183261140f8f20517'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:26.978718 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1178/2350] 10.222.0.70 () {58 vars in 1224 bytes} [Tue Aug 2 21:46:26 2022] DELETE /identity/v3/users/829a1129a7d04bb183261140f8f20517 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:46:27.298182 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f604bd4e-7a33-4ff3-9f51-b78816da3bfa admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:27.299606 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-f604bd4e-7a33-4ff3-9f51-b78816da3bfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:46:27.314246 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f604bd4e-7a33-4ff3-9f51-b78816da3bfa admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:27.373634 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bd945d-0916-449a-9015-fcfbb5ede969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:27.374285 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd945d-0916-449a-9015-fcfbb5ede969 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:27.374571 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd945d-0916-449a-9015-fcfbb5ede969 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:27.374852 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bd945d-0916-449a-9015-fcfbb5ede969 admin admin] PATH_INFO: `/v3/projects/05f9c41071d1489dbd303e61ebdc3588` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:27.376008 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bd945d-0916-449a-9015-fcfbb5ede969 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05f9c41071d1489dbd303e61ebdc3588)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:27.378048 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bd945d-0916-449a-9015-fcfbb5ede969 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:27.427317 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-34bd945d-0916-449a-9015-fcfbb5ede969 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05f9c41071d1489dbd303e61ebdc3588', 'request_id': 'req-34bd945d-0916-449a-9015-fcfbb5ede969'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:27.436157 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-34bd945d-0916-449a-9015-fcfbb5ede969 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05f9c41071d1489dbd303e61ebdc3588', 'request_id': 'req-34bd945d-0916-449a-9015-fcfbb5ede969'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:27.442622 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:46:27.443874 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-34bd945d-0916-449a-9015-fcfbb5ede969 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05f9c41071d1489dbd303e61ebdc3588', 'request_id': 'req-34bd945d-0916-449a-9015-fcfbb5ede969'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:27.456566 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-34bd945d-0916-449a-9015-fcfbb5ede969 admin admin] The token cache is being invalidate because project 05f9c41071d1489dbd303e61ebdc3588 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:46:27.456876 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-34bd945d-0916-449a-9015-fcfbb5ede969 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:27.457506 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-34bd945d-0916-449a-9015-fcfbb5ede969 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:27.459068 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1173/2351] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Aug 2 21:46:27 2022] DELETE /identity/v3/projects/05f9c41071d1489dbd303e61ebdc3588 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:46:27.463065 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b60baf-6062-4b3b-b8d6-dd2a0a2f4977 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:27.464541 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-56b60baf-6062-4b3b-b8d6-dd2a0a2f4977 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:46:27.478818 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b60baf-6062-4b3b-b8d6-dd2a0a2f4977 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:27.513023 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:46:27.537137 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea4d99c-7c20-4abc-878b-96bb47e1fa07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:27.537777 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea4d99c-7c20-4abc-878b-96bb47e1fa07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:27.538056 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea4d99c-7c20-4abc-878b-96bb47e1fa07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:27.538356 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea4d99c-7c20-4abc-878b-96bb47e1fa07 admin admin] PATH_INFO: `/v3/users/4ca2530fe0ce47abbe70d52a6fbeb5fd` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:27.539519 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea4d99c-7c20-4abc-878b-96bb47e1fa07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ca2530fe0ce47abbe70d52a6fbeb5fd)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:27.541481 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea4d99c-7c20-4abc-878b-96bb47e1fa07 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:27.588678 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-3ea4d99c-7c20-4abc-878b-96bb47e1fa07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ca2530fe0ce47abbe70d52a6fbeb5fd'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:27.596017 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-3ea4d99c-7c20-4abc-878b-96bb47e1fa07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ca2530fe0ce47abbe70d52a6fbeb5fd'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:27.609289 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-3ea4d99c-7c20-4abc-878b-96bb47e1fa07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ca2530fe0ce47abbe70d52a6fbeb5fd'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:27.617718 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-3ea4d99c-7c20-4abc-878b-96bb47e1fa07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ca2530fe0ce47abbe70d52a6fbeb5fd'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:27.618577 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-3ea4d99c-7c20-4abc-878b-96bb47e1fa07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ca2530fe0ce47abbe70d52a6fbeb5fd'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:27.625551 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1179/2352] 10.222.0.70 () {58 vars in 1224 bytes} [Tue Aug 2 21:46:27 2022] DELETE /identity/v3/users/4ca2530fe0ce47abbe70d52a6fbeb5fd => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:46:27.957438 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bd945d-0916-449a-9015-fcfbb5ede969 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:27.960531 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-34bd945d-0916-449a-9015-fcfbb5ede969 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:46:27.978845 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bd945d-0916-449a-9015-fcfbb5ede969 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:28.047801 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b2207a-3969-46d1-9e84-c528cca6c404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:28.048490 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b2207a-3969-46d1-9e84-c528cca6c404 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:28.048806 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b2207a-3969-46d1-9e84-c528cca6c404 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:28.049079 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b2207a-3969-46d1-9e84-c528cca6c404 admin admin] PATH_INFO: `/v3/projects/82eb8a3c706c4c9ebfaeeed9df7636aa` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:28.050518 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b2207a-3969-46d1-9e84-c528cca6c404 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82eb8a3c706c4c9ebfaeeed9df7636aa)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:28.052446 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b2207a-3969-46d1-9e84-c528cca6c404 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:28.102806 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-73b2207a-3969-46d1-9e84-c528cca6c404 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82eb8a3c706c4c9ebfaeeed9df7636aa', 'request_id': 'req-73b2207a-3969-46d1-9e84-c528cca6c404'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:28.111021 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-73b2207a-3969-46d1-9e84-c528cca6c404 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82eb8a3c706c4c9ebfaeeed9df7636aa', 'request_id': 'req-73b2207a-3969-46d1-9e84-c528cca6c404'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:28.117985 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-73b2207a-3969-46d1-9e84-c528cca6c404 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82eb8a3c706c4c9ebfaeeed9df7636aa', 'request_id': 'req-73b2207a-3969-46d1-9e84-c528cca6c404'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:28.131154 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-73b2207a-3969-46d1-9e84-c528cca6c404 admin admin] The token cache is being invalidate because project 82eb8a3c706c4c9ebfaeeed9df7636aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:46:28.131503 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-73b2207a-3969-46d1-9e84-c528cca6c404 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:28.132516 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-73b2207a-3969-46d1-9e84-c528cca6c404 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:28.134461 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1174/2353] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Aug 2 21:46:27 2022] DELETE /identity/v3/projects/82eb8a3c706c4c9ebfaeeed9df7636aa => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:46:28.140508 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6b9159-12c6-4949-893d-ea5dd0356e07 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:28.141033 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6b9159-12c6-4949-893d-ea5dd0356e07 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:28.141130 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6b9159-12c6-4949-893d-ea5dd0356e07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:28.160377 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-5c6b9159-12c6-4949-893d-ea5dd0356e07 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:46:28.161627 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-5c6b9159-12c6-4949-893d-ea5dd0356e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:46:28.221273 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1180/2354] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:46:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:46:28.230018 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8050cf7-3abf-418c-aa5a-42636549a336 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:28.230314 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8050cf7-3abf-418c-aa5a-42636549a336 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:28.230595 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8050cf7-3abf-418c-aa5a-42636549a336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:28.251281 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-f8050cf7-3abf-418c-aa5a-42636549a336 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:46:28.252478 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-f8050cf7-3abf-418c-aa5a-42636549a336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:46:28.261717 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1175/2355] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:46:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:46:28.266074 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6b9159-12c6-4949-893d-ea5dd0356e07 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:28.276251 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6b9159-12c6-4949-893d-ea5dd0356e07 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:28.281714 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5ad413-b332-4d79-96fc-dc2cd5069fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:28.286905 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ad413-b332-4d79-96fc-dc2cd5069fc6 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:28.286905 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ad413-b332-4d79-96fc-dc2cd5069fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:28.286905 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ad413-b332-4d79-96fc-dc2cd5069fc6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:28.286905 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5ad413-b332-4d79-96fc-dc2cd5069fc6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:46:28.286905 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5ad413-b332-4d79-96fc-dc2cd5069fc6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:28.286905 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5ad413-b332-4d79-96fc-dc2cd5069fc6 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:28.305876 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1181/2356] 10.222.0.70 () {58 vars in 1153 bytes} [Tue Aug 2 21:46:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:46:28.306820 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8050cf7-3abf-418c-aa5a-42636549a336 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:28.316790 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8050cf7-3abf-418c-aa5a-42636549a336 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:28.322204 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcaf1dc-3fb9-4cc9-8711-a62d61065f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:28.324309 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcaf1dc-3fb9-4cc9-8711-a62d61065f13 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:28.324309 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcaf1dc-3fb9-4cc9-8711-a62d61065f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:28.324309 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcaf1dc-3fb9-4cc9-8711-a62d61065f13 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:28.324309 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcaf1dc-3fb9-4cc9-8711-a62d61065f13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:28.326055 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcaf1dc-3fb9-4cc9-8711-a62d61065f13 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:28.356965 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1176/2357] 10.222.0.70 () {60 vars in 1153 bytes} [Tue Aug 2 21:46:28 2022] POST /identity/v3/projects => generated 377 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:46:28.361212 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5ad413-b332-4d79-96fc-dc2cd5069fc6 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:28.372037 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5ad413-b332-4d79-96fc-dc2cd5069fc6 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:28.417892 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:46:28.436425 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efc3edd-b9ee-4955-a4be-c67a6ccb3a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:28.437054 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efc3edd-b9ee-4955-a4be-c67a6ccb3a32 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:28.437343 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efc3edd-b9ee-4955-a4be-c67a6ccb3a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:28.437622 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efc3edd-b9ee-4955-a4be-c67a6ccb3a32 admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:28.438333 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efc3edd-b9ee-4955-a4be-c67a6ccb3a32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:28.440271 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efc3edd-b9ee-4955-a4be-c67a6ccb3a32 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:28.465247 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1182/2358] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 2 21:46:28 2022] POST /identity/v3/users => generated 289 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:46:28.469700 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcaf1dc-3fb9-4cc9-8711-a62d61065f13 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:28.480762 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcaf1dc-3fb9-4cc9-8711-a62d61065f13 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:28.486190 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678cfc05-5ea8-41fa-b996-fc5a56f993a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:28.486813 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678cfc05-5ea8-41fa-b996-fc5a56f993a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:28.487100 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678cfc05-5ea8-41fa-b996-fc5a56f993a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:28.487921 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678cfc05-5ea8-41fa-b996-fc5a56f993a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:28.488657 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678cfc05-5ea8-41fa-b996-fc5a56f993a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:28.490256 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678cfc05-5ea8-41fa-b996-fc5a56f993a0 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:28.504284 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1177/2359] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:46:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:46:28.505739 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efc3edd-b9ee-4955-a4be-c67a6ccb3a32 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:28.516248 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efc3edd-b9ee-4955-a4be-c67a6ccb3a32 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:28.521138 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c8d25c-d707-48f1-bf3a-23007fc477d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:28.521748 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c8d25c-d707-48f1-bf3a-23007fc477d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:28.522033 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c8d25c-d707-48f1-bf3a-23007fc477d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:28.522305 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c8d25c-d707-48f1-bf3a-23007fc477d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:28.522993 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c8d25c-d707-48f1-bf3a-23007fc477d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:28.524637 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c8d25c-d707-48f1-bf3a-23007fc477d7 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:28.536730 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1183/2360] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:46:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:46:28.540778 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678cfc05-5ea8-41fa-b996-fc5a56f993a0 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:28.551407 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678cfc05-5ea8-41fa-b996-fc5a56f993a0 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:28.555989 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2329ff0d-ae70-4b57-8f26-c842a0b0e89f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:28.556694 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2329ff0d-ae70-4b57-8f26-c842a0b0e89f admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:28.556979 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2329ff0d-ae70-4b57-8f26-c842a0b0e89f admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:28.557259 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2329ff0d-ae70-4b57-8f26-c842a0b0e89f admin admin] PATH_INFO: `/v3/projects/583b7910abe04a4196f7329787544111/users/3d272b04939346199b101d079a331ce7/roles/462e3381a85c42a9959201f9aa122f7c` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:28.572369 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2329ff0d-ae70-4b57-8f26-c842a0b0e89f admin admin] RBAC: Authorizing `identity:create_grant(project_id=583b7910abe04a4196f7329787544111, user_id=3d272b04939346199b101d079a331ce7, role_id=462e3381a85c42a9959201f9aa122f7c)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:28.575036 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2329ff0d-ae70-4b57-8f26-c842a0b0e89f admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:28.588422 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1178/2361] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:46:28 2022] PUT /identity/v3/projects/583b7910abe04a4196f7329787544111/users/3d272b04939346199b101d079a331ce7/roles/462e3381a85c42a9959201f9aa122f7c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:46:28.600104 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da422dab-2907-484d-9df9-ee721aa786b6 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:28.600433 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da422dab-2907-484d-9df9-ee721aa786b6 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:28.600712 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da422dab-2907-484d-9df9-ee721aa786b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:28.628496 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-da422dab-2907-484d-9df9-ee721aa786b6 None None] MFA Rules not processed for user `3d272b04939346199b101d079a331ce7`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:46:28.629716 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-da422dab-2907-484d-9df9-ee721aa786b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:46:28.693601 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1184/2362] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:46:28 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:46:28.698084 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2329ff0d-ae70-4b57-8f26-c842a0b0e89f admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:28.717212 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:46:28.762767 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2329ff0d-ae70-4b57-8f26-c842a0b0e89f admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:28.767550 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2112130-bc74-4770-b719-35ee2f38a0ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:28.768173 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2112130-bc74-4770-b719-35ee2f38a0ab admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:28.768517 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2112130-bc74-4770-b719-35ee2f38a0ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:28.768801 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2112130-bc74-4770-b719-35ee2f38a0ab admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:28.769497 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2112130-bc74-4770-b719-35ee2f38a0ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:28.771448 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2112130-bc74-4770-b719-35ee2f38a0ab admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:28.797750 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1179/2363] 10.222.0.70 () {60 vars in 1153 bytes} [Tue Aug 2 21:46:28 2022] POST /identity/v3/projects => generated 377 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:46:28.801864 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da422dab-2907-484d-9df9-ee721aa786b6 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:28.814057 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da422dab-2907-484d-9df9-ee721aa786b6 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:28.871370 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf050bb-0134-4b16-9d9d-11d5f199745a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:28.871989 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf050bb-0134-4b16-9d9d-11d5f199745a admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:28.872301 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf050bb-0134-4b16-9d9d-11d5f199745a admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:28.872583 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf050bb-0134-4b16-9d9d-11d5f199745a admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:28.873329 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf050bb-0134-4b16-9d9d-11d5f199745a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:28.876185 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf050bb-0134-4b16-9d9d-11d5f199745a admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:28.900143 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1185/2364] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 2 21:46:28 2022] POST /identity/v3/users => generated 289 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:46:28.904280 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2112130-bc74-4770-b719-35ee2f38a0ab admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:28.914346 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2112130-bc74-4770-b719-35ee2f38a0ab admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:28.918921 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc0b894-e01b-4b21-aa18-eea4f039b62d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:28.919697 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc0b894-e01b-4b21-aa18-eea4f039b62d admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:28.919973 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc0b894-e01b-4b21-aa18-eea4f039b62d admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:28.920402 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc0b894-e01b-4b21-aa18-eea4f039b62d admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:28.921092 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc0b894-e01b-4b21-aa18-eea4f039b62d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:28.922681 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc0b894-e01b-4b21-aa18-eea4f039b62d admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:28.933432 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1180/2365] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:46:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:46:28.937304 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf050bb-0134-4b16-9d9d-11d5f199745a admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:28.947834 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf050bb-0134-4b16-9d9d-11d5f199745a admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:28.952405 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cb96c4-577a-417c-8d13-afcee0559781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:28.953019 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb96c4-577a-417c-8d13-afcee0559781 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:28.953299 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb96c4-577a-417c-8d13-afcee0559781 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:28.953569 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cb96c4-577a-417c-8d13-afcee0559781 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:28.954275 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cb96c4-577a-417c-8d13-afcee0559781 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:28.956008 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cb96c4-577a-417c-8d13-afcee0559781 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:28.965901 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1186/2366] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:46:28 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 21:46:28.969981 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc0b894-e01b-4b21-aa18-eea4f039b62d admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:28.980521 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc0b894-e01b-4b21-aa18-eea4f039b62d admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:28.985400 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eb4353-c037-48c6-a7b5-d7b0c1bac49f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:28.986064 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb4353-c037-48c6-a7b5-d7b0c1bac49f admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:28.986358 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb4353-c037-48c6-a7b5-d7b0c1bac49f admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:28.986642 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb4353-c037-48c6-a7b5-d7b0c1bac49f admin admin] PATH_INFO: `/v3/projects/cdee6000b0ef4d8bb18a60fdabcd3a5a/users/0aebbe6e1c5c46b9b8fc7c058c9eb038/roles/462e3381a85c42a9959201f9aa122f7c` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:29.002742 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eb4353-c037-48c6-a7b5-d7b0c1bac49f admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdee6000b0ef4d8bb18a60fdabcd3a5a, user_id=0aebbe6e1c5c46b9b8fc7c058c9eb038, role_id=462e3381a85c42a9959201f9aa122f7c)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:29.006166 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eb4353-c037-48c6-a7b5-d7b0c1bac49f admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:29.020314 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1181/2367] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:46:28 2022] PUT /identity/v3/projects/cdee6000b0ef4d8bb18a60fdabcd3a5a/users/0aebbe6e1c5c46b9b8fc7c058c9eb038/roles/462e3381a85c42a9959201f9aa122f7c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:46:29.089127 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de4c18-71ef-45fe-bfc0-637b9f797fa8 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:29.089416 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de4c18-71ef-45fe-bfc0-637b9f797fa8 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:29.089856 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de4c18-71ef-45fe-bfc0-637b9f797fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:29.123551 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-e4de4c18-71ef-45fe-bfc0-637b9f797fa8 None None] MFA Rules not processed for user `0aebbe6e1c5c46b9b8fc7c058c9eb038`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:46:29.124806 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-e4de4c18-71ef-45fe-bfc0-637b9f797fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:46:29.144315 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:46:29.191145 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1187/2368] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:46:29 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:46:29.195630 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eb4353-c037-48c6-a7b5-d7b0c1bac49f admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:29.256872 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eb4353-c037-48c6-a7b5-d7b0c1bac49f admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:29.261638 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cbc74c-8374-4dab-ba62-c1187aaa5fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:29.262253 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cbc74c-8374-4dab-ba62-c1187aaa5fb7 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:29.262537 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cbc74c-8374-4dab-ba62-c1187aaa5fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:29.262816 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cbc74c-8374-4dab-ba62-c1187aaa5fb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:29.263473 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cbc74c-8374-4dab-ba62-c1187aaa5fb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:29.265411 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cbc74c-8374-4dab-ba62-c1187aaa5fb7 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:29.297760 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1182/2369] 10.222.0.70 () {60 vars in 1153 bytes} [Tue Aug 2 21:46:29 2022] POST /identity/v3/projects => generated 377 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:46:29.302350 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4de4c18-71ef-45fe-bfc0-637b9f797fa8 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:29.313002 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4de4c18-71ef-45fe-bfc0-637b9f797fa8 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:29.369402 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe9623e-cd2e-4409-ab92-6fb55a3afafd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:29.370020 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe9623e-cd2e-4409-ab92-6fb55a3afafd admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:29.370310 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe9623e-cd2e-4409-ab92-6fb55a3afafd admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:29.370595 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe9623e-cd2e-4409-ab92-6fb55a3afafd admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:29.371265 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe9623e-cd2e-4409-ab92-6fb55a3afafd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:29.373251 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe9623e-cd2e-4409-ab92-6fb55a3afafd admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:29.393505 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1188/2370] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 2 21:46:29 2022] POST /identity/v3/users => generated 295 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:46:29.397494 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cbc74c-8374-4dab-ba62-c1187aaa5fb7 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:29.407580 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cbc74c-8374-4dab-ba62-c1187aaa5fb7 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:29.412769 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b612138d-60c7-478d-a3da-97c63b4d04ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:29.413407 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b612138d-60c7-478d-a3da-97c63b4d04ba admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:29.413696 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b612138d-60c7-478d-a3da-97c63b4d04ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:29.413976 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b612138d-60c7-478d-a3da-97c63b4d04ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:29.414669 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b612138d-60c7-478d-a3da-97c63b4d04ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:29.416292 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b612138d-60c7-478d-a3da-97c63b4d04ba admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:29.428358 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1183/2371] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:46:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:46:29.432619 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe9623e-cd2e-4409-ab92-6fb55a3afafd admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:29.442536 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe9623e-cd2e-4409-ab92-6fb55a3afafd admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:29.447162 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d104693d-d1d4-4920-a744-c092c5e7af36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:29.447810 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d104693d-d1d4-4920-a744-c092c5e7af36 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:29.448090 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d104693d-d1d4-4920-a744-c092c5e7af36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:29.448402 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d104693d-d1d4-4920-a744-c092c5e7af36 admin admin] PATH_INFO: `/v3/projects/814241a882a642a5a4708a9e21ff4e7f/users/36e5e058af4b4f009830189cde32ab61/roles/3e32dbf75f9b41f5adb9fe59851267bb` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:29.463157 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d104693d-d1d4-4920-a744-c092c5e7af36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=814241a882a642a5a4708a9e21ff4e7f, user_id=36e5e058af4b4f009830189cde32ab61, role_id=3e32dbf75f9b41f5adb9fe59851267bb)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:29.465939 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d104693d-d1d4-4920-a744-c092c5e7af36 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:29.480298 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1189/2372] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:46:29 2022] PUT /identity/v3/projects/814241a882a642a5a4708a9e21ff4e7f/users/36e5e058af4b4f009830189cde32ab61/roles/3e32dbf75f9b41f5adb9fe59851267bb => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:46:29.484322 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b612138d-60c7-478d-a3da-97c63b4d04ba admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:29.496405 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b612138d-60c7-478d-a3da-97c63b4d04ba admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:29.540392 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:46:29.557628 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94537905-e9c3-4a46-97a1-5d2f437e60a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:29.558273 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94537905-e9c3-4a46-97a1-5d2f437e60a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:29.558554 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94537905-e9c3-4a46-97a1-5d2f437e60a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:29.558851 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94537905-e9c3-4a46-97a1-5d2f437e60a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:29.559561 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94537905-e9c3-4a46-97a1-5d2f437e60a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:29.561178 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94537905-e9c3-4a46-97a1-5d2f437e60a4 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:29.570774 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1184/2373] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:46:29 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:46:29.575496 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d104693d-d1d4-4920-a744-c092c5e7af36 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:29.586061 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d104693d-d1d4-4920-a744-c092c5e7af36 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:29.590683 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dafa637-20b1-4239-8cbf-192c6b94e8f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:29.591338 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dafa637-20b1-4239-8cbf-192c6b94e8f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:29.591622 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dafa637-20b1-4239-8cbf-192c6b94e8f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:29.591907 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dafa637-20b1-4239-8cbf-192c6b94e8f5 admin admin] PATH_INFO: `/v3/projects/814241a882a642a5a4708a9e21ff4e7f/users/36e5e058af4b4f009830189cde32ab61/roles/3e32dbf75f9b41f5adb9fe59851267bb` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:29.593883 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dafa637-20b1-4239-8cbf-192c6b94e8f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=814241a882a642a5a4708a9e21ff4e7f, user_id=36e5e058af4b4f009830189cde32ab61, role_id=3e32dbf75f9b41f5adb9fe59851267bb)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:29.597114 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dafa637-20b1-4239-8cbf-192c6b94e8f5 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:29.607409 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1190/2374] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:46:29 2022] PUT /identity/v3/projects/814241a882a642a5a4708a9e21ff4e7f/users/36e5e058af4b4f009830189cde32ab61/roles/3e32dbf75f9b41f5adb9fe59851267bb => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:46:29.617947 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b95ecf-c169-49b1-97d2-eced881f123d None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:29.618241 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b95ecf-c169-49b1-97d2-eced881f123d None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:29.618525 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b95ecf-c169-49b1-97d2-eced881f123d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:29.646194 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-58b95ecf-c169-49b1-97d2-eced881f123d None None] MFA Rules not processed for user `36e5e058af4b4f009830189cde32ab61`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:46:29.647402 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-58b95ecf-c169-49b1-97d2-eced881f123d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:46:29.719202 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1185/2375] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:46:29 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:46:29.731232 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dafa637-20b1-4239-8cbf-192c6b94e8f5 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:29.733186 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-9dafa637-20b1-4239-8cbf-192c6b94e8f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:46:29.792878 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dafa637-20b1-4239-8cbf-192c6b94e8f5 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:29.796505 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413ebe9b-f5db-4738-9344-c986cc88adf0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '123eb76f95ee4e39905944da701c712d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:29.797129 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413ebe9b-f5db-4738-9344-c986cc88adf0 service cinder] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:29.797410 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413ebe9b-f5db-4738-9344-c986cc88adf0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:29.797685 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413ebe9b-f5db-4738-9344-c986cc88adf0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:29.806531 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413ebe9b-f5db-4738-9344-c986cc88adf0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:29.807977 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413ebe9b-f5db-4738-9344-c986cc88adf0 service cinder] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:29.817747 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1191/2376] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:46:29 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:46:29.860279 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b95ecf-c169-49b1-97d2-eced881f123d None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:29.861719 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-58b95ecf-c169-49b1-97d2-eced881f123d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:46:29.874062 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b95ecf-c169-49b1-97d2-eced881f123d None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:29.878841 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c8f583-4008-4a47-87af-e96e068e8d84 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '123eb76f95ee4e39905944da701c712d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:29.879454 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c8f583-4008-4a47-87af-e96e068e8d84 service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:29.879750 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c8f583-4008-4a47-87af-e96e068e8d84 service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:29.880012 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c8f583-4008-4a47-87af-e96e068e8d84 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:29.938118 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c8f583-4008-4a47-87af-e96e068e8d84 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:29.939636 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c8f583-4008-4a47-87af-e96e068e8d84 service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:29.949079 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1186/2377] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:46:29 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:46:32.842775 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413ebe9b-f5db-4738-9344-c986cc88adf0 service cinder] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:32.861255 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:46:32.909826 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413ebe9b-f5db-4738-9344-c986cc88adf0 service cinder] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:32.914662 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c6079d-fb91-4a3a-975e-ac3c15dcc41a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:32.915306 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c6079d-fb91-4a3a-975e-ac3c15dcc41a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:32.915632 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c6079d-fb91-4a3a-975e-ac3c15dcc41a admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:32.915858 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c6079d-fb91-4a3a-975e-ac3c15dcc41a admin admin] PATH_INFO: `/v3/users/3d272b04939346199b101d079a331ce7` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:32.917057 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c6079d-fb91-4a3a-975e-ac3c15dcc41a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d272b04939346199b101d079a331ce7)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:32.918979 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c6079d-fb91-4a3a-975e-ac3c15dcc41a admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:32.970870 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-f7c6079d-fb91-4a3a-975e-ac3c15dcc41a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d272b04939346199b101d079a331ce7'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:32.981006 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-f7c6079d-fb91-4a3a-975e-ac3c15dcc41a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d272b04939346199b101d079a331ce7'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:32.996828 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-f7c6079d-fb91-4a3a-975e-ac3c15dcc41a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d272b04939346199b101d079a331ce7'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:33.005263 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-f7c6079d-fb91-4a3a-975e-ac3c15dcc41a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d272b04939346199b101d079a331ce7'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:33.005992 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-f7c6079d-fb91-4a3a-975e-ac3c15dcc41a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d272b04939346199b101d079a331ce7'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:33.012304 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1192/2378] 10.222.0.70 () {58 vars in 1224 bytes} [Tue Aug 2 21:46:32 2022] DELETE /identity/v3/users/3d272b04939346199b101d079a331ce7 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:46:33.016688 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9724f8-2150-4fc7-aecf-f9eac24b748f None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:33.019885 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9724f8-2150-4fc7-aecf-f9eac24b748f None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:33.020306 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9724f8-2150-4fc7-aecf-f9eac24b748f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:33.042643 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-2f9724f8-2150-4fc7-aecf-f9eac24b748f None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:46:33.043946 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-2f9724f8-2150-4fc7-aecf-f9eac24b748f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:46:33.130914 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1187/2379] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:46:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:46:33.144144 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c6079d-fb91-4a3a-975e-ac3c15dcc41a admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:33.146571 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-f7c6079d-fb91-4a3a-975e-ac3c15dcc41a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:46:33.239978 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c6079d-fb91-4a3a-975e-ac3c15dcc41a admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:33.244424 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01c3403-f34f-4275-b059-47b2eb5c6265 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '723f5f43572a493dae0349070a2adb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:33.245054 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01c3403-f34f-4275-b059-47b2eb5c6265 service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:33.245335 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01c3403-f34f-4275-b059-47b2eb5c6265 service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:33.245743 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01c3403-f34f-4275-b059-47b2eb5c6265 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:33.257912 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01c3403-f34f-4275-b059-47b2eb5c6265 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:33.260257 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01c3403-f34f-4275-b059-47b2eb5c6265 service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:33.280399 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1193/2380] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:46:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:46:33.593253 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9724f8-2150-4fc7-aecf-f9eac24b748f None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:33.595409 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-2f9724f8-2150-4fc7-aecf-f9eac24b748f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:46:33.607872 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:46:33.626077 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9724f8-2150-4fc7-aecf-f9eac24b748f None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:33.632542 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9162da6d-b45b-4dbe-a94c-0fe0c5622d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:33.633212 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9162da6d-b45b-4dbe-a94c-0fe0c5622d8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:33.633513 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9162da6d-b45b-4dbe-a94c-0fe0c5622d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:33.633783 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9162da6d-b45b-4dbe-a94c-0fe0c5622d8b admin admin] PATH_INFO: `/v3/projects/583b7910abe04a4196f7329787544111` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:33.634983 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9162da6d-b45b-4dbe-a94c-0fe0c5622d8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=583b7910abe04a4196f7329787544111)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:33.637104 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9162da6d-b45b-4dbe-a94c-0fe0c5622d8b admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:33.699476 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-9162da6d-b45b-4dbe-a94c-0fe0c5622d8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '583b7910abe04a4196f7329787544111', 'request_id': 'req-9162da6d-b45b-4dbe-a94c-0fe0c5622d8b'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:33.707136 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-9162da6d-b45b-4dbe-a94c-0fe0c5622d8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '583b7910abe04a4196f7329787544111', 'request_id': 'req-9162da6d-b45b-4dbe-a94c-0fe0c5622d8b'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:33.715343 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-9162da6d-b45b-4dbe-a94c-0fe0c5622d8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '583b7910abe04a4196f7329787544111', 'request_id': 'req-9162da6d-b45b-4dbe-a94c-0fe0c5622d8b'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:33.727470 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-9162da6d-b45b-4dbe-a94c-0fe0c5622d8b admin admin] The token cache is being invalidate because project 583b7910abe04a4196f7329787544111 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:46:33.728616 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-9162da6d-b45b-4dbe-a94c-0fe0c5622d8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:33.728767 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-9162da6d-b45b-4dbe-a94c-0fe0c5622d8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:33.730716 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1188/2381] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Aug 2 21:46:33 2022] DELETE /identity/v3/projects/583b7910abe04a4196f7329787544111 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:46:33.734650 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01c3403-f34f-4275-b059-47b2eb5c6265 service neutron] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:33.746262 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01c3403-f34f-4275-b059-47b2eb5c6265 service neutron] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:33.784887 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:46:33.818215 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3e246f-d4e9-4090-be38-649a30c2c54e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:33.818852 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3e246f-d4e9-4090-be38-649a30c2c54e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:33.819141 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3e246f-d4e9-4090-be38-649a30c2c54e admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:33.819425 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3e246f-d4e9-4090-be38-649a30c2c54e admin admin] PATH_INFO: `/v3/users/0aebbe6e1c5c46b9b8fc7c058c9eb038` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:33.820721 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3e246f-d4e9-4090-be38-649a30c2c54e admin admin] RBAC: Authorizing `identity:delete_user(user_id=0aebbe6e1c5c46b9b8fc7c058c9eb038)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:33.822790 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3e246f-d4e9-4090-be38-649a30c2c54e admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:33.889943 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-5b3e246f-d4e9-4090-be38-649a30c2c54e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0aebbe6e1c5c46b9b8fc7c058c9eb038'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:33.906849 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-5b3e246f-d4e9-4090-be38-649a30c2c54e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0aebbe6e1c5c46b9b8fc7c058c9eb038'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:33.921457 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-5b3e246f-d4e9-4090-be38-649a30c2c54e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0aebbe6e1c5c46b9b8fc7c058c9eb038'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:33.930987 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-5b3e246f-d4e9-4090-be38-649a30c2c54e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0aebbe6e1c5c46b9b8fc7c058c9eb038'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:33.932199 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-5b3e246f-d4e9-4090-be38-649a30c2c54e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0aebbe6e1c5c46b9b8fc7c058c9eb038'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:33.939660 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1194/2382] 10.222.0.70 () {58 vars in 1224 bytes} [Tue Aug 2 21:46:33 2022] DELETE /identity/v3/users/0aebbe6e1c5c46b9b8fc7c058c9eb038 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:46:34.323572 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9162da6d-b45b-4dbe-a94c-0fe0c5622d8b admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:34.325142 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-9162da6d-b45b-4dbe-a94c-0fe0c5622d8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:46:34.342601 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3e246f-d4e9-4090-be38-649a30c2c54e admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:34.343898 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-5b3e246f-d4e9-4090-be38-649a30c2c54e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:46:34.377271 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9162da6d-b45b-4dbe-a94c-0fe0c5622d8b admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:34.427511 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3e246f-d4e9-4090-be38-649a30c2c54e admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:34.432583 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb62ce06-129b-4168-adb8-5c7209dfc5b7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83fcd951771e42959506b70b0137003f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:34.433208 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb62ce06-129b-4168-adb8-5c7209dfc5b7 service placement] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:34.433485 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb62ce06-129b-4168-adb8-5c7209dfc5b7 service placement] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:34.434709 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb62ce06-129b-4168-adb8-5c7209dfc5b7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:34.435989 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-fb62ce06-129b-4168-adb8-5c7209dfc5b7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:46:34.448378 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb62ce06-129b-4168-adb8-5c7209dfc5b7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:34.449835 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2696b30-44fd-46df-b72e-058af32bccb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:34.450022 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb62ce06-129b-4168-adb8-5c7209dfc5b7 service placement] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:34.450505 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2696b30-44fd-46df-b72e-058af32bccb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:34.450786 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2696b30-44fd-46df-b72e-058af32bccb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:34.451093 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2696b30-44fd-46df-b72e-058af32bccb6 admin admin] PATH_INFO: `/v3/projects/cdee6000b0ef4d8bb18a60fdabcd3a5a` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:34.452291 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2696b30-44fd-46df-b72e-058af32bccb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdee6000b0ef4d8bb18a60fdabcd3a5a)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:34.454203 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2696b30-44fd-46df-b72e-058af32bccb6 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:34.460457 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1195/2383] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:46:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:46:34.461937 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bc8528-2b0b-4fd9-a684-50d21882656a None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:34.462224 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bc8528-2b0b-4fd9-a684-50d21882656a None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:34.462501 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bc8528-2b0b-4fd9-a684-50d21882656a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:34.486809 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-54bc8528-2b0b-4fd9-a684-50d21882656a None None] MFA Rules not processed for user `6be7b2bcfebd45389ca289c34fbabc3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:46:34.490829 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-54bc8528-2b0b-4fd9-a684-50d21882656a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:46:34.514099 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-b2696b30-44fd-46df-b72e-058af32bccb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdee6000b0ef4d8bb18a60fdabcd3a5a', 'request_id': 'req-b2696b30-44fd-46df-b72e-058af32bccb6'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:34.524861 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-b2696b30-44fd-46df-b72e-058af32bccb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdee6000b0ef4d8bb18a60fdabcd3a5a', 'request_id': 'req-b2696b30-44fd-46df-b72e-058af32bccb6'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:34.537423 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-b2696b30-44fd-46df-b72e-058af32bccb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdee6000b0ef4d8bb18a60fdabcd3a5a', 'request_id': 'req-b2696b30-44fd-46df-b72e-058af32bccb6'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:34.557354 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:46:34.568822 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-b2696b30-44fd-46df-b72e-058af32bccb6 admin admin] The token cache is being invalidate because project cdee6000b0ef4d8bb18a60fdabcd3a5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:46:34.569145 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-b2696b30-44fd-46df-b72e-058af32bccb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:34.569831 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-b2696b30-44fd-46df-b72e-058af32bccb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:34.571643 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1189/2384] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Aug 2 21:46:34 2022] DELETE /identity/v3/projects/cdee6000b0ef4d8bb18a60fdabcd3a5a => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:46:34.575732 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2696b30-44fd-46df-b72e-058af32bccb6 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:34.577453 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-b2696b30-44fd-46df-b72e-058af32bccb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:46:34.579900 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1196/2385] 10.222.0.70 () {58 vars in 967 bytes} [Tue Aug 2 21:46:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:46:34.597975 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bc8528-2b0b-4fd9-a684-50d21882656a None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:34.599350 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-54bc8528-2b0b-4fd9-a684-50d21882656a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:46:34.601290 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:46:34.682581 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2696b30-44fd-46df-b72e-058af32bccb6 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:34.689196 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e41ade-4d7c-4c5d-97ee-c30e76a844b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:34.690660 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e41ade-4d7c-4c5d-97ee-c30e76a844b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:34.690942 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e41ade-4d7c-4c5d-97ee-c30e76a844b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:34.691363 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e41ade-4d7c-4c5d-97ee-c30e76a844b3 admin admin] PATH_INFO: `/v3/users/36e5e058af4b4f009830189cde32ab61` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:34.694385 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e41ade-4d7c-4c5d-97ee-c30e76a844b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36e5e058af4b4f009830189cde32ab61)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:34.696598 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e41ade-4d7c-4c5d-97ee-c30e76a844b3 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:34.698176 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bc8528-2b0b-4fd9-a684-50d21882656a None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:34.706780 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fbaa7d-4217-4cb5-ba2d-33465c504d73 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee7ebf40212465aac997b461a2d10fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:34.707334 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fbaa7d-4217-4cb5-ba2d-33465c504d73 service swift] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:34.707749 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fbaa7d-4217-4cb5-ba2d-33465c504d73 service swift] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:34.708122 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fbaa7d-4217-4cb5-ba2d-33465c504d73 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:34.722466 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fbaa7d-4217-4cb5-ba2d-33465c504d73 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:34.725371 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fbaa7d-4217-4cb5-ba2d-33465c504d73 service swift] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:34.737930 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1197/2386] 10.222.0.70 () {60 vars in 1384 bytes} [Tue Aug 2 21:46:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 02 21:46:34.759432 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-d4e41ade-4d7c-4c5d-97ee-c30e76a844b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36e5e058af4b4f009830189cde32ab61'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:34.772817 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-d4e41ade-4d7c-4c5d-97ee-c30e76a844b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36e5e058af4b4f009830189cde32ab61'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:34.789876 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-d4e41ade-4d7c-4c5d-97ee-c30e76a844b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36e5e058af4b4f009830189cde32ab61'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:34.791134 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-d4e41ade-4d7c-4c5d-97ee-c30e76a844b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36e5e058af4b4f009830189cde32ab61'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:34.799551 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-d4e41ade-4d7c-4c5d-97ee-c30e76a844b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36e5e058af4b4f009830189cde32ab61'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:34.806608 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1190/2387] 10.222.0.70 () {58 vars in 1224 bytes} [Tue Aug 2 21:46:34 2022] DELETE /identity/v3/users/36e5e058af4b4f009830189cde32ab61 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:46:35.118046 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fbaa7d-4217-4cb5-ba2d-33465c504d73 service swift] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:35.119515 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-79fbaa7d-4217-4cb5-ba2d-33465c504d73 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:46:35.124589 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e41ade-4d7c-4c5d-97ee-c30e76a844b3 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:35.126606 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-d4e41ade-4d7c-4c5d-97ee-c30e76a844b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:46:35.214908 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fbaa7d-4217-4cb5-ba2d-33465c504d73 service swift] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:35.226889 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e41ade-4d7c-4c5d-97ee-c30e76a844b3 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:35.232269 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5856d31c-0e68-46d4-84b1-f88eb60969b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:35.232992 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5856d31c-0e68-46d4-84b1-f88eb60969b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:35.233285 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5856d31c-0e68-46d4-84b1-f88eb60969b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:35.233571 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5856d31c-0e68-46d4-84b1-f88eb60969b6 admin admin] PATH_INFO: `/v3/projects/814241a882a642a5a4708a9e21ff4e7f` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:35.234940 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5856d31c-0e68-46d4-84b1-f88eb60969b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=814241a882a642a5a4708a9e21ff4e7f)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:35.237834 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5856d31c-0e68-46d4-84b1-f88eb60969b6 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:35.299858 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02d651c-3297-42e5-a6a4-06f504a072e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87dd5c1c5e854d4b96e0b7dad6aa3719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:35.300425 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02d651c-3297-42e5-a6a4-06f504a072e5 service nova] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:35.300899 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02d651c-3297-42e5-a6a4-06f504a072e5 service nova] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:35.301336 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02d651c-3297-42e5-a6a4-06f504a072e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:35.303404 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-a02d651c-3297-42e5-a6a4-06f504a072e5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:46:35.306618 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:46:35.318390 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-5856d31c-0e68-46d4-84b1-f88eb60969b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '814241a882a642a5a4708a9e21ff4e7f', 'request_id': 'req-5856d31c-0e68-46d4-84b1-f88eb60969b6'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:35.322055 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:46:35.330004 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-5856d31c-0e68-46d4-84b1-f88eb60969b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '814241a882a642a5a4708a9e21ff4e7f', 'request_id': 'req-5856d31c-0e68-46d4-84b1-f88eb60969b6'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:35.337647 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-5856d31c-0e68-46d4-84b1-f88eb60969b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '814241a882a642a5a4708a9e21ff4e7f', 'request_id': 'req-5856d31c-0e68-46d4-84b1-f88eb60969b6'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:35.352575 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-5856d31c-0e68-46d4-84b1-f88eb60969b6 admin admin] The token cache is being invalidate because project 814241a882a642a5a4708a9e21ff4e7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:46:35.352868 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-5856d31c-0e68-46d4-84b1-f88eb60969b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:35.353563 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-5856d31c-0e68-46d4-84b1-f88eb60969b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:35.356055 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1191/2388] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Aug 2 21:46:35 2022] DELETE /identity/v3/projects/814241a882a642a5a4708a9e21ff4e7f => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:46:35.362963 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0497ed7a-e272-4632-8605-0fe2ac275df1 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:35.363464 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0497ed7a-e272-4632-8605-0fe2ac275df1 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:35.363898 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0497ed7a-e272-4632-8605-0fe2ac275df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:35.393067 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-0497ed7a-e272-4632-8605-0fe2ac275df1 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:46:35.393643 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02d651c-3297-42e5-a6a4-06f504a072e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:35.394838 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-0497ed7a-e272-4632-8605-0fe2ac275df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:46:35.395291 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02d651c-3297-42e5-a6a4-06f504a072e5 service nova] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:35.408083 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1198/2389] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:46:35 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:46:35.418507 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02d651c-3297-42e5-a6a4-06f504a072e5 service nova] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:35.422561 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-a02d651c-3297-42e5-a6a4-06f504a072e5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:46:35.490711 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1192/2390] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:46:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:46:35.492811 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cd9a7b-2785-480b-96ae-b88201780985 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:35.492811 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cd9a7b-2785-480b-96ae-b88201780985 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:35.493340 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cd9a7b-2785-480b-96ae-b88201780985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:35.519227 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02d651c-3297-42e5-a6a4-06f504a072e5 service nova] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:35.522027 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-d9cd9a7b-2785-480b-96ae-b88201780985 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:46:35.523536 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-d9cd9a7b-2785-480b-96ae-b88201780985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:46:35.539227 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1193/2391] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:46:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:46:35.540508 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cd9a7b-2785-480b-96ae-b88201780985 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:35.555927 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cd9a7b-2785-480b-96ae-b88201780985 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:35.564705 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986768a3-9584-4d87-916c-e7c7950b4bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:35.565466 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986768a3-9584-4d87-916c-e7c7950b4bce admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:35.566330 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986768a3-9584-4d87-916c-e7c7950b4bce admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:35.566842 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986768a3-9584-4d87-916c-e7c7950b4bce admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:35.568604 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986768a3-9584-4d87-916c-e7c7950b4bce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:46:35.570477 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986768a3-9584-4d87-916c-e7c7950b4bce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:35.572671 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986768a3-9584-4d87-916c-e7c7950b4bce admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:35.592445 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0009f065-c95e-4cff-816e-76baa7e978ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '723f5f43572a493dae0349070a2adb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:35.592445 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0009f065-c95e-4cff-816e-76baa7e978ff service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:35.592445 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0009f065-c95e-4cff-816e-76baa7e978ff service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:35.592445 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0009f065-c95e-4cff-816e-76baa7e978ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:35.592789 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-0009f065-c95e-4cff-816e-76baa7e978ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:46:35.594641 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1194/2392] 10.222.0.70 () {58 vars in 1153 bytes} [Tue Aug 2 21:46:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:46:35.600094 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986768a3-9584-4d87-916c-e7c7950b4bce admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:35.611275 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986768a3-9584-4d87-916c-e7c7950b4bce admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:35.617598 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0009f065-c95e-4cff-816e-76baa7e978ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:35.618485 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492fb962-5cf7-4052-a005-5ad154c14f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:35.619107 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492fb962-5cf7-4052-a005-5ad154c14f6e admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:35.619388 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492fb962-5cf7-4052-a005-5ad154c14f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:35.619679 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492fb962-5cf7-4052-a005-5ad154c14f6e admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:35.621516 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492fb962-5cf7-4052-a005-5ad154c14f6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:35.621669 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0009f065-c95e-4cff-816e-76baa7e978ff service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:35.623085 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492fb962-5cf7-4052-a005-5ad154c14f6e admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:35.635058 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1199/2393] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:46:35 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:46:35.657685 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1195/2394] 10.222.0.70 () {60 vars in 1153 bytes} [Tue Aug 2 21:46:35 2022] POST /identity/v3/projects => generated 385 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:46:35.662620 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0009f065-c95e-4cff-816e-76baa7e978ff service neutron] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:35.678665 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0009f065-c95e-4cff-816e-76baa7e978ff service neutron] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:35.775266 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699fd0ff-b50d-4b1d-9f48-9571bb3294d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:35.776740 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699fd0ff-b50d-4b1d-9f48-9571bb3294d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:35.777331 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699fd0ff-b50d-4b1d-9f48-9571bb3294d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:35.777918 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699fd0ff-b50d-4b1d-9f48-9571bb3294d7 admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:35.779754 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699fd0ff-b50d-4b1d-9f48-9571bb3294d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:35.784617 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699fd0ff-b50d-4b1d-9f48-9571bb3294d7 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:35.819470 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1200/2395] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 2 21:46:35 2022] POST /identity/v3/users => generated 293 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:46:35.823904 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492fb962-5cf7-4052-a005-5ad154c14f6e admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:35.836279 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492fb962-5cf7-4052-a005-5ad154c14f6e admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:35.842057 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21b6bd7-5f5a-4c3c-bce4-abdc4bb3e0f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:35.842686 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21b6bd7-5f5a-4c3c-bce4-abdc4bb3e0f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:35.842975 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21b6bd7-5f5a-4c3c-bce4-abdc4bb3e0f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:35.843255 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21b6bd7-5f5a-4c3c-bce4-abdc4bb3e0f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:35.843980 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21b6bd7-5f5a-4c3c-bce4-abdc4bb3e0f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:35.845721 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21b6bd7-5f5a-4c3c-bce4-abdc4bb3e0f6 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:35.858398 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1196/2396] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:46:35 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:46:35.862940 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699fd0ff-b50d-4b1d-9f48-9571bb3294d7 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:35.870604 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:46:35.876328 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699fd0ff-b50d-4b1d-9f48-9571bb3294d7 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:35.886641 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04accdd1-533a-4dda-ae1b-c3644c914ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:35.887348 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04accdd1-533a-4dda-ae1b-c3644c914ccc admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:35.889552 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04accdd1-533a-4dda-ae1b-c3644c914ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:35.889552 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04accdd1-533a-4dda-ae1b-c3644c914ccc admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:35.889552 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04accdd1-533a-4dda-ae1b-c3644c914ccc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:35.902253 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04accdd1-533a-4dda-ae1b-c3644c914ccc admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:35.915077 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1201/2397] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:46:35 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 21:46:35.919586 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21b6bd7-5f5a-4c3c-bce4-abdc4bb3e0f6 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:35.930486 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21b6bd7-5f5a-4c3c-bce4-abdc4bb3e0f6 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:35.935239 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1085f9-f91e-4674-8aee-4bb713cd0675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:35.935993 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1085f9-f91e-4674-8aee-4bb713cd0675 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:35.936391 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1085f9-f91e-4674-8aee-4bb713cd0675 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:35.936678 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1085f9-f91e-4674-8aee-4bb713cd0675 admin admin] PATH_INFO: `/v3/projects/99851ba800ad440491c3e195cf55d66d/users/eba79c2f1da34170a04cf5733b4f916c/roles/462e3381a85c42a9959201f9aa122f7c` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:35.953901 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1085f9-f91e-4674-8aee-4bb713cd0675 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99851ba800ad440491c3e195cf55d66d, user_id=eba79c2f1da34170a04cf5733b4f916c, role_id=462e3381a85c42a9959201f9aa122f7c)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:35.956764 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1085f9-f91e-4674-8aee-4bb713cd0675 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:35.969714 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1197/2398] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:46:35 2022] PUT /identity/v3/projects/99851ba800ad440491c3e195cf55d66d/users/eba79c2f1da34170a04cf5733b4f916c/roles/462e3381a85c42a9959201f9aa122f7c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:46:35.983183 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ab9ecf-7b0e-4c00-bb53-0f627fdf2746 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:35.983479 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ab9ecf-7b0e-4c00-bb53-0f627fdf2746 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:35.983756 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ab9ecf-7b0e-4c00-bb53-0f627fdf2746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:36.018036 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-a6ab9ecf-7b0e-4c00-bb53-0f627fdf2746 None None] MFA Rules not processed for user `eba79c2f1da34170a04cf5733b4f916c`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:46:36.019331 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-a6ab9ecf-7b0e-4c00-bb53-0f627fdf2746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:46:36.087680 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1202/2399] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:46:35 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:46:36.101455 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1085f9-f91e-4674-8aee-4bb713cd0675 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:36.103216 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-db1085f9-f91e-4674-8aee-4bb713cd0675 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:46:36.157588 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:46:36.163034 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1085f9-f91e-4674-8aee-4bb713cd0675 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:36.167938 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1dbd15-c4e5-4e7b-9860-216438a117ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '123eb76f95ee4e39905944da701c712d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:36.168567 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1dbd15-c4e5-4e7b-9860-216438a117ca service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:36.169351 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1dbd15-c4e5-4e7b-9860-216438a117ca service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:36.169617 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1dbd15-c4e5-4e7b-9860-216438a117ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:36.179901 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1dbd15-c4e5-4e7b-9860-216438a117ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:36.181520 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1dbd15-c4e5-4e7b-9860-216438a117ca service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:36.190853 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1198/2400] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:46:36 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:46:37.051182 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93429486-9ab6-4057-9306-9dd09aaa192e None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:37.051632 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93429486-9ab6-4057-9306-9dd09aaa192e None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:37.051788 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93429486-9ab6-4057-9306-9dd09aaa192e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:37.072263 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-93429486-9ab6-4057-9306-9dd09aaa192e None None] MFA Rules not processed for user `6be7b2bcfebd45389ca289c34fbabc3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:46:37.073534 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-93429486-9ab6-4057-9306-9dd09aaa192e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:46:37.144393 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1203/2401] 10.222.0.70 () {58 vars in 1009 bytes} [Tue Aug 2 21:46:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:46:37.152608 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1dbd15-c4e5-4e7b-9860-216438a117ca service cinder] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:37.154089 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-db1dbd15-c4e5-4e7b-9860-216438a117ca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:46:37.253604 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1dbd15-c4e5-4e7b-9860-216438a117ca service cinder] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:37.259255 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0512b914-199b-4048-8075-6db98087c1d1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee7ebf40212465aac997b461a2d10fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:37.259952 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0512b914-199b-4048-8075-6db98087c1d1 service swift] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:37.260331 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0512b914-199b-4048-8075-6db98087c1d1 service swift] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:37.260712 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0512b914-199b-4048-8075-6db98087c1d1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:37.273416 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0512b914-199b-4048-8075-6db98087c1d1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:37.276110 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0512b914-199b-4048-8075-6db98087c1d1 service swift] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:37.291998 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1199/2402] 10.222.0.70 () {60 vars in 1384 bytes} [Tue Aug 2 21:46:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 02 21:46:42.236783 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93429486-9ab6-4057-9306-9dd09aaa192e None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:42.408339 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93429486-9ab6-4057-9306-9dd09aaa192e None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:42.414425 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212161b2-d647-4f38-9741-b845d8780086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:42.415287 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212161b2-d647-4f38-9741-b845d8780086 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:42.415682 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212161b2-d647-4f38-9741-b845d8780086 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:42.416352 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212161b2-d647-4f38-9741-b845d8780086 admin admin] PATH_INFO: `/v3/users/eba79c2f1da34170a04cf5733b4f916c` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:42.417902 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212161b2-d647-4f38-9741-b845d8780086 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eba79c2f1da34170a04cf5733b4f916c)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:42.420776 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212161b2-d647-4f38-9741-b845d8780086 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:42.474440 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:46:42.515994 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-212161b2-d647-4f38-9741-b845d8780086 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eba79c2f1da34170a04cf5733b4f916c'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:42.536159 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-212161b2-d647-4f38-9741-b845d8780086 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eba79c2f1da34170a04cf5733b4f916c'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:42.560381 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-212161b2-d647-4f38-9741-b845d8780086 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eba79c2f1da34170a04cf5733b4f916c'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:42.573689 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-212161b2-d647-4f38-9741-b845d8780086 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eba79c2f1da34170a04cf5733b4f916c'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:42.574647 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-212161b2-d647-4f38-9741-b845d8780086 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eba79c2f1da34170a04cf5733b4f916c'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:42.593940 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1204/2403] 10.222.0.70 () {58 vars in 1224 bytes} [Tue Aug 2 21:46:42 2022] DELETE /identity/v3/users/eba79c2f1da34170a04cf5733b4f916c => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:46:42.599735 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5243d64e-80d0-4285-9f6e-1bb279206aec None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:42.600280 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5243d64e-80d0-4285-9f6e-1bb279206aec None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:42.600577 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5243d64e-80d0-4285-9f6e-1bb279206aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:42.621988 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-5243d64e-80d0-4285-9f6e-1bb279206aec None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:46:42.623375 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-5243d64e-80d0-4285-9f6e-1bb279206aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:46:42.712653 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1200/2404] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:46:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:46:42.719750 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212161b2-d647-4f38-9741-b845d8780086 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:42.722020 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-212161b2-d647-4f38-9741-b845d8780086 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:46:42.818120 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212161b2-d647-4f38-9741-b845d8780086 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:42.822434 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeffc9df-75d1-4453-8801-46c3ec71ff1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '723f5f43572a493dae0349070a2adb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:42.823320 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeffc9df-75d1-4453-8801-46c3ec71ff1f service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:42.823793 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeffc9df-75d1-4453-8801-46c3ec71ff1f service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:42.824270 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeffc9df-75d1-4453-8801-46c3ec71ff1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:42.843507 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeffc9df-75d1-4453-8801-46c3ec71ff1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:42.844775 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeffc9df-75d1-4453-8801-46c3ec71ff1f service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:42.859187 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1205/2405] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:46:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:46:43.422488 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5243d64e-80d0-4285-9f6e-1bb279206aec None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:43.424210 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-5243d64e-80d0-4285-9f6e-1bb279206aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:46:43.452378 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5243d64e-80d0-4285-9f6e-1bb279206aec None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:43.465811 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6695337-c5b3-4ca0-9e06-0ce7e5be2bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:43.466491 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6695337-c5b3-4ca0-9e06-0ce7e5be2bdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:43.466786 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6695337-c5b3-4ca0-9e06-0ce7e5be2bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:43.467074 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6695337-c5b3-4ca0-9e06-0ce7e5be2bdb admin admin] PATH_INFO: `/v3/projects/99851ba800ad440491c3e195cf55d66d` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:43.468405 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6695337-c5b3-4ca0-9e06-0ce7e5be2bdb admin admin] RBAC: Authorizing `identity:delete_project(project_id=99851ba800ad440491c3e195cf55d66d)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:43.470382 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6695337-c5b3-4ca0-9e06-0ce7e5be2bdb admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:43.602658 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-e6695337-c5b3-4ca0-9e06-0ce7e5be2bdb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99851ba800ad440491c3e195cf55d66d', 'request_id': 'req-e6695337-c5b3-4ca0-9e06-0ce7e5be2bdb'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:43.618334 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-e6695337-c5b3-4ca0-9e06-0ce7e5be2bdb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99851ba800ad440491c3e195cf55d66d', 'request_id': 'req-e6695337-c5b3-4ca0-9e06-0ce7e5be2bdb'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:43.626047 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-e6695337-c5b3-4ca0-9e06-0ce7e5be2bdb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99851ba800ad440491c3e195cf55d66d', 'request_id': 'req-e6695337-c5b3-4ca0-9e06-0ce7e5be2bdb'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:43.640852 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-e6695337-c5b3-4ca0-9e06-0ce7e5be2bdb admin admin] The token cache is being invalidate because project 99851ba800ad440491c3e195cf55d66d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:46:43.640852 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-e6695337-c5b3-4ca0-9e06-0ce7e5be2bdb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:43.641745 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-e6695337-c5b3-4ca0-9e06-0ce7e5be2bdb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:43.644305 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1201/2406] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Aug 2 21:46:43 2022] DELETE /identity/v3/projects/99851ba800ad440491c3e195cf55d66d => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:46:43.651719 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8390389a-bad9-4d15-8259-c35549ffe7f2 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:43.652299 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8390389a-bad9-4d15-8259-c35549ffe7f2 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:43.652881 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8390389a-bad9-4d15-8259-c35549ffe7f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:43.694400 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-8390389a-bad9-4d15-8259-c35549ffe7f2 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:46:43.695749 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-8390389a-bad9-4d15-8259-c35549ffe7f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:46:43.844824 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1206/2407] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:46:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:46:43.853539 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19951740-ff31-4f41-ba2a-24537320ae2e None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:43.853892 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19951740-ff31-4f41-ba2a-24537320ae2e None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:43.854176 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19951740-ff31-4f41-ba2a-24537320ae2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:43.867211 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:46:43.910258 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-19951740-ff31-4f41-ba2a-24537320ae2e None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:46:43.911677 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-19951740-ff31-4f41-ba2a-24537320ae2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:46:43.921022 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1202/2408] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:46:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:46:43.926502 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8390389a-bad9-4d15-8259-c35549ffe7f2 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:43.942541 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8390389a-bad9-4d15-8259-c35549ffe7f2 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:43.971108 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422f5a1f-3234-4c6a-9bc7-bc5a82e4843d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:43.972788 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422f5a1f-3234-4c6a-9bc7-bc5a82e4843d admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:43.973300 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422f5a1f-3234-4c6a-9bc7-bc5a82e4843d admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:43.973728 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422f5a1f-3234-4c6a-9bc7-bc5a82e4843d admin admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:43.974822 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422f5a1f-3234-4c6a-9bc7-bc5a82e4843d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:46:43.975297 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422f5a1f-3234-4c6a-9bc7-bc5a82e4843d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:43.977103 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422f5a1f-3234-4c6a-9bc7-bc5a82e4843d admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:44.003323 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1207/2409] 10.222.0.70 () {58 vars in 1153 bytes} [Tue Aug 2 21:46:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:46:44.006929 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19951740-ff31-4f41-ba2a-24537320ae2e None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:44.023381 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19951740-ff31-4f41-ba2a-24537320ae2e None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:44.030824 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1a200e-09e4-444f-bcb1-52cc90a2f790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:44.031475 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1a200e-09e4-444f-bcb1-52cc90a2f790 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:44.031761 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1a200e-09e4-444f-bcb1-52cc90a2f790 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:44.032040 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1a200e-09e4-444f-bcb1-52cc90a2f790 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:44.032856 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1a200e-09e4-444f-bcb1-52cc90a2f790 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:44.036314 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1a200e-09e4-444f-bcb1-52cc90a2f790 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:44.096631 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1203/2410] 10.222.0.70 () {60 vars in 1153 bytes} [Tue Aug 2 21:46:44 2022] POST /identity/v3/projects => generated 373 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:46:44.098746 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422f5a1f-3234-4c6a-9bc7-bc5a82e4843d admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:44.115194 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422f5a1f-3234-4c6a-9bc7-bc5a82e4843d admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:44.192545 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:46:44.225183 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19eed00-5240-4b4f-a569-387c14760708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:44.225993 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19eed00-5240-4b4f-a569-387c14760708 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:44.226379 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19eed00-5240-4b4f-a569-387c14760708 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:44.226997 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19eed00-5240-4b4f-a569-387c14760708 admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:44.227796 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19eed00-5240-4b4f-a569-387c14760708 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:44.233362 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19eed00-5240-4b4f-a569-387c14760708 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:44.286761 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1208/2411] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 2 21:46:44 2022] POST /identity/v3/users => generated 287 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:46:44.295643 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1a200e-09e4-444f-bcb1-52cc90a2f790 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:44.318823 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1a200e-09e4-444f-bcb1-52cc90a2f790 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:44.330276 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ec211a-b8ed-4837-9322-719efcf2ecd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:44.330939 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ec211a-b8ed-4837-9322-719efcf2ecd8 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:44.331239 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ec211a-b8ed-4837-9322-719efcf2ecd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:44.331518 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ec211a-b8ed-4837-9322-719efcf2ecd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:44.332578 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ec211a-b8ed-4837-9322-719efcf2ecd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:44.336608 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ec211a-b8ed-4837-9322-719efcf2ecd8 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:44.361513 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1204/2412] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:46:44 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:46:44.366146 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19eed00-5240-4b4f-a569-387c14760708 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:44.405174 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19eed00-5240-4b4f-a569-387c14760708 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:44.415338 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16013f9-ff4f-4ac9-8fc6-bc4a23b733f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:44.417431 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16013f9-ff4f-4ac9-8fc6-bc4a23b733f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:44.418345 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16013f9-ff4f-4ac9-8fc6-bc4a23b733f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:44.418922 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16013f9-ff4f-4ac9-8fc6-bc4a23b733f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:44.419946 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16013f9-ff4f-4ac9-8fc6-bc4a23b733f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:44.422570 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16013f9-ff4f-4ac9-8fc6-bc4a23b733f3 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:44.455241 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1209/2413] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:46:44 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:46:44.459177 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ec211a-b8ed-4837-9322-719efcf2ecd8 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:44.470455 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ec211a-b8ed-4837-9322-719efcf2ecd8 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:44.487243 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669c821f-548e-4c4f-917f-96afbdb47682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:44.487947 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669c821f-548e-4c4f-917f-96afbdb47682 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:44.488262 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669c821f-548e-4c4f-917f-96afbdb47682 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:44.488539 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669c821f-548e-4c4f-917f-96afbdb47682 admin admin] PATH_INFO: `/v3/projects/48162287c38340348025747401b1e920/users/11a2acad8d46400c898e0817bb4f5309/roles/462e3381a85c42a9959201f9aa122f7c` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:44.531253 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669c821f-548e-4c4f-917f-96afbdb47682 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48162287c38340348025747401b1e920, user_id=11a2acad8d46400c898e0817bb4f5309, role_id=462e3381a85c42a9959201f9aa122f7c)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:44.531986 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669c821f-548e-4c4f-917f-96afbdb47682 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:44.577193 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1205/2414] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:46:44 2022] PUT /identity/v3/projects/48162287c38340348025747401b1e920/users/11a2acad8d46400c898e0817bb4f5309/roles/462e3381a85c42a9959201f9aa122f7c => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:46:44.584070 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7135b5b8-ba25-4849-9941-477cbfd9faf7 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:44.584750 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7135b5b8-ba25-4849-9941-477cbfd9faf7 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:44.585267 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7135b5b8-ba25-4849-9941-477cbfd9faf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:44.660312 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-7135b5b8-ba25-4849-9941-477cbfd9faf7 None None] MFA Rules not processed for user `11a2acad8d46400c898e0817bb4f5309`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:46:44.662285 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-7135b5b8-ba25-4849-9941-477cbfd9faf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:46:44.757285 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1210/2415] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:46:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:46:44.769244 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669c821f-548e-4c4f-917f-96afbdb47682 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:44.771736 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-669c821f-548e-4c4f-917f-96afbdb47682 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:46:44.891531 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669c821f-548e-4c4f-917f-96afbdb47682 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:44.897079 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26d4122-616f-4caa-be35-8b73538e5b9e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '123eb76f95ee4e39905944da701c712d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:44.897772 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d4122-616f-4caa-be35-8b73538e5b9e service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:44.898061 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d4122-616f-4caa-be35-8b73538e5b9e service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:44.898438 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d4122-616f-4caa-be35-8b73538e5b9e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:44.910392 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26d4122-616f-4caa-be35-8b73538e5b9e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:44.912103 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26d4122-616f-4caa-be35-8b73538e5b9e service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:44.930446 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1206/2416] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:46:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:46:44.967674 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7135b5b8-ba25-4849-9941-477cbfd9faf7 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:44.969176 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-7135b5b8-ba25-4849-9941-477cbfd9faf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:46:45.064103 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7135b5b8-ba25-4849-9941-477cbfd9faf7 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:45.070008 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceee083-1575-4642-8f7b-64c3f0e716b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:45.070680 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceee083-1575-4642-8f7b-64c3f0e716b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:45.070959 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceee083-1575-4642-8f7b-64c3f0e716b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:45.071241 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ceee083-1575-4642-8f7b-64c3f0e716b9 admin admin] PATH_INFO: `/v3/users/4ef0895d195b463688f59525e075dcbc` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:45.073129 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceee083-1575-4642-8f7b-64c3f0e716b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ef0895d195b463688f59525e075dcbc)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:45.075323 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ceee083-1575-4642-8f7b-64c3f0e716b9 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:45.174971 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-1ceee083-1575-4642-8f7b-64c3f0e716b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ef0895d195b463688f59525e075dcbc'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:45.180650 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:46:45.201968 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-1ceee083-1575-4642-8f7b-64c3f0e716b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ef0895d195b463688f59525e075dcbc'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:45.227379 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-1ceee083-1575-4642-8f7b-64c3f0e716b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ef0895d195b463688f59525e075dcbc'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:45.239848 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-1ceee083-1575-4642-8f7b-64c3f0e716b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ef0895d195b463688f59525e075dcbc'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:45.240747 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-1ceee083-1575-4642-8f7b-64c3f0e716b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ef0895d195b463688f59525e075dcbc'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:45.251730 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1211/2417] 10.222.0.70 () {58 vars in 1224 bytes} [Tue Aug 2 21:46:44 2022] DELETE /identity/v3/users/4ef0895d195b463688f59525e075dcbc => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:46:45.485261 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26d4122-616f-4caa-be35-8b73538e5b9e service cinder] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:45.502095 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26d4122-616f-4caa-be35-8b73538e5b9e service cinder] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:45.585495 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20770bcd-bbff-42aa-9ca8-89d2ef41e996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:45.586155 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20770bcd-bbff-42aa-9ca8-89d2ef41e996 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:45.586547 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20770bcd-bbff-42aa-9ca8-89d2ef41e996 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:45.586825 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20770bcd-bbff-42aa-9ca8-89d2ef41e996 admin admin] PATH_INFO: `/v3/projects/e113381d9819474198c261274e679da2` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:45.588074 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20770bcd-bbff-42aa-9ca8-89d2ef41e996 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e113381d9819474198c261274e679da2)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:45.590115 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20770bcd-bbff-42aa-9ca8-89d2ef41e996 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:45.655004 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:46:45.656658 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-20770bcd-bbff-42aa-9ca8-89d2ef41e996 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e113381d9819474198c261274e679da2', 'request_id': 'req-20770bcd-bbff-42aa-9ca8-89d2ef41e996'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:45.666843 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-20770bcd-bbff-42aa-9ca8-89d2ef41e996 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e113381d9819474198c261274e679da2', 'request_id': 'req-20770bcd-bbff-42aa-9ca8-89d2ef41e996'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:45.677914 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-20770bcd-bbff-42aa-9ca8-89d2ef41e996 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e113381d9819474198c261274e679da2', 'request_id': 'req-20770bcd-bbff-42aa-9ca8-89d2ef41e996'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:45.692960 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-20770bcd-bbff-42aa-9ca8-89d2ef41e996 admin admin] The token cache is being invalidate because project e113381d9819474198c261274e679da2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:46:45.693491 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-20770bcd-bbff-42aa-9ca8-89d2ef41e996 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:45.694407 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-20770bcd-bbff-42aa-9ca8-89d2ef41e996 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:45.696609 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1207/2418] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Aug 2 21:46:45 2022] DELETE /identity/v3/projects/e113381d9819474198c261274e679da2 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:46:45.701155 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceee083-1575-4642-8f7b-64c3f0e716b9 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:45.702894 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-1ceee083-1575-4642-8f7b-64c3f0e716b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:46:45.725100 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ceee083-1575-4642-8f7b-64c3f0e716b9 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:45.807270 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5837a86c-5c16-4901-a5bd-3f87dbefb275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:45.807971 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5837a86c-5c16-4901-a5bd-3f87dbefb275 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:45.808284 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5837a86c-5c16-4901-a5bd-3f87dbefb275 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:45.808568 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5837a86c-5c16-4901-a5bd-3f87dbefb275 admin admin] PATH_INFO: `/v3/users/3a788f50faaf4259a5c7e178a1b68330` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:45.809784 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5837a86c-5c16-4901-a5bd-3f87dbefb275 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a788f50faaf4259a5c7e178a1b68330)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:45.811840 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5837a86c-5c16-4901-a5bd-3f87dbefb275 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:45.863108 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-5837a86c-5c16-4901-a5bd-3f87dbefb275 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a788f50faaf4259a5c7e178a1b68330'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:45.877257 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-5837a86c-5c16-4901-a5bd-3f87dbefb275 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a788f50faaf4259a5c7e178a1b68330'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:45.892725 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-5837a86c-5c16-4901-a5bd-3f87dbefb275 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a788f50faaf4259a5c7e178a1b68330'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:45.908171 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-5837a86c-5c16-4901-a5bd-3f87dbefb275 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a788f50faaf4259a5c7e178a1b68330'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:45.909392 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-5837a86c-5c16-4901-a5bd-3f87dbefb275 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a788f50faaf4259a5c7e178a1b68330'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:45.918979 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1212/2419] 10.222.0.70 () {58 vars in 1224 bytes} [Tue Aug 2 21:46:45 2022] DELETE /identity/v3/users/3a788f50faaf4259a5c7e178a1b68330 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:46:46.102323 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20770bcd-bbff-42aa-9ca8-89d2ef41e996 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:46.104055 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-20770bcd-bbff-42aa-9ca8-89d2ef41e996 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:46:46.118870 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20770bcd-bbff-42aa-9ca8-89d2ef41e996 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:46.186919 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe17f7e-fac2-43e6-9253-a233f234ad9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:46.187609 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe17f7e-fac2-43e6-9253-a233f234ad9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:46.187890 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe17f7e-fac2-43e6-9253-a233f234ad9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:46.188184 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe17f7e-fac2-43e6-9253-a233f234ad9e admin admin] PATH_INFO: `/v3/projects/75dc6be64dd342f29692aec7d4e3b670` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:46.189610 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe17f7e-fac2-43e6-9253-a233f234ad9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=75dc6be64dd342f29692aec7d4e3b670)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:46.191593 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe17f7e-fac2-43e6-9253-a233f234ad9e admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:46.242409 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-0fe17f7e-fac2-43e6-9253-a233f234ad9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75dc6be64dd342f29692aec7d4e3b670', 'request_id': 'req-0fe17f7e-fac2-43e6-9253-a233f234ad9e'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:46.249279 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-0fe17f7e-fac2-43e6-9253-a233f234ad9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75dc6be64dd342f29692aec7d4e3b670', 'request_id': 'req-0fe17f7e-fac2-43e6-9253-a233f234ad9e'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:46.255216 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-0fe17f7e-fac2-43e6-9253-a233f234ad9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75dc6be64dd342f29692aec7d4e3b670', 'request_id': 'req-0fe17f7e-fac2-43e6-9253-a233f234ad9e'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:46.266466 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-0fe17f7e-fac2-43e6-9253-a233f234ad9e admin admin] The token cache is being invalidate because project 75dc6be64dd342f29692aec7d4e3b670 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:46:46.266805 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-0fe17f7e-fac2-43e6-9253-a233f234ad9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:46.267418 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-0fe17f7e-fac2-43e6-9253-a233f234ad9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:46.269521 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1208/2420] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Aug 2 21:46:46 2022] DELETE /identity/v3/projects/75dc6be64dd342f29692aec7d4e3b670 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:46:48.160979 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5837a86c-5c16-4901-a5bd-3f87dbefb275 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:48.162441 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-5837a86c-5c16-4901-a5bd-3f87dbefb275 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:46:48.175717 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5837a86c-5c16-4901-a5bd-3f87dbefb275 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:48.217511 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:46:48.234107 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15568ff8-02ec-4b75-88af-73f7b573de6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:48.234750 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15568ff8-02ec-4b75-88af-73f7b573de6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:48.235036 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15568ff8-02ec-4b75-88af-73f7b573de6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:48.235315 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15568ff8-02ec-4b75-88af-73f7b573de6e admin admin] PATH_INFO: `/v3/users/11a2acad8d46400c898e0817bb4f5309` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:48.236499 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15568ff8-02ec-4b75-88af-73f7b573de6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=11a2acad8d46400c898e0817bb4f5309)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:48.239187 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15568ff8-02ec-4b75-88af-73f7b573de6e admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:48.282704 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-15568ff8-02ec-4b75-88af-73f7b573de6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11a2acad8d46400c898e0817bb4f5309'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:48.293198 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-15568ff8-02ec-4b75-88af-73f7b573de6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11a2acad8d46400c898e0817bb4f5309'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:48.306165 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-15568ff8-02ec-4b75-88af-73f7b573de6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11a2acad8d46400c898e0817bb4f5309'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:48.313016 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-15568ff8-02ec-4b75-88af-73f7b573de6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11a2acad8d46400c898e0817bb4f5309'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:48.313675 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-15568ff8-02ec-4b75-88af-73f7b573de6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11a2acad8d46400c898e0817bb4f5309'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:48.320022 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1213/2421] 10.222.0.70 () {58 vars in 1224 bytes} [Tue Aug 2 21:46:48 2022] DELETE /identity/v3/users/11a2acad8d46400c898e0817bb4f5309 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:46:48.324435 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f76420-c31e-435e-81c3-c4bd57ebea0d None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:48.324907 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f76420-c31e-435e-81c3-c4bd57ebea0d None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:48.325004 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f76420-c31e-435e-81c3-c4bd57ebea0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:48.344165 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-77f76420-c31e-435e-81c3-c4bd57ebea0d None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:46:48.345416 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-77f76420-c31e-435e-81c3-c4bd57ebea0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:46:48.403528 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1209/2422] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:46:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:46:48.413210 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15568ff8-02ec-4b75-88af-73f7b573de6e admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:48.414613 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-15568ff8-02ec-4b75-88af-73f7b573de6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:46:48.470745 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15568ff8-02ec-4b75-88af-73f7b573de6e admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:48.474404 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1e00d1-a4f6-4c2c-a511-259969313542 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '723f5f43572a493dae0349070a2adb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:48.475015 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1e00d1-a4f6-4c2c-a511-259969313542 service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:48.475300 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1e00d1-a4f6-4c2c-a511-259969313542 service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:48.475578 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1e00d1-a4f6-4c2c-a511-259969313542 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:48.485063 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1e00d1-a4f6-4c2c-a511-259969313542 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:48.486493 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1e00d1-a4f6-4c2c-a511-259969313542 service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:48.496371 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1214/2423] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:46:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:46:48.872844 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f76420-c31e-435e-81c3-c4bd57ebea0d None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:48.874289 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-77f76420-c31e-435e-81c3-c4bd57ebea0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:46:48.883747 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:46:48.887811 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f76420-c31e-435e-81c3-c4bd57ebea0d None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:48.895189 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2056f547-12d8-459c-bfa4-e5796dd4df18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:48.896597 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2056f547-12d8-459c-bfa4-e5796dd4df18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:48.897140 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2056f547-12d8-459c-bfa4-e5796dd4df18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:48.897505 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2056f547-12d8-459c-bfa4-e5796dd4df18 admin admin] PATH_INFO: `/v3/projects/48162287c38340348025747401b1e920` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:48.899031 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2056f547-12d8-459c-bfa4-e5796dd4df18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48162287c38340348025747401b1e920)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:48.901107 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2056f547-12d8-459c-bfa4-e5796dd4df18 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:48.952171 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-2056f547-12d8-459c-bfa4-e5796dd4df18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48162287c38340348025747401b1e920', 'request_id': 'req-2056f547-12d8-459c-bfa4-e5796dd4df18'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:48.961567 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-2056f547-12d8-459c-bfa4-e5796dd4df18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48162287c38340348025747401b1e920', 'request_id': 'req-2056f547-12d8-459c-bfa4-e5796dd4df18'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:48.967623 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-2056f547-12d8-459c-bfa4-e5796dd4df18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48162287c38340348025747401b1e920', 'request_id': 'req-2056f547-12d8-459c-bfa4-e5796dd4df18'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:48.979779 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-2056f547-12d8-459c-bfa4-e5796dd4df18 admin admin] The token cache is being invalidate because project 48162287c38340348025747401b1e920 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:46:48.980070 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-2056f547-12d8-459c-bfa4-e5796dd4df18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:48.980799 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-2056f547-12d8-459c-bfa4-e5796dd4df18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:46:48.996645 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1210/2424] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Aug 2 21:46:48 2022] DELETE /identity/v3/projects/48162287c38340348025747401b1e920 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:46:50.185324 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1e00d1-a4f6-4c2c-a511-259969313542 service neutron] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:50.186927 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-0d1e00d1-a4f6-4c2c-a511-259969313542 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:46:50.255210 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:46:50.260132 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1e00d1-a4f6-4c2c-a511-259969313542 service neutron] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:50.329954 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de43d6ee-f71b-45dd-af93-dcb9bdecf1a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87dd5c1c5e854d4b96e0b7dad6aa3719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:50.331161 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de43d6ee-f71b-45dd-af93-dcb9bdecf1a4 service nova] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:50.331447 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de43d6ee-f71b-45dd-af93-dcb9bdecf1a4 service nova] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:50.331723 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de43d6ee-f71b-45dd-af93-dcb9bdecf1a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:50.333536 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-de43d6ee-f71b-45dd-af93-dcb9bdecf1a4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:46:50.390145 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de43d6ee-f71b-45dd-af93-dcb9bdecf1a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:50.391673 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de43d6ee-f71b-45dd-af93-dcb9bdecf1a4 service nova] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:50.401476 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1215/2425] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:46:50 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:46:50.817777 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2056f547-12d8-459c-bfa4-e5796dd4df18 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:50.822144 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-2056f547-12d8-459c-bfa4-e5796dd4df18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:46:50.841070 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2056f547-12d8-459c-bfa4-e5796dd4df18 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:50.849589 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417d714a-3aa1-45c7-bb7a-e125260d467e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87dd5c1c5e854d4b96e0b7dad6aa3719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:50.850246 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417d714a-3aa1-45c7-bb7a-e125260d467e service nova] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:50.850473 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417d714a-3aa1-45c7-bb7a-e125260d467e service nova] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:50.850900 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417d714a-3aa1-45c7-bb7a-e125260d467e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:50.854795 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-417d714a-3aa1-45c7-bb7a-e125260d467e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:46:50.868683 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417d714a-3aa1-45c7-bb7a-e125260d467e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:50.870359 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417d714a-3aa1-45c7-bb7a-e125260d467e service nova] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:50.896684 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1211/2426] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:46:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:46:52.479878 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd4e52-601e-4690-8c94-4b4a26c9430e None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:52.480366 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd4e52-601e-4690-8c94-4b4a26c9430e None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:52.480492 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cd4e52-601e-4690-8c94-4b4a26c9430e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:52.501280 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-27cd4e52-601e-4690-8c94-4b4a26c9430e None None] MFA Rules not processed for user `6be7b2bcfebd45389ca289c34fbabc3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:46:52.503106 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-27cd4e52-601e-4690-8c94-4b4a26c9430e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:46:52.559386 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1216/2427] 10.222.0.70 () {58 vars in 967 bytes} [Tue Aug 2 21:46:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:46:52.571491 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417d714a-3aa1-45c7-bb7a-e125260d467e service nova] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:52.572908 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-417d714a-3aa1-45c7-bb7a-e125260d467e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:46:52.644516 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417d714a-3aa1-45c7-bb7a-e125260d467e service nova] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:52.649452 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269a37ca-2070-4de5-bbfd-a993ebc90d7f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee7ebf40212465aac997b461a2d10fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:52.650074 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269a37ca-2070-4de5-bbfd-a993ebc90d7f service swift] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:52.650361 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269a37ca-2070-4de5-bbfd-a993ebc90d7f service swift] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:52.650647 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269a37ca-2070-4de5-bbfd-a993ebc90d7f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:52.659401 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269a37ca-2070-4de5-bbfd-a993ebc90d7f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:52.661082 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269a37ca-2070-4de5-bbfd-a993ebc90d7f service swift] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:52.669147 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1212/2428] 10.222.0.70 () {60 vars in 1384 bytes} [Tue Aug 2 21:46:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 02 21:46:58.875604 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cd4e52-601e-4690-8c94-4b4a26c9430e None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:46:58.877285 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-27cd4e52-601e-4690-8c94-4b4a26c9430e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:46:58.895708 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cd4e52-601e-4690-8c94-4b4a26c9430e None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:46:58.902127 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63390267-3157-4c7c-aa82-dfb2a1cda07b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87dd5c1c5e854d4b96e0b7dad6aa3719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:46:58.902852 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63390267-3157-4c7c-aa82-dfb2a1cda07b service nova] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:46:58.903168 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63390267-3157-4c7c-aa82-dfb2a1cda07b service nova] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:46:58.903447 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63390267-3157-4c7c-aa82-dfb2a1cda07b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:46:58.905748 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-63390267-3157-4c7c-aa82-dfb2a1cda07b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:46:58.920707 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63390267-3157-4c7c-aa82-dfb2a1cda07b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:46:58.922608 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63390267-3157-4c7c-aa82-dfb2a1cda07b service nova] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:46:58.935725 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1217/2429] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:46:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:47:02.666014 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=63,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:06.312039 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269a37ca-2070-4de5-bbfd-a993ebc90d7f service swift] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:06.313516 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-269a37ca-2070-4de5-bbfd-a993ebc90d7f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:06.372342 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269a37ca-2070-4de5-bbfd-a993ebc90d7f service swift] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:06.375926 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49716973-7105-4229-b435-7a239118b9e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '723f5f43572a493dae0349070a2adb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:06.376573 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49716973-7105-4229-b435-7a239118b9e7 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:06.376865 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49716973-7105-4229-b435-7a239118b9e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:06.377747 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49716973-7105-4229-b435-7a239118b9e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:06.379512 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-49716973-7105-4229-b435-7a239118b9e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:06.443085 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49716973-7105-4229-b435-7a239118b9e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:06.444578 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49716973-7105-4229-b435-7a239118b9e7 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:06.454205 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1213/2430] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:47:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:47:08.420758 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63390267-3157-4c7c-aa82-dfb2a1cda07b service nova] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:08.423053 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-63390267-3157-4c7c-aa82-dfb2a1cda07b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:08.436365 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63390267-3157-4c7c-aa82-dfb2a1cda07b service nova] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:08.440775 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b49590-cf07-4fdf-933a-16513fab50e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '723f5f43572a493dae0349070a2adb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:08.441567 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b49590-cf07-4fdf-933a-16513fab50e8 service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:08.441953 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b49590-cf07-4fdf-933a-16513fab50e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:08.442486 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b49590-cf07-4fdf-933a-16513fab50e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:08.444589 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-80b49590-cf07-4fdf-933a-16513fab50e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:08.463103 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b49590-cf07-4fdf-933a-16513fab50e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:08.465871 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b49590-cf07-4fdf-933a-16513fab50e8 service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:08.479140 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1218/2431] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:47:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:47:09.537860 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49716973-7105-4229-b435-7a239118b9e7 service neutron] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:09.539453 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-49716973-7105-4229-b435-7a239118b9e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:09.557476 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49716973-7105-4229-b435-7a239118b9e7 service neutron] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:09.563785 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec4e639-7e1c-48f0-a67c-3ce007d3c41b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:09.565208 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec4e639-7e1c-48f0-a67c-3ce007d3c41b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:09.565561 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec4e639-7e1c-48f0-a67c-3ce007d3c41b admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:09.565915 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec4e639-7e1c-48f0-a67c-3ce007d3c41b admin admin] PATH_INFO: `/v3/users/182daeeee91b4594b4eab1c28cba5067` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:09.571270 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec4e639-7e1c-48f0-a67c-3ce007d3c41b admin admin] RBAC: Authorizing `identity:delete_user(user_id=182daeeee91b4594b4eab1c28cba5067)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:09.573391 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec4e639-7e1c-48f0-a67c-3ce007d3c41b admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:09.651143 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-6ec4e639-7e1c-48f0-a67c-3ce007d3c41b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '182daeeee91b4594b4eab1c28cba5067'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:09.664383 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-6ec4e639-7e1c-48f0-a67c-3ce007d3c41b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '182daeeee91b4594b4eab1c28cba5067'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:09.688153 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-6ec4e639-7e1c-48f0-a67c-3ce007d3c41b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '182daeeee91b4594b4eab1c28cba5067'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:09.688952 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-6ec4e639-7e1c-48f0-a67c-3ce007d3c41b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '182daeeee91b4594b4eab1c28cba5067'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:09.699947 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-6ec4e639-7e1c-48f0-a67c-3ce007d3c41b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '182daeeee91b4594b4eab1c28cba5067'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:09.713586 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1214/2432] 10.222.0.70 () {58 vars in 1224 bytes} [Tue Aug 2 21:47:09 2022] DELETE /identity/v3/users/182daeeee91b4594b4eab1c28cba5067 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:47:09.895462 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b49590-cf07-4fdf-933a-16513fab50e8 service neutron] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:09.906119 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b49590-cf07-4fdf-933a-16513fab50e8 service neutron] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:09.925517 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:09.968895 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2863c4-fd06-47c5-a553-dee0fec22303 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:09.969546 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2863c4-fd06-47c5-a553-dee0fec22303 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:09.969834 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2863c4-fd06-47c5-a553-dee0fec22303 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:09.970114 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2863c4-fd06-47c5-a553-dee0fec22303 admin admin] PATH_INFO: `/v3/projects/fb128c47ae8445598a9979588c57381a` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:09.971367 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2863c4-fd06-47c5-a553-dee0fec22303 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb128c47ae8445598a9979588c57381a)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:09.973331 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2863c4-fd06-47c5-a553-dee0fec22303 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:10.021690 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-9f2863c4-fd06-47c5-a553-dee0fec22303 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb128c47ae8445598a9979588c57381a', 'request_id': 'req-9f2863c4-fd06-47c5-a553-dee0fec22303'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:10.028096 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-9f2863c4-fd06-47c5-a553-dee0fec22303 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb128c47ae8445598a9979588c57381a', 'request_id': 'req-9f2863c4-fd06-47c5-a553-dee0fec22303'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:10.049819 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-9f2863c4-fd06-47c5-a553-dee0fec22303 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb128c47ae8445598a9979588c57381a', 'request_id': 'req-9f2863c4-fd06-47c5-a553-dee0fec22303'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:10.063444 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-9f2863c4-fd06-47c5-a553-dee0fec22303 admin admin] The token cache is being invalidate because project fb128c47ae8445598a9979588c57381a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:47:10.063743 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-9f2863c4-fd06-47c5-a553-dee0fec22303 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:10.064434 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-9f2863c4-fd06-47c5-a553-dee0fec22303 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:10.066541 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1219/2433] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Aug 2 21:47:09 2022] DELETE /identity/v3/projects/fb128c47ae8445598a9979588c57381a => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:47:10.071686 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194915c5-fd18-4723-9fc6-c6917d9dec43 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:10.072104 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194915c5-fd18-4723-9fc6-c6917d9dec43 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:10.072482 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194915c5-fd18-4723-9fc6-c6917d9dec43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:10.095003 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-194915c5-fd18-4723-9fc6-c6917d9dec43 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:47:10.096305 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-194915c5-fd18-4723-9fc6-c6917d9dec43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:10.117179 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:10.173334 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1215/2434] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:47:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:47:10.183332 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa53f29-eebf-4c39-8d6c-73d4857a6374 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:10.183775 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa53f29-eebf-4c39-8d6c-73d4857a6374 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:10.184316 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa53f29-eebf-4c39-8d6c-73d4857a6374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:10.209737 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-caa53f29-eebf-4c39-8d6c-73d4857a6374 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:47:10.211210 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-caa53f29-eebf-4c39-8d6c-73d4857a6374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:10.222830 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1220/2435] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:47:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:47:10.229348 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194915c5-fd18-4723-9fc6-c6917d9dec43 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:10.240623 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194915c5-fd18-4723-9fc6-c6917d9dec43 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:10.246030 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0676e17b-4a75-40dd-bfe3-50fef5bed578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:10.246851 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0676e17b-4a75-40dd-bfe3-50fef5bed578 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:10.247130 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0676e17b-4a75-40dd-bfe3-50fef5bed578 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:10.247583 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0676e17b-4a75-40dd-bfe3-50fef5bed578 admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:10.248318 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0676e17b-4a75-40dd-bfe3-50fef5bed578 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:47:10.248684 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0676e17b-4a75-40dd-bfe3-50fef5bed578 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:10.250494 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0676e17b-4a75-40dd-bfe3-50fef5bed578 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:10.267836 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1216/2436] 10.222.0.70 () {58 vars in 1153 bytes} [Tue Aug 2 21:47:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:47:10.273395 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa53f29-eebf-4c39-8d6c-73d4857a6374 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:10.292259 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa53f29-eebf-4c39-8d6c-73d4857a6374 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:10.297252 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce845ec-63d5-49a0-b142-cfcbe255ee09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:10.298221 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce845ec-63d5-49a0-b142-cfcbe255ee09 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:10.298680 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce845ec-63d5-49a0-b142-cfcbe255ee09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:10.299773 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce845ec-63d5-49a0-b142-cfcbe255ee09 admin admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:10.300979 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce845ec-63d5-49a0-b142-cfcbe255ee09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:10.303086 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce845ec-63d5-49a0-b142-cfcbe255ee09 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:10.339798 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1221/2437] 10.222.0.70 () {60 vars in 1153 bytes} [Tue Aug 2 21:47:10 2022] POST /identity/v3/projects => generated 357 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:47:10.340391 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0676e17b-4a75-40dd-bfe3-50fef5bed578 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:10.351510 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0676e17b-4a75-40dd-bfe3-50fef5bed578 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:10.417663 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12329940-f3fa-4b1e-ae34-d691499c323a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:10.418510 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12329940-f3fa-4b1e-ae34-d691499c323a admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:10.418638 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12329940-f3fa-4b1e-ae34-d691499c323a admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:10.418963 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12329940-f3fa-4b1e-ae34-d691499c323a admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:10.419632 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12329940-f3fa-4b1e-ae34-d691499c323a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:10.422039 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12329940-f3fa-4b1e-ae34-d691499c323a admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:10.448937 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1217/2438] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 2 21:47:10 2022] POST /identity/v3/users => generated 279 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:47:10.452857 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce845ec-63d5-49a0-b142-cfcbe255ee09 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:10.463706 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce845ec-63d5-49a0-b142-cfcbe255ee09 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:10.469340 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf7709e-7803-481f-80fe-8823f9b299b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:10.470127 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf7709e-7803-481f-80fe-8823f9b299b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:10.470428 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf7709e-7803-481f-80fe-8823f9b299b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:10.470706 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf7709e-7803-481f-80fe-8823f9b299b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:10.471566 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf7709e-7803-481f-80fe-8823f9b299b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:10.473254 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf7709e-7803-481f-80fe-8823f9b299b5 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:10.492155 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1222/2439] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:47:10 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:47:10.493450 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12329940-f3fa-4b1e-ae34-d691499c323a admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:10.505134 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12329940-f3fa-4b1e-ae34-d691499c323a admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:10.510135 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21afe05a-cf57-44a7-aefd-17adc75e2a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:10.510805 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21afe05a-cf57-44a7-aefd-17adc75e2a1d admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:10.511090 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21afe05a-cf57-44a7-aefd-17adc75e2a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:10.511365 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21afe05a-cf57-44a7-aefd-17adc75e2a1d admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:10.512168 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21afe05a-cf57-44a7-aefd-17adc75e2a1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:10.513840 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21afe05a-cf57-44a7-aefd-17adc75e2a1d admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:10.529978 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1218/2440] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:47:10 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 21:47:10.531844 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf7709e-7803-481f-80fe-8823f9b299b5 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:10.544790 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf7709e-7803-481f-80fe-8823f9b299b5 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:10.552381 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8a0fde-d197-489c-abb3-0d49503ca717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:10.553090 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8a0fde-d197-489c-abb3-0d49503ca717 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:10.553376 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8a0fde-d197-489c-abb3-0d49503ca717 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:10.553656 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8a0fde-d197-489c-abb3-0d49503ca717 admin admin] PATH_INFO: `/v3/projects/42f45c7eee9c4dfa9eedb2775592fb95/users/2366d8628b994148830c701939160a61/roles/462e3381a85c42a9959201f9aa122f7c` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:10.571635 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8a0fde-d197-489c-abb3-0d49503ca717 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42f45c7eee9c4dfa9eedb2775592fb95, user_id=2366d8628b994148830c701939160a61, role_id=462e3381a85c42a9959201f9aa122f7c)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:10.574595 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8a0fde-d197-489c-abb3-0d49503ca717 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:10.597097 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1223/2441] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:47:10 2022] PUT /identity/v3/projects/42f45c7eee9c4dfa9eedb2775592fb95/users/2366d8628b994148830c701939160a61/roles/462e3381a85c42a9959201f9aa122f7c => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:47:10.609430 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0ab030-a18b-4e5c-b5d3-77b403531f7c None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:10.609862 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0ab030-a18b-4e5c-b5d3-77b403531f7c None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:10.610018 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0ab030-a18b-4e5c-b5d3-77b403531f7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:10.645138 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-3d0ab030-a18b-4e5c-b5d3-77b403531f7c None None] MFA Rules not processed for user `2366d8628b994148830c701939160a61`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:47:10.646371 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-3d0ab030-a18b-4e5c-b5d3-77b403531f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:10.713147 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1219/2442] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:47:10 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:47:10.717680 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8a0fde-d197-489c-abb3-0d49503ca717 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:10.765518 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:10.782090 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8a0fde-d197-489c-abb3-0d49503ca717 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:10.787467 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb873a9c-38e1-4ee5-9b0d-0a1056b42267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:10.788090 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb873a9c-38e1-4ee5-9b0d-0a1056b42267 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:10.788476 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb873a9c-38e1-4ee5-9b0d-0a1056b42267 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:10.788789 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb873a9c-38e1-4ee5-9b0d-0a1056b42267 admin admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:10.789520 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb873a9c-38e1-4ee5-9b0d-0a1056b42267 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:10.791620 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb873a9c-38e1-4ee5-9b0d-0a1056b42267 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:10.822273 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1224/2443] 10.222.0.70 () {60 vars in 1153 bytes} [Tue Aug 2 21:47:10 2022] POST /identity/v3/projects => generated 355 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 21:47:10.823583 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0ab030-a18b-4e5c-b5d3-77b403531f7c None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:10.835918 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0ab030-a18b-4e5c-b5d3-77b403531f7c None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:10.850164 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:10.899260 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87918cd0-f9a7-4609-b6be-e4e426f8bcf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:10.899897 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87918cd0-f9a7-4609-b6be-e4e426f8bcf1 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:10.900185 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87918cd0-f9a7-4609-b6be-e4e426f8bcf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:10.900497 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87918cd0-f9a7-4609-b6be-e4e426f8bcf1 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:10.901171 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87918cd0-f9a7-4609-b6be-e4e426f8bcf1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:10.903129 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87918cd0-f9a7-4609-b6be-e4e426f8bcf1 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:10.939871 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1220/2444] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 2 21:47:10 2022] POST /identity/v3/users => generated 284 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:47:10.944989 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb873a9c-38e1-4ee5-9b0d-0a1056b42267 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:10.958141 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb873a9c-38e1-4ee5-9b0d-0a1056b42267 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:10.963108 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ee906c-535b-40cd-8a95-c4a7f02d41e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:10.963830 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ee906c-535b-40cd-8a95-c4a7f02d41e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:10.964186 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ee906c-535b-40cd-8a95-c4a7f02d41e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:10.964564 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ee906c-535b-40cd-8a95-c4a7f02d41e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:10.965336 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ee906c-535b-40cd-8a95-c4a7f02d41e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:10.967207 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ee906c-535b-40cd-8a95-c4a7f02d41e7 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:10.980817 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1225/2445] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:47:10 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:47:10.985128 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87918cd0-f9a7-4609-b6be-e4e426f8bcf1 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:10.995424 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87918cd0-f9a7-4609-b6be-e4e426f8bcf1 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:11.002072 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18d5a13-6f7d-4c9c-85d3-f75e2d744957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:11.002761 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d5a13-6f7d-4c9c-85d3-f75e2d744957 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:11.003051 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d5a13-6f7d-4c9c-85d3-f75e2d744957 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:11.003405 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d5a13-6f7d-4c9c-85d3-f75e2d744957 admin admin] PATH_INFO: `/v3/projects/7e6ee763ae3b486f85f352d62d676fe5/users/37d428a529f8416eaba0d42f5bc8b273/roles/3e32dbf75f9b41f5adb9fe59851267bb` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:11.022063 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18d5a13-6f7d-4c9c-85d3-f75e2d744957 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e6ee763ae3b486f85f352d62d676fe5, user_id=37d428a529f8416eaba0d42f5bc8b273, role_id=3e32dbf75f9b41f5adb9fe59851267bb)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:11.025086 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18d5a13-6f7d-4c9c-85d3-f75e2d744957 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:11.046388 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1221/2446] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:47:10 2022] PUT /identity/v3/projects/7e6ee763ae3b486f85f352d62d676fe5/users/37d428a529f8416eaba0d42f5bc8b273/roles/3e32dbf75f9b41f5adb9fe59851267bb => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:47:11.047957 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ee906c-535b-40cd-8a95-c4a7f02d41e7 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:11.058874 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ee906c-535b-40cd-8a95-c4a7f02d41e7 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:11.123888 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7041c476-6753-4c1e-9448-0a723007174b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:11.124546 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7041c476-6753-4c1e-9448-0a723007174b admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:11.124835 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7041c476-6753-4c1e-9448-0a723007174b admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:11.125109 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7041c476-6753-4c1e-9448-0a723007174b admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:11.126553 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7041c476-6753-4c1e-9448-0a723007174b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:11.128756 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7041c476-6753-4c1e-9448-0a723007174b admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:11.139745 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1226/2447] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:47:11 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:47:11.144635 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18d5a13-6f7d-4c9c-85d3-f75e2d744957 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:11.154963 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18d5a13-6f7d-4c9c-85d3-f75e2d744957 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:11.160253 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e3d8dc-8e16-4515-b78d-d8c275155823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:11.160935 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e3d8dc-8e16-4515-b78d-d8c275155823 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:11.161218 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e3d8dc-8e16-4515-b78d-d8c275155823 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:11.161496 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e3d8dc-8e16-4515-b78d-d8c275155823 admin admin] PATH_INFO: `/v3/projects/7e6ee763ae3b486f85f352d62d676fe5/users/37d428a529f8416eaba0d42f5bc8b273/roles/3e32dbf75f9b41f5adb9fe59851267bb` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:11.163451 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e3d8dc-8e16-4515-b78d-d8c275155823 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e6ee763ae3b486f85f352d62d676fe5, user_id=37d428a529f8416eaba0d42f5bc8b273, role_id=3e32dbf75f9b41f5adb9fe59851267bb)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:11.166200 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e3d8dc-8e16-4515-b78d-d8c275155823 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:11.176674 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1222/2448] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:47:11 2022] PUT /identity/v3/projects/7e6ee763ae3b486f85f352d62d676fe5/users/37d428a529f8416eaba0d42f5bc8b273/roles/3e32dbf75f9b41f5adb9fe59851267bb => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:47:11.187068 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15722fb-5211-4528-8a0a-de29434441a6 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:11.187359 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15722fb-5211-4528-8a0a-de29434441a6 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:11.187641 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15722fb-5211-4528-8a0a-de29434441a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:11.217422 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-e15722fb-5211-4528-8a0a-de29434441a6 None None] MFA Rules not processed for user `37d428a529f8416eaba0d42f5bc8b273`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:47:11.218656 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-e15722fb-5211-4528-8a0a-de29434441a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:11.296367 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1227/2449] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:47:11 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:47:11.306108 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e3d8dc-8e16-4515-b78d-d8c275155823 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:11.307862 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-f8e3d8dc-8e16-4515-b78d-d8c275155823 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:11.388586 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e3d8dc-8e16-4515-b78d-d8c275155823 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:11.406669 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c28b0f-e711-4e05-8b92-f03bb15b87dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '123eb76f95ee4e39905944da701c712d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:11.407326 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c28b0f-e711-4e05-8b92-f03bb15b87dd service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:11.407600 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c28b0f-e711-4e05-8b92-f03bb15b87dd service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:11.407881 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c28b0f-e711-4e05-8b92-f03bb15b87dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:11.425334 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c28b0f-e711-4e05-8b92-f03bb15b87dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:11.427089 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c28b0f-e711-4e05-8b92-f03bb15b87dd service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:11.446806 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1223/2450] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:47:11 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:47:11.545306 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15722fb-5211-4528-8a0a-de29434441a6 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:11.559370 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15722fb-5211-4528-8a0a-de29434441a6 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:11.567158 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bb6e10-a00a-479a-8410-0c7078b4bd44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '123eb76f95ee4e39905944da701c712d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:11.567983 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bb6e10-a00a-479a-8410-0c7078b4bd44 service cinder] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:11.568387 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bb6e10-a00a-479a-8410-0c7078b4bd44 service cinder] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:11.568667 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bb6e10-a00a-479a-8410-0c7078b4bd44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:11.637328 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:11.658532 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bb6e10-a00a-479a-8410-0c7078b4bd44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:11.660051 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bb6e10-a00a-479a-8410-0c7078b4bd44 service cinder] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:11.669912 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1228/2451] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:47:11 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:47:12.019181 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c28b0f-e711-4e05-8b92-f03bb15b87dd service cinder] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:12.020699 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-37c28b0f-e711-4e05-8b92-f03bb15b87dd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:12.096649 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c28b0f-e711-4e05-8b92-f03bb15b87dd service cinder] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:12.101146 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafe1a88-a15d-4aad-9c00-9b52a01f32ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:12.101780 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe1a88-a15d-4aad-9c00-9b52a01f32ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:12.102091 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe1a88-a15d-4aad-9c00-9b52a01f32ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:12.102378 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe1a88-a15d-4aad-9c00-9b52a01f32ce admin admin] PATH_INFO: `/v3/users/54c59604553a491b9276bd45b3a2f6cf` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:12.103521 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafe1a88-a15d-4aad-9c00-9b52a01f32ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=54c59604553a491b9276bd45b3a2f6cf)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:12.105733 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafe1a88-a15d-4aad-9c00-9b52a01f32ce admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:12.120071 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:12.159895 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-fafe1a88-a15d-4aad-9c00-9b52a01f32ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54c59604553a491b9276bd45b3a2f6cf'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:12.168410 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-fafe1a88-a15d-4aad-9c00-9b52a01f32ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54c59604553a491b9276bd45b3a2f6cf'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:12.181110 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-fafe1a88-a15d-4aad-9c00-9b52a01f32ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54c59604553a491b9276bd45b3a2f6cf'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:12.181758 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-fafe1a88-a15d-4aad-9c00-9b52a01f32ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54c59604553a491b9276bd45b3a2f6cf'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:12.188714 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-fafe1a88-a15d-4aad-9c00-9b52a01f32ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54c59604553a491b9276bd45b3a2f6cf'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:12.194598 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1224/2452] 10.222.0.70 () {58 vars in 1224 bytes} [Tue Aug 2 21:47:12 2022] DELETE /identity/v3/users/54c59604553a491b9276bd45b3a2f6cf => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:47:12.375321 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bb6e10-a00a-479a-8410-0c7078b4bd44 service cinder] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:12.386627 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bb6e10-a00a-479a-8410-0c7078b4bd44 service cinder] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:12.451405 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bb1d2e-0c09-4053-916b-f6f458ace583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:12.452052 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb1d2e-0c09-4053-916b-f6f458ace583 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:12.452371 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb1d2e-0c09-4053-916b-f6f458ace583 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:12.452668 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb1d2e-0c09-4053-916b-f6f458ace583 admin admin] PATH_INFO: `/v3/projects/9fe85fcf38a14b68956d95e9ed0117da` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:12.453808 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bb1d2e-0c09-4053-916b-f6f458ace583 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fe85fcf38a14b68956d95e9ed0117da)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:12.456294 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bb1d2e-0c09-4053-916b-f6f458ace583 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:12.502848 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-68bb1d2e-0c09-4053-916b-f6f458ace583 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fe85fcf38a14b68956d95e9ed0117da', 'request_id': 'req-68bb1d2e-0c09-4053-916b-f6f458ace583'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:12.508561 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-68bb1d2e-0c09-4053-916b-f6f458ace583 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fe85fcf38a14b68956d95e9ed0117da', 'request_id': 'req-68bb1d2e-0c09-4053-916b-f6f458ace583'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:12.515528 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-68bb1d2e-0c09-4053-916b-f6f458ace583 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fe85fcf38a14b68956d95e9ed0117da', 'request_id': 'req-68bb1d2e-0c09-4053-916b-f6f458ace583'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:12.527173 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-68bb1d2e-0c09-4053-916b-f6f458ace583 admin admin] The token cache is being invalidate because project 9fe85fcf38a14b68956d95e9ed0117da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:47:12.527556 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-68bb1d2e-0c09-4053-916b-f6f458ace583 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:12.528186 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-68bb1d2e-0c09-4053-916b-f6f458ace583 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:12.529728 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1229/2453] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Aug 2 21:47:12 2022] DELETE /identity/v3/projects/9fe85fcf38a14b68956d95e9ed0117da => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:47:12.535297 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500f0cab-47ca-460a-b4b3-98de5ec77614 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:12.535595 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500f0cab-47ca-460a-b4b3-98de5ec77614 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:12.535890 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500f0cab-47ca-460a-b4b3-98de5ec77614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:12.555264 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-500f0cab-47ca-460a-b4b3-98de5ec77614 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:47:12.556497 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-500f0cab-47ca-460a-b4b3-98de5ec77614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:12.618184 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1225/2454] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:47:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:47:12.626597 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4015b77e-76df-4b43-acab-d20461f6ccf7 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:12.626892 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4015b77e-76df-4b43-acab-d20461f6ccf7 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:12.627177 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4015b77e-76df-4b43-acab-d20461f6ccf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:12.647748 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-4015b77e-76df-4b43-acab-d20461f6ccf7 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:47:12.649017 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-4015b77e-76df-4b43-acab-d20461f6ccf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:12.657083 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1230/2455] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:47:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:47:12.662043 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500f0cab-47ca-460a-b4b3-98de5ec77614 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:12.671758 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500f0cab-47ca-460a-b4b3-98de5ec77614 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:12.676436 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813d2ef6-2c87-4aea-abf0-072fd55888dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:12.677057 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813d2ef6-2c87-4aea-abf0-072fd55888dc admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:12.677339 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813d2ef6-2c87-4aea-abf0-072fd55888dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:12.677615 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813d2ef6-2c87-4aea-abf0-072fd55888dc admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:12.678416 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813d2ef6-2c87-4aea-abf0-072fd55888dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:47:12.678726 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813d2ef6-2c87-4aea-abf0-072fd55888dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:12.680365 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813d2ef6-2c87-4aea-abf0-072fd55888dc admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:12.692377 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1226/2456] 10.222.0.70 () {58 vars in 1153 bytes} [Tue Aug 2 21:47:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:47:12.696880 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4015b77e-76df-4b43-acab-d20461f6ccf7 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:12.706981 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4015b77e-76df-4b43-acab-d20461f6ccf7 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:12.711629 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae27def-f9b4-439c-8d86-6ace66b26a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:12.712262 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae27def-f9b4-439c-8d86-6ace66b26a01 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:12.712568 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae27def-f9b4-439c-8d86-6ace66b26a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:12.712847 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae27def-f9b4-439c-8d86-6ace66b26a01 admin admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:12.713522 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae27def-f9b4-439c-8d86-6ace66b26a01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:12.715439 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae27def-f9b4-439c-8d86-6ace66b26a01 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:12.743321 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1231/2457] 10.222.0.70 () {60 vars in 1153 bytes} [Tue Aug 2 21:47:12 2022] POST /identity/v3/projects => generated 405 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:47:12.747485 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813d2ef6-2c87-4aea-abf0-072fd55888dc admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:12.758159 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813d2ef6-2c87-4aea-abf0-072fd55888dc admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:12.813453 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e9116a-090d-4f4a-9a6a-8f290f45aef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:12.814071 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e9116a-090d-4f4a-9a6a-8f290f45aef3 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:12.814356 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e9116a-090d-4f4a-9a6a-8f290f45aef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:12.815142 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e9116a-090d-4f4a-9a6a-8f290f45aef3 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:12.815808 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e9116a-090d-4f4a-9a6a-8f290f45aef3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:12.817765 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e9116a-090d-4f4a-9a6a-8f290f45aef3 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:12.839539 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1227/2458] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 2 21:47:12 2022] POST /identity/v3/users => generated 303 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:47:12.843972 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae27def-f9b4-439c-8d86-6ace66b26a01 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:12.854240 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae27def-f9b4-439c-8d86-6ace66b26a01 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:12.859059 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc39b89f-675f-4f2f-b967-d2e7c0f2af05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:12.859662 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc39b89f-675f-4f2f-b967-d2e7c0f2af05 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:12.859940 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc39b89f-675f-4f2f-b967-d2e7c0f2af05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:12.860212 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc39b89f-675f-4f2f-b967-d2e7c0f2af05 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:12.860935 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc39b89f-675f-4f2f-b967-d2e7c0f2af05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:12.862538 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc39b89f-675f-4f2f-b967-d2e7c0f2af05 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:12.873380 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1232/2459] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:47:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:47:12.877878 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e9116a-090d-4f4a-9a6a-8f290f45aef3 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:12.887805 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e9116a-090d-4f4a-9a6a-8f290f45aef3 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:12.892499 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16441f1-c739-4945-b7cf-168861fbf0c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:12.893686 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16441f1-c739-4945-b7cf-168861fbf0c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:12.893973 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16441f1-c739-4945-b7cf-168861fbf0c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:12.894342 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16441f1-c739-4945-b7cf-168861fbf0c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:12.895054 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16441f1-c739-4945-b7cf-168861fbf0c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:12.896587 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16441f1-c739-4945-b7cf-168861fbf0c5 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:12.898899 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:12.909561 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1228/2460] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:47:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:47:12.913787 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc39b89f-675f-4f2f-b967-d2e7c0f2af05 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:12.924092 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc39b89f-675f-4f2f-b967-d2e7c0f2af05 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:12.928985 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eaf130-f823-4ab2-989a-492e9a1a148d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:12.929644 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eaf130-f823-4ab2-989a-492e9a1a148d admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:12.929929 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eaf130-f823-4ab2-989a-492e9a1a148d admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:12.930210 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eaf130-f823-4ab2-989a-492e9a1a148d admin admin] PATH_INFO: `/v3/projects/bcbd1f0a291b4f4286c2da771510334e/users/b23b306d9edc4abcb68300841ea74fbf/roles/462e3381a85c42a9959201f9aa122f7c` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:12.945649 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eaf130-f823-4ab2-989a-492e9a1a148d admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcbd1f0a291b4f4286c2da771510334e, user_id=b23b306d9edc4abcb68300841ea74fbf, role_id=462e3381a85c42a9959201f9aa122f7c)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:12.948497 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eaf130-f823-4ab2-989a-492e9a1a148d admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:12.964601 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1233/2461] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:47:12 2022] PUT /identity/v3/projects/bcbd1f0a291b4f4286c2da771510334e/users/b23b306d9edc4abcb68300841ea74fbf/roles/462e3381a85c42a9959201f9aa122f7c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:47:12.975085 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f0d051-4d2b-4a53-9183-c2602117e3b6 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:12.975363 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f0d051-4d2b-4a53-9183-c2602117e3b6 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:12.975642 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f0d051-4d2b-4a53-9183-c2602117e3b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:13.007664 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-13f0d051-4d2b-4a53-9183-c2602117e3b6 None None] MFA Rules not processed for user `b23b306d9edc4abcb68300841ea74fbf`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:47:13.009040 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-13f0d051-4d2b-4a53-9183-c2602117e3b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:13.081306 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1229/2462] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:47:12 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:47:13.085924 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eaf130-f823-4ab2-989a-492e9a1a148d admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:13.094933 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:13.151927 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eaf130-f823-4ab2-989a-492e9a1a148d admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:13.156564 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f57de98-314a-4fc6-8068-3bce252e38e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:13.157176 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f57de98-314a-4fc6-8068-3bce252e38e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:13.157466 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f57de98-314a-4fc6-8068-3bce252e38e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:13.157744 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f57de98-314a-4fc6-8068-3bce252e38e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:13.158443 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f57de98-314a-4fc6-8068-3bce252e38e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:13.160386 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f57de98-314a-4fc6-8068-3bce252e38e4 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:13.186546 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1234/2463] 10.222.0.70 () {60 vars in 1153 bytes} [Tue Aug 2 21:47:13 2022] POST /identity/v3/projects => generated 403 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:47:13.191218 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f0d051-4d2b-4a53-9183-c2602117e3b6 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:13.201852 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f0d051-4d2b-4a53-9183-c2602117e3b6 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:13.258106 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e144e050-f6f5-4490-88b2-781ddab511cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:13.258640 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e144e050-f6f5-4490-88b2-781ddab511cc admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:13.258927 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e144e050-f6f5-4490-88b2-781ddab511cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:13.259209 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e144e050-f6f5-4490-88b2-781ddab511cc admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:13.259867 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e144e050-f6f5-4490-88b2-781ddab511cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:13.261877 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e144e050-f6f5-4490-88b2-781ddab511cc admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:13.282395 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1230/2464] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 2 21:47:13 2022] POST /identity/v3/users => generated 308 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 21:47:13.288410 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f57de98-314a-4fc6-8068-3bce252e38e4 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:13.300258 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f57de98-314a-4fc6-8068-3bce252e38e4 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:13.305130 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0d07d1-237f-4784-96b9-519117601113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:13.305785 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0d07d1-237f-4784-96b9-519117601113 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:13.306070 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0d07d1-237f-4784-96b9-519117601113 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:13.306348 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0d07d1-237f-4784-96b9-519117601113 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:13.307041 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0d07d1-237f-4784-96b9-519117601113 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:13.308687 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0d07d1-237f-4784-96b9-519117601113 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:13.321240 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1235/2465] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:47:13 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:47:13.325289 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e144e050-f6f5-4490-88b2-781ddab511cc admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:13.335946 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e144e050-f6f5-4490-88b2-781ddab511cc admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:13.340846 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767f51ca-56ce-4e6c-823e-4b4732c3ca68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:13.341527 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f51ca-56ce-4e6c-823e-4b4732c3ca68 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:13.341812 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f51ca-56ce-4e6c-823e-4b4732c3ca68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:13.342095 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767f51ca-56ce-4e6c-823e-4b4732c3ca68 admin admin] PATH_INFO: `/v3/projects/57035d088ecb48ec9168f93a2f2356e2/users/50cc159505f042fc81ae1b3a689b0e7f/roles/3e32dbf75f9b41f5adb9fe59851267bb` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:13.357781 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767f51ca-56ce-4e6c-823e-4b4732c3ca68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57035d088ecb48ec9168f93a2f2356e2, user_id=50cc159505f042fc81ae1b3a689b0e7f, role_id=3e32dbf75f9b41f5adb9fe59851267bb)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:13.360496 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767f51ca-56ce-4e6c-823e-4b4732c3ca68 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:13.374229 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1231/2466] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:47:13 2022] PUT /identity/v3/projects/57035d088ecb48ec9168f93a2f2356e2/users/50cc159505f042fc81ae1b3a689b0e7f/roles/3e32dbf75f9b41f5adb9fe59851267bb => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:47:13.378801 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0d07d1-237f-4784-96b9-519117601113 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:13.389207 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0d07d1-237f-4784-96b9-519117601113 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:13.448947 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d0228d-3c56-4614-af51-779156c3ac08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:13.449571 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d0228d-3c56-4614-af51-779156c3ac08 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:13.449860 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d0228d-3c56-4614-af51-779156c3ac08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:13.450136 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d0228d-3c56-4614-af51-779156c3ac08 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:13.450822 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d0228d-3c56-4614-af51-779156c3ac08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:13.452456 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d0228d-3c56-4614-af51-779156c3ac08 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:13.462184 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1236/2467] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:47:13 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:47:13.466476 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767f51ca-56ce-4e6c-823e-4b4732c3ca68 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:13.476919 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767f51ca-56ce-4e6c-823e-4b4732c3ca68 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:13.481787 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f88719-fbc9-43bb-afa6-afbebed38fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:13.482446 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f88719-fbc9-43bb-afa6-afbebed38fad admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:13.482734 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f88719-fbc9-43bb-afa6-afbebed38fad admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:13.483016 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f88719-fbc9-43bb-afa6-afbebed38fad admin admin] PATH_INFO: `/v3/projects/57035d088ecb48ec9168f93a2f2356e2/users/50cc159505f042fc81ae1b3a689b0e7f/roles/3e32dbf75f9b41f5adb9fe59851267bb` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:13.485002 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f88719-fbc9-43bb-afa6-afbebed38fad admin admin] RBAC: Authorizing `identity:create_grant(project_id=57035d088ecb48ec9168f93a2f2356e2, user_id=50cc159505f042fc81ae1b3a689b0e7f, role_id=3e32dbf75f9b41f5adb9fe59851267bb)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:13.488159 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f88719-fbc9-43bb-afa6-afbebed38fad admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:13.498249 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1232/2468] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:47:13 2022] PUT /identity/v3/projects/57035d088ecb48ec9168f93a2f2356e2/users/50cc159505f042fc81ae1b3a689b0e7f/roles/3e32dbf75f9b41f5adb9fe59851267bb => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:47:13.510193 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4138c9-7e73-4e4d-8d6f-0bd755170150 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:13.510530 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4138c9-7e73-4e4d-8d6f-0bd755170150 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:13.510820 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4138c9-7e73-4e4d-8d6f-0bd755170150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:13.538480 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-5b4138c9-7e73-4e4d-8d6f-0bd755170150 None None] MFA Rules not processed for user `50cc159505f042fc81ae1b3a689b0e7f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:47:13.539747 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-5b4138c9-7e73-4e4d-8d6f-0bd755170150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:13.607977 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1237/2469] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:47:13 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:47:13.619755 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f88719-fbc9-43bb-afa6-afbebed38fad admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:13.621476 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-66f88719-fbc9-43bb-afa6-afbebed38fad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:13.668175 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:13.683465 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f88719-fbc9-43bb-afa6-afbebed38fad admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:13.687155 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b3fce2-58cf-4c74-a79b-64b94ae1b1dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '123eb76f95ee4e39905944da701c712d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:13.687772 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b3fce2-58cf-4c74-a79b-64b94ae1b1dd service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:13.688053 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b3fce2-58cf-4c74-a79b-64b94ae1b1dd service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:13.688368 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b3fce2-58cf-4c74-a79b-64b94ae1b1dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:13.698027 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b3fce2-58cf-4c74-a79b-64b94ae1b1dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:13.699462 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b3fce2-58cf-4c74-a79b-64b94ae1b1dd service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:13.709691 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1233/2470] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:47:13 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:47:13.856493 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4138c9-7e73-4e4d-8d6f-0bd755170150 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:13.860824 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:13.921107 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4138c9-7e73-4e4d-8d6f-0bd755170150 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:13.926543 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bb7ff6-3289-4d54-88cf-49de911e3229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:13.927209 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb7ff6-3289-4d54-88cf-49de911e3229 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:13.927493 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb7ff6-3289-4d54-88cf-49de911e3229 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:13.927776 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb7ff6-3289-4d54-88cf-49de911e3229 admin admin] PATH_INFO: `/v3/users/b23b306d9edc4abcb68300841ea74fbf` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:13.928965 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bb7ff6-3289-4d54-88cf-49de911e3229 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b23b306d9edc4abcb68300841ea74fbf)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:13.930889 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bb7ff6-3289-4d54-88cf-49de911e3229 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:13.975798 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-a9bb7ff6-3289-4d54-88cf-49de911e3229 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b23b306d9edc4abcb68300841ea74fbf'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:13.983084 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-a9bb7ff6-3289-4d54-88cf-49de911e3229 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b23b306d9edc4abcb68300841ea74fbf'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:13.995541 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-a9bb7ff6-3289-4d54-88cf-49de911e3229 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b23b306d9edc4abcb68300841ea74fbf'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:14.003561 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-a9bb7ff6-3289-4d54-88cf-49de911e3229 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b23b306d9edc4abcb68300841ea74fbf'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:14.004252 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-a9bb7ff6-3289-4d54-88cf-49de911e3229 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b23b306d9edc4abcb68300841ea74fbf'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:14.010111 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1238/2471] 10.222.0.70 () {58 vars in 1224 bytes} [Tue Aug 2 21:47:13 2022] DELETE /identity/v3/users/b23b306d9edc4abcb68300841ea74fbf => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:47:14.014771 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9642de0-6637-40a7-b56f-b021629ae2c2 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:14.015010 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9642de0-6637-40a7-b56f-b021629ae2c2 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:14.015288 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9642de0-6637-40a7-b56f-b021629ae2c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:14.035280 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-e9642de0-6637-40a7-b56f-b021629ae2c2 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:47:14.036648 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-e9642de0-6637-40a7-b56f-b021629ae2c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:14.097881 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1234/2472] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:47:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:47:14.108067 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bb7ff6-3289-4d54-88cf-49de911e3229 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:14.109528 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-a9bb7ff6-3289-4d54-88cf-49de911e3229 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:14.168183 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bb7ff6-3289-4d54-88cf-49de911e3229 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:14.171863 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7592b000-a4aa-48b2-b728-8009fdffe243 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '723f5f43572a493dae0349070a2adb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:14.172522 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7592b000-a4aa-48b2-b728-8009fdffe243 service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:14.172812 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7592b000-a4aa-48b2-b728-8009fdffe243 service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:14.173102 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7592b000-a4aa-48b2-b728-8009fdffe243 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:14.182418 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7592b000-a4aa-48b2-b728-8009fdffe243 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:14.183861 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7592b000-a4aa-48b2-b728-8009fdffe243 service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:14.193576 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1239/2473] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:47:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:47:14.491060 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9642de0-6637-40a7-b56f-b021629ae2c2 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:14.492504 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-e9642de0-6637-40a7-b56f-b021629ae2c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:14.507779 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9642de0-6637-40a7-b56f-b021629ae2c2 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:14.513253 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465db274-270a-4da0-ba6d-3955c4eefdcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:14.513971 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465db274-270a-4da0-ba6d-3955c4eefdcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:14.514151 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465db274-270a-4da0-ba6d-3955c4eefdcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:14.514431 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465db274-270a-4da0-ba6d-3955c4eefdcb admin admin] PATH_INFO: `/v3/projects/bcbd1f0a291b4f4286c2da771510334e` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:14.515596 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465db274-270a-4da0-ba6d-3955c4eefdcb admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcbd1f0a291b4f4286c2da771510334e)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:14.517573 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465db274-270a-4da0-ba6d-3955c4eefdcb admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:14.567933 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-465db274-270a-4da0-ba6d-3955c4eefdcb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcbd1f0a291b4f4286c2da771510334e', 'request_id': 'req-465db274-270a-4da0-ba6d-3955c4eefdcb'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:14.576188 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-465db274-270a-4da0-ba6d-3955c4eefdcb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcbd1f0a291b4f4286c2da771510334e', 'request_id': 'req-465db274-270a-4da0-ba6d-3955c4eefdcb'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:14.583563 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-465db274-270a-4da0-ba6d-3955c4eefdcb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcbd1f0a291b4f4286c2da771510334e', 'request_id': 'req-465db274-270a-4da0-ba6d-3955c4eefdcb'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:14.594679 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-465db274-270a-4da0-ba6d-3955c4eefdcb admin admin] The token cache is being invalidate because project bcbd1f0a291b4f4286c2da771510334e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:47:14.594969 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-465db274-270a-4da0-ba6d-3955c4eefdcb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:14.595617 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-465db274-270a-4da0-ba6d-3955c4eefdcb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:14.597219 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1235/2474] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Aug 2 21:47:14 2022] DELETE /identity/v3/projects/bcbd1f0a291b4f4286c2da771510334e => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:47:14.601370 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7592b000-a4aa-48b2-b728-8009fdffe243 service neutron] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:14.612047 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7592b000-a4aa-48b2-b728-8009fdffe243 service neutron] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:14.632946 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:14.672087 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f62cc4a-c386-4746-8acb-42b9dd94ed7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:14.672764 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f62cc4a-c386-4746-8acb-42b9dd94ed7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:14.673053 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f62cc4a-c386-4746-8acb-42b9dd94ed7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:14.673333 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f62cc4a-c386-4746-8acb-42b9dd94ed7f admin admin] PATH_INFO: `/v3/users/50cc159505f042fc81ae1b3a689b0e7f` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:14.675013 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f62cc4a-c386-4746-8acb-42b9dd94ed7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=50cc159505f042fc81ae1b3a689b0e7f)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:14.676998 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f62cc4a-c386-4746-8acb-42b9dd94ed7f admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:14.724910 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-9f62cc4a-c386-4746-8acb-42b9dd94ed7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50cc159505f042fc81ae1b3a689b0e7f'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:14.732712 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-9f62cc4a-c386-4746-8acb-42b9dd94ed7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50cc159505f042fc81ae1b3a689b0e7f'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:14.745484 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-9f62cc4a-c386-4746-8acb-42b9dd94ed7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50cc159505f042fc81ae1b3a689b0e7f'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:14.753172 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-9f62cc4a-c386-4746-8acb-42b9dd94ed7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50cc159505f042fc81ae1b3a689b0e7f'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:14.754129 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-9f62cc4a-c386-4746-8acb-42b9dd94ed7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50cc159505f042fc81ae1b3a689b0e7f'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:14.761330 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1240/2475] 10.222.0.70 () {58 vars in 1224 bytes} [Tue Aug 2 21:47:14 2022] DELETE /identity/v3/users/50cc159505f042fc81ae1b3a689b0e7f => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:47:15.037442 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465db274-270a-4da0-ba6d-3955c4eefdcb admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:15.039172 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-465db274-270a-4da0-ba6d-3955c4eefdcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:15.053134 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465db274-270a-4da0-ba6d-3955c4eefdcb admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:15.111684 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4442bc-1e0f-4bf4-b965-9bb609a991e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:15.112355 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4442bc-1e0f-4bf4-b965-9bb609a991e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:15.112635 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4442bc-1e0f-4bf4-b965-9bb609a991e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:15.112908 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4442bc-1e0f-4bf4-b965-9bb609a991e8 admin admin] PATH_INFO: `/v3/projects/57035d088ecb48ec9168f93a2f2356e2` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:15.114039 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4442bc-1e0f-4bf4-b965-9bb609a991e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=57035d088ecb48ec9168f93a2f2356e2)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:15.115959 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4442bc-1e0f-4bf4-b965-9bb609a991e8 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:15.123848 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:15.162706 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-5b4442bc-1e0f-4bf4-b965-9bb609a991e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57035d088ecb48ec9168f93a2f2356e2', 'request_id': 'req-5b4442bc-1e0f-4bf4-b965-9bb609a991e8'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:15.169222 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-5b4442bc-1e0f-4bf4-b965-9bb609a991e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57035d088ecb48ec9168f93a2f2356e2', 'request_id': 'req-5b4442bc-1e0f-4bf4-b965-9bb609a991e8'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:15.174906 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-5b4442bc-1e0f-4bf4-b965-9bb609a991e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57035d088ecb48ec9168f93a2f2356e2', 'request_id': 'req-5b4442bc-1e0f-4bf4-b965-9bb609a991e8'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:15.185879 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-5b4442bc-1e0f-4bf4-b965-9bb609a991e8 admin admin] The token cache is being invalidate because project 57035d088ecb48ec9168f93a2f2356e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:47:15.186175 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-5b4442bc-1e0f-4bf4-b965-9bb609a991e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:15.186845 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-5b4442bc-1e0f-4bf4-b965-9bb609a991e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:15.188388 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1236/2476] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Aug 2 21:47:15 2022] DELETE /identity/v3/projects/57035d088ecb48ec9168f93a2f2356e2 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:47:15.193708 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf30fe6-7049-48cd-afa0-17cfe4c17a47 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:15.194023 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf30fe6-7049-48cd-afa0-17cfe4c17a47 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:15.194298 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf30fe6-7049-48cd-afa0-17cfe4c17a47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:15.214293 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-bdf30fe6-7049-48cd-afa0-17cfe4c17a47 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:47:15.215498 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-bdf30fe6-7049-48cd-afa0-17cfe4c17a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:15.274791 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1241/2477] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:47:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:47:15.284155 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d4a92-72a2-441e-9618-f0842b6de992 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:15.284155 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d4a92-72a2-441e-9618-f0842b6de992 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:15.284155 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319d4a92-72a2-441e-9618-f0842b6de992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:15.302524 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-319d4a92-72a2-441e-9618-f0842b6de992 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:47:15.303732 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-319d4a92-72a2-441e-9618-f0842b6de992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:15.311673 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1237/2478] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:47:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:47:15.316472 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf30fe6-7049-48cd-afa0-17cfe4c17a47 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:15.326235 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf30fe6-7049-48cd-afa0-17cfe4c17a47 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:15.331319 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e181eb9-7d18-4026-a122-361a6371b812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:15.331935 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e181eb9-7d18-4026-a122-361a6371b812 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:15.332216 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e181eb9-7d18-4026-a122-361a6371b812 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:15.332525 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e181eb9-7d18-4026-a122-361a6371b812 admin admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:15.333220 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e181eb9-7d18-4026-a122-361a6371b812 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:47:15.333527 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e181eb9-7d18-4026-a122-361a6371b812 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:15.335155 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e181eb9-7d18-4026-a122-361a6371b812 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:15.346652 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1242/2479] 10.222.0.70 () {58 vars in 1153 bytes} [Tue Aug 2 21:47:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:47:15.350939 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319d4a92-72a2-441e-9618-f0842b6de992 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:15.360435 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319d4a92-72a2-441e-9618-f0842b6de992 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:15.365638 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df96d66-603c-40cb-96c7-aad0065cb449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:15.366237 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df96d66-603c-40cb-96c7-aad0065cb449 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:15.366523 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df96d66-603c-40cb-96c7-aad0065cb449 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:15.366800 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df96d66-603c-40cb-96c7-aad0065cb449 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:15.367482 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df96d66-603c-40cb-96c7-aad0065cb449 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:15.369435 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df96d66-603c-40cb-96c7-aad0065cb449 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:15.397004 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1238/2480] 10.222.0.70 () {60 vars in 1153 bytes} [Tue Aug 2 21:47:15 2022] POST /identity/v3/projects => generated 365 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 21:47:15.401087 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e181eb9-7d18-4026-a122-361a6371b812 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:15.410952 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e181eb9-7d18-4026-a122-361a6371b812 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:15.442575 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:15.471943 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb70ea3-1461-42f5-b7f5-7a11defced3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:15.472607 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb70ea3-1461-42f5-b7f5-7a11defced3f admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:15.472887 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb70ea3-1461-42f5-b7f5-7a11defced3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:15.473165 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb70ea3-1461-42f5-b7f5-7a11defced3f admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:15.473828 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb70ea3-1461-42f5-b7f5-7a11defced3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:15.475792 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb70ea3-1461-42f5-b7f5-7a11defced3f admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:15.501106 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1243/2481] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 2 21:47:15 2022] POST /identity/v3/users => generated 283 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 21:47:15.503082 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df96d66-603c-40cb-96c7-aad0065cb449 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:15.513973 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df96d66-603c-40cb-96c7-aad0065cb449 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:15.518227 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88983fd-161c-4032-9c77-d4a819363bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:15.518855 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88983fd-161c-4032-9c77-d4a819363bd2 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:15.519200 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88983fd-161c-4032-9c77-d4a819363bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:15.519377 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88983fd-161c-4032-9c77-d4a819363bd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:15.520071 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88983fd-161c-4032-9c77-d4a819363bd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:15.521695 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88983fd-161c-4032-9c77-d4a819363bd2 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:15.531886 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1239/2482] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:47:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:47:15.536303 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb70ea3-1461-42f5-b7f5-7a11defced3f admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:15.546971 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb70ea3-1461-42f5-b7f5-7a11defced3f admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:15.552667 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d053e24d-98fa-4e33-9bd1-93059aa77c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:15.553289 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d053e24d-98fa-4e33-9bd1-93059aa77c2c admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:15.553577 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d053e24d-98fa-4e33-9bd1-93059aa77c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:15.553857 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d053e24d-98fa-4e33-9bd1-93059aa77c2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:15.554588 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d053e24d-98fa-4e33-9bd1-93059aa77c2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:15.556270 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d053e24d-98fa-4e33-9bd1-93059aa77c2c admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:15.568335 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1244/2483] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:47:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:47:15.572663 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88983fd-161c-4032-9c77-d4a819363bd2 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:15.582818 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88983fd-161c-4032-9c77-d4a819363bd2 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:15.587669 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e056f8bf-fb72-4226-8bd9-e9eaa17a5c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:15.588298 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e056f8bf-fb72-4226-8bd9-e9eaa17a5c13 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:15.588590 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e056f8bf-fb72-4226-8bd9-e9eaa17a5c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:15.588872 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e056f8bf-fb72-4226-8bd9-e9eaa17a5c13 admin admin] PATH_INFO: `/v3/projects/c1f33f3cf9994abf99bfa2bd3782fb71/users/54be99dba906487aa537fbd99020e364/roles/462e3381a85c42a9959201f9aa122f7c` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:15.603836 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e056f8bf-fb72-4226-8bd9-e9eaa17a5c13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1f33f3cf9994abf99bfa2bd3782fb71, user_id=54be99dba906487aa537fbd99020e364, role_id=462e3381a85c42a9959201f9aa122f7c)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:15.606808 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e056f8bf-fb72-4226-8bd9-e9eaa17a5c13 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:15.620694 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1240/2484] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:47:15 2022] PUT /identity/v3/projects/c1f33f3cf9994abf99bfa2bd3782fb71/users/54be99dba906487aa537fbd99020e364/roles/462e3381a85c42a9959201f9aa122f7c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:47:15.636741 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec35686-d63f-4d98-a961-ad654088fbb1 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:15.636741 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec35686-d63f-4d98-a961-ad654088fbb1 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:15.636741 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec35686-d63f-4d98-a961-ad654088fbb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:15.662635 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-dec35686-d63f-4d98-a961-ad654088fbb1 None None] MFA Rules not processed for user `54be99dba906487aa537fbd99020e364`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:47:15.663922 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-dec35686-d63f-4d98-a961-ad654088fbb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:15.731079 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1245/2485] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:47:15 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:47:15.735538 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e056f8bf-fb72-4226-8bd9-e9eaa17a5c13 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:15.800204 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e056f8bf-fb72-4226-8bd9-e9eaa17a5c13 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:15.804905 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860ea5e4-b3be-4150-acad-ef301d4045a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:15.805502 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860ea5e4-b3be-4150-acad-ef301d4045a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:15.805788 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860ea5e4-b3be-4150-acad-ef301d4045a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:15.806062 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860ea5e4-b3be-4150-acad-ef301d4045a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:15.806724 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860ea5e4-b3be-4150-acad-ef301d4045a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:15.808674 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860ea5e4-b3be-4150-acad-ef301d4045a4 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:15.837520 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1241/2486] 10.222.0.70 () {60 vars in 1153 bytes} [Tue Aug 2 21:47:15 2022] POST /identity/v3/projects => generated 363 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:47:15.841723 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec35686-d63f-4d98-a961-ad654088fbb1 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:15.853466 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec35686-d63f-4d98-a961-ad654088fbb1 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:15.912633 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a896a49-8f14-425d-b909-2565617e1b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:15.913329 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a896a49-8f14-425d-b909-2565617e1b3c admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:15.913582 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a896a49-8f14-425d-b909-2565617e1b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:15.913818 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a896a49-8f14-425d-b909-2565617e1b3c admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:15.914591 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a896a49-8f14-425d-b909-2565617e1b3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:15.916636 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a896a49-8f14-425d-b909-2565617e1b3c admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:15.945032 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1246/2487] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 2 21:47:15 2022] POST /identity/v3/users => generated 288 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:47:15.948935 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860ea5e4-b3be-4150-acad-ef301d4045a4 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:15.960672 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860ea5e4-b3be-4150-acad-ef301d4045a4 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:15.965406 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd4ef41-e7af-4880-be77-fb4b0d26aa9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:15.966024 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd4ef41-e7af-4880-be77-fb4b0d26aa9e admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:15.966295 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd4ef41-e7af-4880-be77-fb4b0d26aa9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:15.966572 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd4ef41-e7af-4880-be77-fb4b0d26aa9e admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:15.967258 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd4ef41-e7af-4880-be77-fb4b0d26aa9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:15.968885 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd4ef41-e7af-4880-be77-fb4b0d26aa9e admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:15.980812 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1242/2488] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:47:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:47:15.985118 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a896a49-8f14-425d-b909-2565617e1b3c admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:15.995891 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a896a49-8f14-425d-b909-2565617e1b3c admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:16.000805 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1464ad-20f7-4408-bd23-376e83250a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:16.001463 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1464ad-20f7-4408-bd23-376e83250a5e admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:16.001747 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1464ad-20f7-4408-bd23-376e83250a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:16.002067 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1464ad-20f7-4408-bd23-376e83250a5e admin admin] PATH_INFO: `/v3/projects/b97659a4302f4b9ea2d9ad4d00969c52/users/e07c6125664c45878b6ea2040dd8a481/roles/3e32dbf75f9b41f5adb9fe59851267bb` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:16.017066 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1464ad-20f7-4408-bd23-376e83250a5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b97659a4302f4b9ea2d9ad4d00969c52, user_id=e07c6125664c45878b6ea2040dd8a481, role_id=3e32dbf75f9b41f5adb9fe59851267bb)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:16.019820 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1464ad-20f7-4408-bd23-376e83250a5e admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:16.032990 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1247/2489] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:47:15 2022] PUT /identity/v3/projects/b97659a4302f4b9ea2d9ad4d00969c52/users/e07c6125664c45878b6ea2040dd8a481/roles/3e32dbf75f9b41f5adb9fe59851267bb => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:47:16.038453 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd4ef41-e7af-4880-be77-fb4b0d26aa9e admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:16.049519 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd4ef41-e7af-4880-be77-fb4b0d26aa9e admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:16.053400 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:16.111254 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a715ed02-9161-4b96-9cbd-a528c0629cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:16.112487 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a715ed02-9161-4b96-9cbd-a528c0629cf0 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:16.113042 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a715ed02-9161-4b96-9cbd-a528c0629cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:16.113042 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a715ed02-9161-4b96-9cbd-a528c0629cf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:16.113737 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a715ed02-9161-4b96-9cbd-a528c0629cf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:16.115335 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a715ed02-9161-4b96-9cbd-a528c0629cf0 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:16.125202 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1243/2490] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:47:16 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 21:47:16.129255 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1464ad-20f7-4408-bd23-376e83250a5e admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:16.137151 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:16.142179 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1464ad-20f7-4408-bd23-376e83250a5e admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:16.148764 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce048414-4228-4496-97ac-b5de2852682c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:16.149429 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce048414-4228-4496-97ac-b5de2852682c admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:16.149736 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce048414-4228-4496-97ac-b5de2852682c admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:16.150016 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce048414-4228-4496-97ac-b5de2852682c admin admin] PATH_INFO: `/v3/projects/b97659a4302f4b9ea2d9ad4d00969c52/users/e07c6125664c45878b6ea2040dd8a481/roles/3e32dbf75f9b41f5adb9fe59851267bb` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:16.151987 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce048414-4228-4496-97ac-b5de2852682c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b97659a4302f4b9ea2d9ad4d00969c52, user_id=e07c6125664c45878b6ea2040dd8a481, role_id=3e32dbf75f9b41f5adb9fe59851267bb)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:16.154744 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce048414-4228-4496-97ac-b5de2852682c admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:16.166104 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1248/2491] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:47:16 2022] PUT /identity/v3/projects/b97659a4302f4b9ea2d9ad4d00969c52/users/e07c6125664c45878b6ea2040dd8a481/roles/3e32dbf75f9b41f5adb9fe59851267bb => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:47:16.177667 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a2d5ea-baf4-442c-bba4-991c3c1aba9b None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:16.178008 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a2d5ea-baf4-442c-bba4-991c3c1aba9b None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:16.178355 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a2d5ea-baf4-442c-bba4-991c3c1aba9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:16.209953 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-86a2d5ea-baf4-442c-bba4-991c3c1aba9b None None] MFA Rules not processed for user `e07c6125664c45878b6ea2040dd8a481`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:47:16.211200 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-86a2d5ea-baf4-442c-bba4-991c3c1aba9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:16.282143 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1244/2492] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:47:16 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:47:16.294082 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce048414-4228-4496-97ac-b5de2852682c admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:16.295911 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-ce048414-4228-4496-97ac-b5de2852682c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:16.353874 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce048414-4228-4496-97ac-b5de2852682c admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:16.357855 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c9de55-8bd1-42db-9a72-676363ba8aa4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '123eb76f95ee4e39905944da701c712d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:16.358473 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c9de55-8bd1-42db-9a72-676363ba8aa4 service cinder] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:16.358761 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c9de55-8bd1-42db-9a72-676363ba8aa4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:16.359039 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c9de55-8bd1-42db-9a72-676363ba8aa4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:16.368092 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c9de55-8bd1-42db-9a72-676363ba8aa4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:16.369582 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c9de55-8bd1-42db-9a72-676363ba8aa4 service cinder] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:16.379052 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1249/2493] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:47:16 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:47:16.453908 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a2d5ea-baf4-442c-bba4-991c3c1aba9b None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:16.464198 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a2d5ea-baf4-442c-bba4-991c3c1aba9b None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:16.467786 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc417d6-1ff9-4a0f-be7e-bb6e646715f5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '123eb76f95ee4e39905944da701c712d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:16.468439 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc417d6-1ff9-4a0f-be7e-bb6e646715f5 service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:16.468725 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc417d6-1ff9-4a0f-be7e-bb6e646715f5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:16.469002 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc417d6-1ff9-4a0f-be7e-bb6e646715f5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:16.525459 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc417d6-1ff9-4a0f-be7e-bb6e646715f5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:16.526922 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc417d6-1ff9-4a0f-be7e-bb6e646715f5 service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:16.535920 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1245/2494] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:47:16 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:47:23.856428 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c9de55-8bd1-42db-9a72-676363ba8aa4 service cinder] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:23.919885 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c9de55-8bd1-42db-9a72-676363ba8aa4 service cinder] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:23.924566 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba47caf-cb00-4366-b534-f2423603dede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:23.925205 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba47caf-cb00-4366-b534-f2423603dede admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:23.925491 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba47caf-cb00-4366-b534-f2423603dede admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:23.925772 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba47caf-cb00-4366-b534-f2423603dede admin admin] PATH_INFO: `/v3/users/54be99dba906487aa537fbd99020e364` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:23.926939 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba47caf-cb00-4366-b534-f2423603dede admin admin] RBAC: Authorizing `identity:delete_user(user_id=54be99dba906487aa537fbd99020e364)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:23.928897 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba47caf-cb00-4366-b534-f2423603dede admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:23.976135 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-fba47caf-cb00-4366-b534-f2423603dede admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54be99dba906487aa537fbd99020e364'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:23.984382 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-fba47caf-cb00-4366-b534-f2423603dede admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54be99dba906487aa537fbd99020e364'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:23.996803 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-fba47caf-cb00-4366-b534-f2423603dede admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54be99dba906487aa537fbd99020e364'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:24.004212 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-fba47caf-cb00-4366-b534-f2423603dede admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54be99dba906487aa537fbd99020e364'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:24.006640 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-fba47caf-cb00-4366-b534-f2423603dede admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54be99dba906487aa537fbd99020e364'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:24.012533 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1250/2495] 10.222.0.70 () {58 vars in 1224 bytes} [Tue Aug 2 21:47:23 2022] DELETE /identity/v3/users/54be99dba906487aa537fbd99020e364 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:47:24.017168 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8918a9a-ed7c-4de2-acda-54ff7d575f25 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:24.017654 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8918a9a-ed7c-4de2-acda-54ff7d575f25 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:24.017785 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8918a9a-ed7c-4de2-acda-54ff7d575f25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:24.037889 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-a8918a9a-ed7c-4de2-acda-54ff7d575f25 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:47:24.039250 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-a8918a9a-ed7c-4de2-acda-54ff7d575f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:24.060031 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:24.099611 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1246/2496] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:47:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:47:24.109578 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba47caf-cb00-4366-b534-f2423603dede admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:24.110970 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-fba47caf-cb00-4366-b534-f2423603dede admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:24.126028 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:24.170764 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba47caf-cb00-4366-b534-f2423603dede admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:24.174371 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef93da1-7430-48bc-8b73-66fa5af32432 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '723f5f43572a493dae0349070a2adb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:24.174982 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef93da1-7430-48bc-8b73-66fa5af32432 service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:24.175330 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef93da1-7430-48bc-8b73-66fa5af32432 service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:24.175611 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef93da1-7430-48bc-8b73-66fa5af32432 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:24.184480 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef93da1-7430-48bc-8b73-66fa5af32432 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:24.185914 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef93da1-7430-48bc-8b73-66fa5af32432 service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:24.195784 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1251/2497] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:47:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:47:24.471267 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8918a9a-ed7c-4de2-acda-54ff7d575f25 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:24.472746 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-a8918a9a-ed7c-4de2-acda-54ff7d575f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:24.485163 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8918a9a-ed7c-4de2-acda-54ff7d575f25 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:24.490334 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3ab557-b8d0-4f9a-a485-50e5072894b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:24.490983 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3ab557-b8d0-4f9a-a485-50e5072894b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:24.491270 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3ab557-b8d0-4f9a-a485-50e5072894b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:24.491561 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3ab557-b8d0-4f9a-a485-50e5072894b6 admin admin] PATH_INFO: `/v3/projects/c1f33f3cf9994abf99bfa2bd3782fb71` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:24.492749 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3ab557-b8d0-4f9a-a485-50e5072894b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1f33f3cf9994abf99bfa2bd3782fb71)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:24.494667 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3ab557-b8d0-4f9a-a485-50e5072894b6 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:24.542866 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-1d3ab557-b8d0-4f9a-a485-50e5072894b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1f33f3cf9994abf99bfa2bd3782fb71', 'request_id': 'req-1d3ab557-b8d0-4f9a-a485-50e5072894b6'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:24.549771 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-1d3ab557-b8d0-4f9a-a485-50e5072894b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1f33f3cf9994abf99bfa2bd3782fb71', 'request_id': 'req-1d3ab557-b8d0-4f9a-a485-50e5072894b6'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:24.556530 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-1d3ab557-b8d0-4f9a-a485-50e5072894b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1f33f3cf9994abf99bfa2bd3782fb71', 'request_id': 'req-1d3ab557-b8d0-4f9a-a485-50e5072894b6'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:24.570271 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-1d3ab557-b8d0-4f9a-a485-50e5072894b6 admin admin] The token cache is being invalidate because project c1f33f3cf9994abf99bfa2bd3782fb71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:47:24.570564 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-1d3ab557-b8d0-4f9a-a485-50e5072894b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:24.571241 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-1d3ab557-b8d0-4f9a-a485-50e5072894b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:24.572866 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1247/2498] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Aug 2 21:47:24 2022] DELETE /identity/v3/projects/c1f33f3cf9994abf99bfa2bd3782fb71 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:47:24.576852 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef93da1-7430-48bc-8b73-66fa5af32432 service neutron] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:24.586719 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef93da1-7430-48bc-8b73-66fa5af32432 service neutron] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:24.642666 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87809c84-0121-4abb-b329-8f198ab61062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:24.643305 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87809c84-0121-4abb-b329-8f198ab61062 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:24.643590 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87809c84-0121-4abb-b329-8f198ab61062 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:24.643867 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87809c84-0121-4abb-b329-8f198ab61062 admin admin] PATH_INFO: `/v3/users/e07c6125664c45878b6ea2040dd8a481` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:24.645626 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87809c84-0121-4abb-b329-8f198ab61062 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e07c6125664c45878b6ea2040dd8a481)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:24.647509 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87809c84-0121-4abb-b329-8f198ab61062 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:24.693897 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-87809c84-0121-4abb-b329-8f198ab61062 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e07c6125664c45878b6ea2040dd8a481'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:24.701010 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-87809c84-0121-4abb-b329-8f198ab61062 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e07c6125664c45878b6ea2040dd8a481'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:24.714134 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-87809c84-0121-4abb-b329-8f198ab61062 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e07c6125664c45878b6ea2040dd8a481'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:24.721788 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-87809c84-0121-4abb-b329-8f198ab61062 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e07c6125664c45878b6ea2040dd8a481'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:24.722976 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-87809c84-0121-4abb-b329-8f198ab61062 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e07c6125664c45878b6ea2040dd8a481'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:24.728804 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1252/2499] 10.222.0.70 () {58 vars in 1224 bytes} [Tue Aug 2 21:47:24 2022] DELETE /identity/v3/users/e07c6125664c45878b6ea2040dd8a481 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:47:25.028699 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3ab557-b8d0-4f9a-a485-50e5072894b6 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:25.030311 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-1d3ab557-b8d0-4f9a-a485-50e5072894b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:25.055277 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3ab557-b8d0-4f9a-a485-50e5072894b6 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:25.116278 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195e395c-4e03-4457-bcf9-1397ab733dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:25.117052 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195e395c-4e03-4457-bcf9-1397ab733dbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:25.117511 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195e395c-4e03-4457-bcf9-1397ab733dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:25.117645 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195e395c-4e03-4457-bcf9-1397ab733dbd admin admin] PATH_INFO: `/v3/projects/b97659a4302f4b9ea2d9ad4d00969c52` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:25.118808 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195e395c-4e03-4457-bcf9-1397ab733dbd admin admin] RBAC: Authorizing `identity:delete_project(project_id=b97659a4302f4b9ea2d9ad4d00969c52)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:25.120812 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195e395c-4e03-4457-bcf9-1397ab733dbd admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:25.170517 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-195e395c-4e03-4457-bcf9-1397ab733dbd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b97659a4302f4b9ea2d9ad4d00969c52', 'request_id': 'req-195e395c-4e03-4457-bcf9-1397ab733dbd'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:25.173181 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:25.180925 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-195e395c-4e03-4457-bcf9-1397ab733dbd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b97659a4302f4b9ea2d9ad4d00969c52', 'request_id': 'req-195e395c-4e03-4457-bcf9-1397ab733dbd'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:25.187888 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-195e395c-4e03-4457-bcf9-1397ab733dbd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b97659a4302f4b9ea2d9ad4d00969c52', 'request_id': 'req-195e395c-4e03-4457-bcf9-1397ab733dbd'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:25.199891 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-195e395c-4e03-4457-bcf9-1397ab733dbd admin admin] The token cache is being invalidate because project b97659a4302f4b9ea2d9ad4d00969c52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:47:25.200184 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-195e395c-4e03-4457-bcf9-1397ab733dbd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:25.200854 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-195e395c-4e03-4457-bcf9-1397ab733dbd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:25.202359 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1248/2500] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Aug 2 21:47:25 2022] DELETE /identity/v3/projects/b97659a4302f4b9ea2d9ad4d00969c52 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:47:25.208717 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475e85f2-d0e6-45a7-8220-aeafd70d57ee None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:25.209176 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475e85f2-d0e6-45a7-8220-aeafd70d57ee None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:25.209567 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475e85f2-d0e6-45a7-8220-aeafd70d57ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:25.229960 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-475e85f2-d0e6-45a7-8220-aeafd70d57ee None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:47:25.231223 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-475e85f2-d0e6-45a7-8220-aeafd70d57ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:25.262284 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:25.309884 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1253/2501] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:47:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:47:25.314103 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff349b7-02b0-4273-8a76-01ed1dcbca62 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:25.314401 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff349b7-02b0-4273-8a76-01ed1dcbca62 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:25.314683 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff349b7-02b0-4273-8a76-01ed1dcbca62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:25.335532 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-9ff349b7-02b0-4273-8a76-01ed1dcbca62 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:47:25.336825 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-9ff349b7-02b0-4273-8a76-01ed1dcbca62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:25.345250 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1249/2502] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:47:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:47:25.350353 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475e85f2-d0e6-45a7-8220-aeafd70d57ee None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:25.360510 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475e85f2-d0e6-45a7-8220-aeafd70d57ee None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:25.365979 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ada7fd-21b1-4c52-9171-9b5dd0642b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:25.366597 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ada7fd-21b1-4c52-9171-9b5dd0642b46 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:25.366882 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ada7fd-21b1-4c52-9171-9b5dd0642b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:25.367163 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ada7fd-21b1-4c52-9171-9b5dd0642b46 admin admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:25.367866 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ada7fd-21b1-4c52-9171-9b5dd0642b46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:47:25.368182 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ada7fd-21b1-4c52-9171-9b5dd0642b46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:25.369885 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ada7fd-21b1-4c52-9171-9b5dd0642b46 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:25.382306 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1254/2503] 10.222.0.70 () {58 vars in 1153 bytes} [Tue Aug 2 21:47:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:47:25.386764 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff349b7-02b0-4273-8a76-01ed1dcbca62 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:25.396167 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff349b7-02b0-4273-8a76-01ed1dcbca62 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:25.401129 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e583415-65e8-4096-af30-5f6126acc676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:25.401744 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e583415-65e8-4096-af30-5f6126acc676 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:25.402028 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e583415-65e8-4096-af30-5f6126acc676 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:25.402305 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e583415-65e8-4096-af30-5f6126acc676 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:25.402967 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e583415-65e8-4096-af30-5f6126acc676 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:25.404942 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e583415-65e8-4096-af30-5f6126acc676 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:25.433905 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1250/2504] 10.222.0.70 () {60 vars in 1153 bytes} [Tue Aug 2 21:47:25 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:47:25.438289 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ada7fd-21b1-4c52-9171-9b5dd0642b46 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:25.449250 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ada7fd-21b1-4c52-9171-9b5dd0642b46 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:25.507344 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899e83d3-202c-40f2-8acb-3e9b060c2f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:25.507966 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899e83d3-202c-40f2-8acb-3e9b060c2f69 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:25.508337 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899e83d3-202c-40f2-8acb-3e9b060c2f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:25.508622 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899e83d3-202c-40f2-8acb-3e9b060c2f69 admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:25.509281 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899e83d3-202c-40f2-8acb-3e9b060c2f69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:25.511286 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899e83d3-202c-40f2-8acb-3e9b060c2f69 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:25.532484 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1255/2505] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 2 21:47:25 2022] POST /identity/v3/users => generated 288 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:47:25.537311 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e583415-65e8-4096-af30-5f6126acc676 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:25.547748 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e583415-65e8-4096-af30-5f6126acc676 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:25.553140 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7bb96b-f2be-4d1b-bb6c-59c2b6865144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:25.553752 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7bb96b-f2be-4d1b-bb6c-59c2b6865144 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:25.554053 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7bb96b-f2be-4d1b-bb6c-59c2b6865144 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:25.554336 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7bb96b-f2be-4d1b-bb6c-59c2b6865144 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:25.555030 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7bb96b-f2be-4d1b-bb6c-59c2b6865144 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:25.556707 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7bb96b-f2be-4d1b-bb6c-59c2b6865144 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:25.567441 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1251/2506] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:47:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 21:47:25.571577 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899e83d3-202c-40f2-8acb-3e9b060c2f69 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:25.582105 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899e83d3-202c-40f2-8acb-3e9b060c2f69 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:25.587018 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bd2a85-3665-47df-82c7-85fe73635305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:25.587697 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bd2a85-3665-47df-82c7-85fe73635305 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:25.588001 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bd2a85-3665-47df-82c7-85fe73635305 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:25.588315 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bd2a85-3665-47df-82c7-85fe73635305 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:25.589038 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bd2a85-3665-47df-82c7-85fe73635305 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:25.590845 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bd2a85-3665-47df-82c7-85fe73635305 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:25.602025 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1256/2507] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:47:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:47:25.606456 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7bb96b-f2be-4d1b-bb6c-59c2b6865144 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:25.617034 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7bb96b-f2be-4d1b-bb6c-59c2b6865144 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:25.621775 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45586f3d-fb5f-41d0-a90e-0a17072146a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:25.622431 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45586f3d-fb5f-41d0-a90e-0a17072146a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:25.622780 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45586f3d-fb5f-41d0-a90e-0a17072146a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:25.623025 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45586f3d-fb5f-41d0-a90e-0a17072146a0 admin admin] PATH_INFO: `/v3/projects/aab78826f0ee4842bfa434b47f80736b/users/10281c7b5cf14440bd5ba8075d2d09e0/roles/462e3381a85c42a9959201f9aa122f7c` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:25.638108 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45586f3d-fb5f-41d0-a90e-0a17072146a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aab78826f0ee4842bfa434b47f80736b, user_id=10281c7b5cf14440bd5ba8075d2d09e0, role_id=462e3381a85c42a9959201f9aa122f7c)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:25.640812 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45586f3d-fb5f-41d0-a90e-0a17072146a0 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:25.653359 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1252/2508] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:47:25 2022] PUT /identity/v3/projects/aab78826f0ee4842bfa434b47f80736b/users/10281c7b5cf14440bd5ba8075d2d09e0/roles/462e3381a85c42a9959201f9aa122f7c => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:47:25.664044 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19179b97-c8a2-4992-91c5-500d149a84df None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:25.664384 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19179b97-c8a2-4992-91c5-500d149a84df None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:25.664663 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19179b97-c8a2-4992-91c5-500d149a84df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:25.694143 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-19179b97-c8a2-4992-91c5-500d149a84df None None] MFA Rules not processed for user `10281c7b5cf14440bd5ba8075d2d09e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:47:25.696335 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-19179b97-c8a2-4992-91c5-500d149a84df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:25.770105 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1257/2509] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:47:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:47:25.774724 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45586f3d-fb5f-41d0-a90e-0a17072146a0 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:25.838387 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45586f3d-fb5f-41d0-a90e-0a17072146a0 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:25.843051 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1944d11-b0d1-4d1f-872d-ef8f02670668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:25.843666 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1944d11-b0d1-4d1f-872d-ef8f02670668 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:25.843958 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1944d11-b0d1-4d1f-872d-ef8f02670668 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:25.844260 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1944d11-b0d1-4d1f-872d-ef8f02670668 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:25.844936 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1944d11-b0d1-4d1f-872d-ef8f02670668 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:25.846849 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1944d11-b0d1-4d1f-872d-ef8f02670668 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:25.875750 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1253/2510] 10.222.0.70 () {60 vars in 1153 bytes} [Tue Aug 2 21:47:25 2022] POST /identity/v3/projects => generated 375 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:47:25.879715 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19179b97-c8a2-4992-91c5-500d149a84df None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:25.890332 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19179b97-c8a2-4992-91c5-500d149a84df None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:25.919545 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:25.950901 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b7a733-8798-4f7a-9342-2dfd47ac6572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:25.951535 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b7a733-8798-4f7a-9342-2dfd47ac6572 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:25.951822 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b7a733-8798-4f7a-9342-2dfd47ac6572 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:25.952103 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b7a733-8798-4f7a-9342-2dfd47ac6572 admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:25.952805 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b7a733-8798-4f7a-9342-2dfd47ac6572 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:25.954746 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b7a733-8798-4f7a-9342-2dfd47ac6572 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:25.975815 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1258/2511] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 2 21:47:25 2022] POST /identity/v3/users => generated 294 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:47:25.980093 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1944d11-b0d1-4d1f-872d-ef8f02670668 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:25.990364 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1944d11-b0d1-4d1f-872d-ef8f02670668 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:25.994982 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1110dde9-b0d0-42ff-9f14-fedb544c0d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:25.995594 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1110dde9-b0d0-42ff-9f14-fedb544c0d57 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:25.995882 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1110dde9-b0d0-42ff-9f14-fedb544c0d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:25.996166 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1110dde9-b0d0-42ff-9f14-fedb544c0d57 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:25.996886 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1110dde9-b0d0-42ff-9f14-fedb544c0d57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:25.999010 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1110dde9-b0d0-42ff-9f14-fedb544c0d57 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:26.011905 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1254/2512] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:47:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:47:26.016172 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b7a733-8798-4f7a-9342-2dfd47ac6572 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:26.027604 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b7a733-8798-4f7a-9342-2dfd47ac6572 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:26.032479 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ccff4d-00f3-491b-8406-c85b31fbb601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:26.033224 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ccff4d-00f3-491b-8406-c85b31fbb601 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:26.033560 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ccff4d-00f3-491b-8406-c85b31fbb601 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:26.033873 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ccff4d-00f3-491b-8406-c85b31fbb601 admin admin] PATH_INFO: `/v3/projects/da9bf5135bf74611bc5ef48d63041549/users/4ecb6ded3b2c408b9650886c9c077e14/roles/3e32dbf75f9b41f5adb9fe59851267bb` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:26.050975 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ccff4d-00f3-491b-8406-c85b31fbb601 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da9bf5135bf74611bc5ef48d63041549, user_id=4ecb6ded3b2c408b9650886c9c077e14, role_id=3e32dbf75f9b41f5adb9fe59851267bb)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:26.053701 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ccff4d-00f3-491b-8406-c85b31fbb601 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:26.067191 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1259/2513] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:47:26 2022] PUT /identity/v3/projects/da9bf5135bf74611bc5ef48d63041549/users/4ecb6ded3b2c408b9650886c9c077e14/roles/3e32dbf75f9b41f5adb9fe59851267bb => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:47:26.071199 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1110dde9-b0d0-42ff-9f14-fedb544c0d57 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:26.081941 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1110dde9-b0d0-42ff-9f14-fedb544c0d57 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:26.128886 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:26.140170 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453224b5-8645-4f70-95db-16f6bb51320a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:26.140829 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453224b5-8645-4f70-95db-16f6bb51320a admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:26.141117 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453224b5-8645-4f70-95db-16f6bb51320a admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:26.141395 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453224b5-8645-4f70-95db-16f6bb51320a admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:26.142087 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453224b5-8645-4f70-95db-16f6bb51320a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:26.143689 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453224b5-8645-4f70-95db-16f6bb51320a admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:26.154083 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1255/2514] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:47:26 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:47:26.158458 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ccff4d-00f3-491b-8406-c85b31fbb601 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:26.169644 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ccff4d-00f3-491b-8406-c85b31fbb601 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:26.174445 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859d709f-fd0a-4237-9994-59d64b5210e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:26.175105 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859d709f-fd0a-4237-9994-59d64b5210e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:26.175404 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859d709f-fd0a-4237-9994-59d64b5210e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:26.175670 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859d709f-fd0a-4237-9994-59d64b5210e4 admin admin] PATH_INFO: `/v3/projects/da9bf5135bf74611bc5ef48d63041549/users/4ecb6ded3b2c408b9650886c9c077e14/roles/3e32dbf75f9b41f5adb9fe59851267bb` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:26.177856 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859d709f-fd0a-4237-9994-59d64b5210e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da9bf5135bf74611bc5ef48d63041549, user_id=4ecb6ded3b2c408b9650886c9c077e14, role_id=3e32dbf75f9b41f5adb9fe59851267bb)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:26.180644 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859d709f-fd0a-4237-9994-59d64b5210e4 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:26.191572 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1260/2515] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:47:26 2022] PUT /identity/v3/projects/da9bf5135bf74611bc5ef48d63041549/users/4ecb6ded3b2c408b9650886c9c077e14/roles/3e32dbf75f9b41f5adb9fe59851267bb => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:47:26.202785 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7e59cc-de96-498f-be61-754a9ffcd649 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:26.203017 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7e59cc-de96-498f-be61-754a9ffcd649 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:26.203304 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7e59cc-de96-498f-be61-754a9ffcd649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:26.231270 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-1a7e59cc-de96-498f-be61-754a9ffcd649 None None] MFA Rules not processed for user `4ecb6ded3b2c408b9650886c9c077e14`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:47:26.232803 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-1a7e59cc-de96-498f-be61-754a9ffcd649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:26.307510 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1256/2516] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:47:26 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:47:26.318371 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859d709f-fd0a-4237-9994-59d64b5210e4 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:26.320729 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-859d709f-fd0a-4237-9994-59d64b5210e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:26.384423 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859d709f-fd0a-4237-9994-59d64b5210e4 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:26.388120 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea5f330-5803-49d2-9dac-633d68ae6187 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '123eb76f95ee4e39905944da701c712d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:26.388870 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea5f330-5803-49d2-9dac-633d68ae6187 service cinder] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:26.389180 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea5f330-5803-49d2-9dac-633d68ae6187 service cinder] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:26.389462 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea5f330-5803-49d2-9dac-633d68ae6187 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:26.457091 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea5f330-5803-49d2-9dac-633d68ae6187 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:26.458562 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea5f330-5803-49d2-9dac-633d68ae6187 service cinder] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:26.467697 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1261/2517] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:47:26 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:47:26.642801 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7e59cc-de96-498f-be61-754a9ffcd649 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:26.644702 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-1a7e59cc-de96-498f-be61-754a9ffcd649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:26.715725 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7e59cc-de96-498f-be61-754a9ffcd649 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:26.720898 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0273ce1a-a5c0-4337-823e-635f1ac697bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:26.721748 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0273ce1a-a5c0-4337-823e-635f1ac697bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:26.722231 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0273ce1a-a5c0-4337-823e-635f1ac697bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:26.722652 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0273ce1a-a5c0-4337-823e-635f1ac697bd admin admin] PATH_INFO: `/v3/users/2366d8628b994148830c701939160a61` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:26.724026 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0273ce1a-a5c0-4337-823e-635f1ac697bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=2366d8628b994148830c701939160a61)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:26.725969 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0273ce1a-a5c0-4337-823e-635f1ac697bd admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:26.804281 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-0273ce1a-a5c0-4337-823e-635f1ac697bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2366d8628b994148830c701939160a61'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:26.812030 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-0273ce1a-a5c0-4337-823e-635f1ac697bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2366d8628b994148830c701939160a61'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:26.825342 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-0273ce1a-a5c0-4337-823e-635f1ac697bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2366d8628b994148830c701939160a61'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:26.826018 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-0273ce1a-a5c0-4337-823e-635f1ac697bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2366d8628b994148830c701939160a61'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:26.828007 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:26.834630 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-0273ce1a-a5c0-4337-823e-635f1ac697bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2366d8628b994148830c701939160a61'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:26.841391 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1257/2518] 10.222.0.70 () {58 vars in 1224 bytes} [Tue Aug 2 21:47:26 2022] DELETE /identity/v3/users/2366d8628b994148830c701939160a61 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:47:26.845794 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c483ef-abaf-4dd2-ae3f-876ec02c27db None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:26.846083 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c483ef-abaf-4dd2-ae3f-876ec02c27db None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:26.846361 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c483ef-abaf-4dd2-ae3f-876ec02c27db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:26.866670 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-e6c483ef-abaf-4dd2-ae3f-876ec02c27db None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:47:26.867884 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-e6c483ef-abaf-4dd2-ae3f-876ec02c27db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:26.899689 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:26.928251 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1262/2519] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:47:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:47:26.937984 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0273ce1a-a5c0-4337-823e-635f1ac697bd admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:26.939378 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-0273ce1a-a5c0-4337-823e-635f1ac697bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:26.997516 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0273ce1a-a5c0-4337-823e-635f1ac697bd admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:27.001138 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc691491-ce02-40d3-b140-e2b6eb4b4974 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '723f5f43572a493dae0349070a2adb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:27.001765 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc691491-ce02-40d3-b140-e2b6eb4b4974 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:27.002044 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc691491-ce02-40d3-b140-e2b6eb4b4974 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:27.002324 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc691491-ce02-40d3-b140-e2b6eb4b4974 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:27.011345 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc691491-ce02-40d3-b140-e2b6eb4b4974 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:27.012881 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc691491-ce02-40d3-b140-e2b6eb4b4974 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:27.022171 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1258/2520] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:47:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:47:27.298475 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c483ef-abaf-4dd2-ae3f-876ec02c27db None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:27.300123 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-e6c483ef-abaf-4dd2-ae3f-876ec02c27db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:27.314413 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c483ef-abaf-4dd2-ae3f-876ec02c27db None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:27.319762 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58cb895-70f1-4207-ae07-38e03635a7a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:27.320541 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58cb895-70f1-4207-ae07-38e03635a7a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:27.320823 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58cb895-70f1-4207-ae07-38e03635a7a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:27.321101 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58cb895-70f1-4207-ae07-38e03635a7a9 admin admin] PATH_INFO: `/v3/projects/42f45c7eee9c4dfa9eedb2775592fb95` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:27.322263 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58cb895-70f1-4207-ae07-38e03635a7a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42f45c7eee9c4dfa9eedb2775592fb95)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:27.324186 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58cb895-70f1-4207-ae07-38e03635a7a9 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:27.372299 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-a58cb895-70f1-4207-ae07-38e03635a7a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42f45c7eee9c4dfa9eedb2775592fb95', 'request_id': 'req-a58cb895-70f1-4207-ae07-38e03635a7a9'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:27.377793 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-a58cb895-70f1-4207-ae07-38e03635a7a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42f45c7eee9c4dfa9eedb2775592fb95', 'request_id': 'req-a58cb895-70f1-4207-ae07-38e03635a7a9'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:27.385023 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-a58cb895-70f1-4207-ae07-38e03635a7a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42f45c7eee9c4dfa9eedb2775592fb95', 'request_id': 'req-a58cb895-70f1-4207-ae07-38e03635a7a9'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:27.396094 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-a58cb895-70f1-4207-ae07-38e03635a7a9 admin admin] The token cache is being invalidate because project 42f45c7eee9c4dfa9eedb2775592fb95 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:47:27.396476 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-a58cb895-70f1-4207-ae07-38e03635a7a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:27.397106 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-a58cb895-70f1-4207-ae07-38e03635a7a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:27.398651 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1263/2521] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Aug 2 21:47:27 2022] DELETE /identity/v3/projects/42f45c7eee9c4dfa9eedb2775592fb95 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:47:27.402821 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc691491-ce02-40d3-b140-e2b6eb4b4974 service neutron] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:27.413064 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc691491-ce02-40d3-b140-e2b6eb4b4974 service neutron] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:27.468643 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a111dd9-bf1a-4e0c-813d-1151e0908240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:27.469268 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a111dd9-bf1a-4e0c-813d-1151e0908240 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:27.469555 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a111dd9-bf1a-4e0c-813d-1151e0908240 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:27.469837 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a111dd9-bf1a-4e0c-813d-1151e0908240 admin admin] PATH_INFO: `/v3/users/37d428a529f8416eaba0d42f5bc8b273` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:27.471003 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a111dd9-bf1a-4e0c-813d-1151e0908240 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37d428a529f8416eaba0d42f5bc8b273)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:27.473514 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a111dd9-bf1a-4e0c-813d-1151e0908240 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:27.519335 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-0a111dd9-bf1a-4e0c-813d-1151e0908240 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37d428a529f8416eaba0d42f5bc8b273'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:27.526554 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-0a111dd9-bf1a-4e0c-813d-1151e0908240 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37d428a529f8416eaba0d42f5bc8b273'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:27.539453 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-0a111dd9-bf1a-4e0c-813d-1151e0908240 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37d428a529f8416eaba0d42f5bc8b273'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:27.540079 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-0a111dd9-bf1a-4e0c-813d-1151e0908240 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37d428a529f8416eaba0d42f5bc8b273'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:27.547265 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-0a111dd9-bf1a-4e0c-813d-1151e0908240 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37d428a529f8416eaba0d42f5bc8b273'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:27.553919 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1259/2522] 10.222.0.70 () {58 vars in 1224 bytes} [Tue Aug 2 21:47:27 2022] DELETE /identity/v3/users/37d428a529f8416eaba0d42f5bc8b273 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:47:27.856134 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58cb895-70f1-4207-ae07-38e03635a7a9 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:27.857654 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-a58cb895-70f1-4207-ae07-38e03635a7a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:27.872482 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58cb895-70f1-4207-ae07-38e03635a7a9 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:27.955872 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b464cef4-9560-4450-a83c-139fa35fb308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:27.956605 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b464cef4-9560-4450-a83c-139fa35fb308 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:27.956894 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b464cef4-9560-4450-a83c-139fa35fb308 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:27.957165 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b464cef4-9560-4450-a83c-139fa35fb308 admin admin] PATH_INFO: `/v3/projects/7e6ee763ae3b486f85f352d62d676fe5` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:27.958661 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b464cef4-9560-4450-a83c-139fa35fb308 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e6ee763ae3b486f85f352d62d676fe5)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:27.960525 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b464cef4-9560-4450-a83c-139fa35fb308 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:28.044791 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-b464cef4-9560-4450-a83c-139fa35fb308 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e6ee763ae3b486f85f352d62d676fe5', 'request_id': 'req-b464cef4-9560-4450-a83c-139fa35fb308'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:28.052056 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-b464cef4-9560-4450-a83c-139fa35fb308 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e6ee763ae3b486f85f352d62d676fe5', 'request_id': 'req-b464cef4-9560-4450-a83c-139fa35fb308'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:28.057631 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:28.064412 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-b464cef4-9560-4450-a83c-139fa35fb308 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e6ee763ae3b486f85f352d62d676fe5', 'request_id': 'req-b464cef4-9560-4450-a83c-139fa35fb308'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:28.079327 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-b464cef4-9560-4450-a83c-139fa35fb308 admin admin] The token cache is being invalidate because project 7e6ee763ae3b486f85f352d62d676fe5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:47:28.079665 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-b464cef4-9560-4450-a83c-139fa35fb308 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:28.080539 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-b464cef4-9560-4450-a83c-139fa35fb308 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:28.085696 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1264/2523] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Aug 2 21:47:27 2022] DELETE /identity/v3/projects/7e6ee763ae3b486f85f352d62d676fe5 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:47:28.087072 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b7757-c872-41a2-8013-c7b9b9214e07 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:28.087367 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b7757-c872-41a2-8013-c7b9b9214e07 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:28.087654 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0b7757-c872-41a2-8013-c7b9b9214e07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:28.109586 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-3c0b7757-c872-41a2-8013-c7b9b9214e07 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:47:28.110856 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-3c0b7757-c872-41a2-8013-c7b9b9214e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:28.121389 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:28.181740 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1260/2524] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:47:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:47:28.192774 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c257ba80-bd37-4a68-a59e-87f868ff427e None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:28.193064 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c257ba80-bd37-4a68-a59e-87f868ff427e None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:28.193381 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c257ba80-bd37-4a68-a59e-87f868ff427e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:28.213022 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-c257ba80-bd37-4a68-a59e-87f868ff427e None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:47:28.214229 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-c257ba80-bd37-4a68-a59e-87f868ff427e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:28.222781 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1265/2525] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:47:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:47:28.226855 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0b7757-c872-41a2-8013-c7b9b9214e07 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:28.237592 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0b7757-c872-41a2-8013-c7b9b9214e07 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:28.243352 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae108b2c-4ccb-4788-b0fd-48ddf271b9eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:28.244045 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae108b2c-4ccb-4788-b0fd-48ddf271b9eb admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:28.244425 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae108b2c-4ccb-4788-b0fd-48ddf271b9eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:28.244706 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae108b2c-4ccb-4788-b0fd-48ddf271b9eb admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:28.245572 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae108b2c-4ccb-4788-b0fd-48ddf271b9eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:47:28.245884 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae108b2c-4ccb-4788-b0fd-48ddf271b9eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:28.247701 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae108b2c-4ccb-4788-b0fd-48ddf271b9eb admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:28.259985 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1261/2526] 10.222.0.70 () {58 vars in 1153 bytes} [Tue Aug 2 21:47:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:47:28.264485 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c257ba80-bd37-4a68-a59e-87f868ff427e None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:28.274221 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c257ba80-bd37-4a68-a59e-87f868ff427e None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:28.278949 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1f73ce-74a5-4730-8716-d0760411a10c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:28.279581 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1f73ce-74a5-4730-8716-d0760411a10c admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:28.279865 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1f73ce-74a5-4730-8716-d0760411a10c admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:28.280145 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1f73ce-74a5-4730-8716-d0760411a10c admin admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:28.280855 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1f73ce-74a5-4730-8716-d0760411a10c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:28.282780 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1f73ce-74a5-4730-8716-d0760411a10c admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:28.311672 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1266/2527] 10.222.0.70 () {60 vars in 1153 bytes} [Tue Aug 2 21:47:28 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:47:28.315942 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae108b2c-4ccb-4788-b0fd-48ddf271b9eb admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:28.326029 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae108b2c-4ccb-4788-b0fd-48ddf271b9eb admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:28.389728 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d4a4c0-57c5-4617-b00f-0008605fc305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:28.390349 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d4a4c0-57c5-4617-b00f-0008605fc305 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:28.390634 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d4a4c0-57c5-4617-b00f-0008605fc305 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:28.390910 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d4a4c0-57c5-4617-b00f-0008605fc305 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:28.391576 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d4a4c0-57c5-4617-b00f-0008605fc305 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:28.393562 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d4a4c0-57c5-4617-b00f-0008605fc305 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:28.414185 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1262/2528] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 2 21:47:28 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:47:28.418377 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1f73ce-74a5-4730-8716-d0760411a10c admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:28.428766 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1f73ce-74a5-4730-8716-d0760411a10c admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:28.433399 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b4eeba-676f-43a3-aa11-0b349d9ab53c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:28.434009 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b4eeba-676f-43a3-aa11-0b349d9ab53c admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:28.434326 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b4eeba-676f-43a3-aa11-0b349d9ab53c admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:28.434605 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b4eeba-676f-43a3-aa11-0b349d9ab53c admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:28.435326 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b4eeba-676f-43a3-aa11-0b349d9ab53c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:28.436984 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b4eeba-676f-43a3-aa11-0b349d9ab53c admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:28.447302 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1267/2529] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:47:28 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:47:28.451122 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d4a4c0-57c5-4617-b00f-0008605fc305 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:28.462046 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d4a4c0-57c5-4617-b00f-0008605fc305 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:28.467258 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8283e1-fcdf-4cad-97a4-cf2d47b4e162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:28.467877 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8283e1-fcdf-4cad-97a4-cf2d47b4e162 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:28.468171 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8283e1-fcdf-4cad-97a4-cf2d47b4e162 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:28.468488 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8283e1-fcdf-4cad-97a4-cf2d47b4e162 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:28.469188 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8283e1-fcdf-4cad-97a4-cf2d47b4e162 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:28.470870 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8283e1-fcdf-4cad-97a4-cf2d47b4e162 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:28.483042 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1263/2530] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:47:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:47:28.487160 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b4eeba-676f-43a3-aa11-0b349d9ab53c admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:28.497729 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b4eeba-676f-43a3-aa11-0b349d9ab53c admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:28.502369 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8e39b4-ff2f-451f-ba00-0b1e1bbf3d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:28.503026 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8e39b4-ff2f-451f-ba00-0b1e1bbf3d28 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:28.503315 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8e39b4-ff2f-451f-ba00-0b1e1bbf3d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:28.504185 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8e39b4-ff2f-451f-ba00-0b1e1bbf3d28 admin admin] PATH_INFO: `/v3/projects/d9ecc49f2c924ee79140c2a528336c23/users/005c8378f2ee430b99dc8af7c9506058/roles/462e3381a85c42a9959201f9aa122f7c` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:28.518474 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8e39b4-ff2f-451f-ba00-0b1e1bbf3d28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9ecc49f2c924ee79140c2a528336c23, user_id=005c8378f2ee430b99dc8af7c9506058, role_id=462e3381a85c42a9959201f9aa122f7c)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:28.521251 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8e39b4-ff2f-451f-ba00-0b1e1bbf3d28 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:28.533717 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1268/2531] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:47:28 2022] PUT /identity/v3/projects/d9ecc49f2c924ee79140c2a528336c23/users/005c8378f2ee430b99dc8af7c9506058/roles/462e3381a85c42a9959201f9aa122f7c => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:47:28.545048 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e98a9e6-db88-416d-a8d5-45b99157ef74 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:28.545341 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e98a9e6-db88-416d-a8d5-45b99157ef74 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:28.545623 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e98a9e6-db88-416d-a8d5-45b99157ef74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:28.574429 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-9e98a9e6-db88-416d-a8d5-45b99157ef74 None None] MFA Rules not processed for user `005c8378f2ee430b99dc8af7c9506058`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:47:28.575611 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-9e98a9e6-db88-416d-a8d5-45b99157ef74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:28.638443 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1264/2532] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:47:28 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:47:28.643624 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8e39b4-ff2f-451f-ba00-0b1e1bbf3d28 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:28.705206 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8e39b4-ff2f-451f-ba00-0b1e1bbf3d28 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:28.709736 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df6ca6f-5e84-409a-85ff-fb7b12b9239d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:28.710340 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df6ca6f-5e84-409a-85ff-fb7b12b9239d admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:28.710620 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df6ca6f-5e84-409a-85ff-fb7b12b9239d admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:28.710895 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df6ca6f-5e84-409a-85ff-fb7b12b9239d admin admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:28.711543 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df6ca6f-5e84-409a-85ff-fb7b12b9239d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:28.713521 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df6ca6f-5e84-409a-85ff-fb7b12b9239d admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:28.744598 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1269/2533] 10.222.0.70 () {60 vars in 1153 bytes} [Tue Aug 2 21:47:28 2022] POST /identity/v3/projects => generated 387 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:47:28.748845 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e98a9e6-db88-416d-a8d5-45b99157ef74 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:28.760975 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e98a9e6-db88-416d-a8d5-45b99157ef74 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:28.765555 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:28.818918 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea7f36d-e54d-47e4-864f-44c096ac1542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:28.819838 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea7f36d-e54d-47e4-864f-44c096ac1542 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:28.820124 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea7f36d-e54d-47e4-864f-44c096ac1542 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:28.820488 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea7f36d-e54d-47e4-864f-44c096ac1542 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:28.821253 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea7f36d-e54d-47e4-864f-44c096ac1542 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:28.823187 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea7f36d-e54d-47e4-864f-44c096ac1542 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:28.843500 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1265/2534] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 2 21:47:28 2022] POST /identity/v3/users => generated 300 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:47:28.848117 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df6ca6f-5e84-409a-85ff-fb7b12b9239d admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:28.858854 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df6ca6f-5e84-409a-85ff-fb7b12b9239d admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:28.864012 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869b6190-2f71-42b4-ab73-a0330cdb35a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:28.864651 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869b6190-2f71-42b4-ab73-a0330cdb35a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:28.864939 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869b6190-2f71-42b4-ab73-a0330cdb35a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:28.865219 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869b6190-2f71-42b4-ab73-a0330cdb35a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:28.865906 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869b6190-2f71-42b4-ab73-a0330cdb35a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:28.867512 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869b6190-2f71-42b4-ab73-a0330cdb35a9 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:28.878005 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1270/2535] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:47:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:47:28.882014 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea7f36d-e54d-47e4-864f-44c096ac1542 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:28.891923 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea7f36d-e54d-47e4-864f-44c096ac1542 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:28.896471 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e627c1-6990-4f9a-bd8b-b6a1be2265de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:28.897127 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e627c1-6990-4f9a-bd8b-b6a1be2265de admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:28.897419 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e627c1-6990-4f9a-bd8b-b6a1be2265de admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:28.897699 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e627c1-6990-4f9a-bd8b-b6a1be2265de admin admin] PATH_INFO: `/v3/projects/035d89eed32241ad96745c3f011e8b73/users/c8718a521b3f42c196785064236df362/roles/3e32dbf75f9b41f5adb9fe59851267bb` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:28.912879 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e627c1-6990-4f9a-bd8b-b6a1be2265de admin admin] RBAC: Authorizing `identity:create_grant(project_id=035d89eed32241ad96745c3f011e8b73, user_id=c8718a521b3f42c196785064236df362, role_id=3e32dbf75f9b41f5adb9fe59851267bb)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:28.915553 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e627c1-6990-4f9a-bd8b-b6a1be2265de admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:28.928279 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1266/2536] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:47:28 2022] PUT /identity/v3/projects/035d89eed32241ad96745c3f011e8b73/users/c8718a521b3f42c196785064236df362/roles/3e32dbf75f9b41f5adb9fe59851267bb => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:47:28.932206 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869b6190-2f71-42b4-ab73-a0330cdb35a9 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:28.942760 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869b6190-2f71-42b4-ab73-a0330cdb35a9 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:28.998206 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67378248-66b0-404d-bdc0-30563dfbb23f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:28.998820 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67378248-66b0-404d-bdc0-30563dfbb23f admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:28.999103 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67378248-66b0-404d-bdc0-30563dfbb23f admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:28.999381 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67378248-66b0-404d-bdc0-30563dfbb23f admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:29.000096 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67378248-66b0-404d-bdc0-30563dfbb23f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:29.001722 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67378248-66b0-404d-bdc0-30563dfbb23f admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:29.004308 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:29.013439 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1271/2537] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:47:28 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:47:29.017296 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e627c1-6990-4f9a-bd8b-b6a1be2265de admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:29.027983 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e627c1-6990-4f9a-bd8b-b6a1be2265de admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:29.032606 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfd2525-0ffd-426d-8f8b-dfc39e702159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:29.033314 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfd2525-0ffd-426d-8f8b-dfc39e702159 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:29.033599 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfd2525-0ffd-426d-8f8b-dfc39e702159 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:29.033879 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfd2525-0ffd-426d-8f8b-dfc39e702159 admin admin] PATH_INFO: `/v3/projects/035d89eed32241ad96745c3f011e8b73/users/c8718a521b3f42c196785064236df362/roles/3e32dbf75f9b41f5adb9fe59851267bb` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:29.035928 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfd2525-0ffd-426d-8f8b-dfc39e702159 admin admin] RBAC: Authorizing `identity:create_grant(project_id=035d89eed32241ad96745c3f011e8b73, user_id=c8718a521b3f42c196785064236df362, role_id=3e32dbf75f9b41f5adb9fe59851267bb)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:29.038657 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfd2525-0ffd-426d-8f8b-dfc39e702159 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:29.050198 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1267/2538] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:47:29 2022] PUT /identity/v3/projects/035d89eed32241ad96745c3f011e8b73/users/c8718a521b3f42c196785064236df362/roles/3e32dbf75f9b41f5adb9fe59851267bb => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:47:29.060383 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee860f7-3d00-488d-9596-9119a30500b8 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:29.060681 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee860f7-3d00-488d-9596-9119a30500b8 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:29.060962 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee860f7-3d00-488d-9596-9119a30500b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:29.089331 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-6ee860f7-3d00-488d-9596-9119a30500b8 None None] MFA Rules not processed for user `c8718a521b3f42c196785064236df362`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:47:29.090546 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-6ee860f7-3d00-488d-9596-9119a30500b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:29.161541 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfd2525-0ffd-426d-8f8b-dfc39e702159 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:29.163292 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-5cfd2525-0ffd-426d-8f8b-dfc39e702159 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:29.166274 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1272/2539] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:47:29 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:47:29.180482 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee860f7-3d00-488d-9596-9119a30500b8 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:29.182705 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-6ee860f7-3d00-488d-9596-9119a30500b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:29.227841 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfd2525-0ffd-426d-8f8b-dfc39e702159 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:29.231884 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c9c075-945a-46fb-9ea3-a45296780878 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '123eb76f95ee4e39905944da701c712d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:29.232548 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c9c075-945a-46fb-9ea3-a45296780878 service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:29.232837 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c9c075-945a-46fb-9ea3-a45296780878 service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:29.233119 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c9c075-945a-46fb-9ea3-a45296780878 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:29.235141 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-17c9c075-945a-46fb-9ea3-a45296780878 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:29.249444 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee860f7-3d00-488d-9596-9119a30500b8 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:29.255032 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1716159-86aa-46b9-a38d-a42c52c3a59c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '123eb76f95ee4e39905944da701c712d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:29.255714 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1716159-86aa-46b9-a38d-a42c52c3a59c service cinder] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:29.256007 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1716159-86aa-46b9-a38d-a42c52c3a59c service cinder] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:29.256316 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1716159-86aa-46b9-a38d-a42c52c3a59c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:29.266027 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1716159-86aa-46b9-a38d-a42c52c3a59c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:29.267476 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1716159-86aa-46b9-a38d-a42c52c3a59c service cinder] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:29.277918 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1273/2540] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:47:29 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:47:29.305803 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c9c075-945a-46fb-9ea3-a45296780878 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:29.308280 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c9c075-945a-46fb-9ea3-a45296780878 service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:29.315746 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1716159-86aa-46b9-a38d-a42c52c3a59c service cinder] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:29.320835 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1268/2541] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:47:29 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 21:47:29.393900 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1716159-86aa-46b9-a38d-a42c52c3a59c service cinder] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:29.393900 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629a718b-da90-44b1-b8fe-54789247498d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:29.393900 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629a718b-da90-44b1-b8fe-54789247498d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:29.393900 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629a718b-da90-44b1-b8fe-54789247498d admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:29.394818 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629a718b-da90-44b1-b8fe-54789247498d admin admin] PATH_INFO: `/v3/users/005c8378f2ee430b99dc8af7c9506058` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:29.394996 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629a718b-da90-44b1-b8fe-54789247498d admin admin] RBAC: Authorizing `identity:delete_user(user_id=005c8378f2ee430b99dc8af7c9506058)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:29.396907 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629a718b-da90-44b1-b8fe-54789247498d admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:29.434720 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:29.454862 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-629a718b-da90-44b1-b8fe-54789247498d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '005c8378f2ee430b99dc8af7c9506058'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:29.463303 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-629a718b-da90-44b1-b8fe-54789247498d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '005c8378f2ee430b99dc8af7c9506058'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:29.477426 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-629a718b-da90-44b1-b8fe-54789247498d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '005c8378f2ee430b99dc8af7c9506058'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:29.486198 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-629a718b-da90-44b1-b8fe-54789247498d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '005c8378f2ee430b99dc8af7c9506058'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:29.487404 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-629a718b-da90-44b1-b8fe-54789247498d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '005c8378f2ee430b99dc8af7c9506058'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:29.494382 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1274/2542] 10.222.0.70 () {58 vars in 1224 bytes} [Tue Aug 2 21:47:29 2022] DELETE /identity/v3/users/005c8378f2ee430b99dc8af7c9506058 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:47:29.498565 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e41a56e-b392-492d-bd16-a9d30dd7f440 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:29.499012 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e41a56e-b392-492d-bd16-a9d30dd7f440 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:29.499120 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e41a56e-b392-492d-bd16-a9d30dd7f440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:29.518359 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-6e41a56e-b392-492d-bd16-a9d30dd7f440 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:47:29.520063 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-6e41a56e-b392-492d-bd16-a9d30dd7f440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:29.526264 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:29.583435 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1269/2543] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:47:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:47:29.594221 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629a718b-da90-44b1-b8fe-54789247498d admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:29.595865 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-629a718b-da90-44b1-b8fe-54789247498d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:29.670366 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629a718b-da90-44b1-b8fe-54789247498d admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:29.674112 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72b0a1d-8327-4c0f-95eb-275d0c158255 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '723f5f43572a493dae0349070a2adb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:29.674739 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72b0a1d-8327-4c0f-95eb-275d0c158255 service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:29.675021 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72b0a1d-8327-4c0f-95eb-275d0c158255 service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:29.681371 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72b0a1d-8327-4c0f-95eb-275d0c158255 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:29.693041 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72b0a1d-8327-4c0f-95eb-275d0c158255 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:29.694494 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72b0a1d-8327-4c0f-95eb-275d0c158255 service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:29.715951 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1275/2544] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:47:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:47:30.150822 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e41a56e-b392-492d-bd16-a9d30dd7f440 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:30.152417 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-6e41a56e-b392-492d-bd16-a9d30dd7f440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:30.165198 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e41a56e-b392-492d-bd16-a9d30dd7f440 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:30.169795 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc29ce2-9798-452f-ba6a-77650a8a1fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:30.170442 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc29ce2-9798-452f-ba6a-77650a8a1fe5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:30.170728 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc29ce2-9798-452f-ba6a-77650a8a1fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:30.171007 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc29ce2-9798-452f-ba6a-77650a8a1fe5 admin admin] PATH_INFO: `/v3/projects/d9ecc49f2c924ee79140c2a528336c23` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:30.172306 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc29ce2-9798-452f-ba6a-77650a8a1fe5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9ecc49f2c924ee79140c2a528336c23)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:30.174284 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc29ce2-9798-452f-ba6a-77650a8a1fe5 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:30.226295 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-9cc29ce2-9798-452f-ba6a-77650a8a1fe5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9ecc49f2c924ee79140c2a528336c23', 'request_id': 'req-9cc29ce2-9798-452f-ba6a-77650a8a1fe5'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:30.233703 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-9cc29ce2-9798-452f-ba6a-77650a8a1fe5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9ecc49f2c924ee79140c2a528336c23', 'request_id': 'req-9cc29ce2-9798-452f-ba6a-77650a8a1fe5'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:30.239536 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-9cc29ce2-9798-452f-ba6a-77650a8a1fe5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9ecc49f2c924ee79140c2a528336c23', 'request_id': 'req-9cc29ce2-9798-452f-ba6a-77650a8a1fe5'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:30.251891 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-9cc29ce2-9798-452f-ba6a-77650a8a1fe5 admin admin] The token cache is being invalidate because project d9ecc49f2c924ee79140c2a528336c23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:47:30.252187 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-9cc29ce2-9798-452f-ba6a-77650a8a1fe5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:30.252937 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-9cc29ce2-9798-452f-ba6a-77650a8a1fe5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:30.255288 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1270/2545] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Aug 2 21:47:30 2022] DELETE /identity/v3/projects/d9ecc49f2c924ee79140c2a528336c23 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:47:30.259007 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72b0a1d-8327-4c0f-95eb-275d0c158255 service neutron] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:30.269901 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72b0a1d-8327-4c0f-95eb-275d0c158255 service neutron] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:30.333702 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fe354a-f156-46ce-b4ba-e8ca3da07cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:30.334347 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe354a-f156-46ce-b4ba-e8ca3da07cc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:30.334628 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe354a-f156-46ce-b4ba-e8ca3da07cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:30.334902 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fe354a-f156-46ce-b4ba-e8ca3da07cc0 admin admin] PATH_INFO: `/v3/users/c8718a521b3f42c196785064236df362` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:30.336059 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fe354a-f156-46ce-b4ba-e8ca3da07cc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8718a521b3f42c196785064236df362)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:30.338027 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fe354a-f156-46ce-b4ba-e8ca3da07cc0 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:30.386133 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-e2fe354a-f156-46ce-b4ba-e8ca3da07cc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8718a521b3f42c196785064236df362'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:30.389284 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:30.396719 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-e2fe354a-f156-46ce-b4ba-e8ca3da07cc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8718a521b3f42c196785064236df362'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:30.412831 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-e2fe354a-f156-46ce-b4ba-e8ca3da07cc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8718a521b3f42c196785064236df362'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:30.420445 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-e2fe354a-f156-46ce-b4ba-e8ca3da07cc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8718a521b3f42c196785064236df362'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:30.421265 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-e2fe354a-f156-46ce-b4ba-e8ca3da07cc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8718a521b3f42c196785064236df362'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:30.427752 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1276/2546] 10.222.0.70 () {58 vars in 1224 bytes} [Tue Aug 2 21:47:30 2022] DELETE /identity/v3/users/c8718a521b3f42c196785064236df362 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:47:30.773752 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc29ce2-9798-452f-ba6a-77650a8a1fe5 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:30.775234 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-9cc29ce2-9798-452f-ba6a-77650a8a1fe5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:30.821556 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc29ce2-9798-452f-ba6a-77650a8a1fe5 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:30.935056 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf29a00-73eb-4a74-9150-d106dd6c157b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:30.935816 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf29a00-73eb-4a74-9150-d106dd6c157b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:30.936344 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf29a00-73eb-4a74-9150-d106dd6c157b admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:30.936693 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf29a00-73eb-4a74-9150-d106dd6c157b admin admin] PATH_INFO: `/v3/projects/035d89eed32241ad96745c3f011e8b73` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:30.937953 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf29a00-73eb-4a74-9150-d106dd6c157b admin admin] RBAC: Authorizing `identity:delete_project(project_id=035d89eed32241ad96745c3f011e8b73)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:30.940213 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf29a00-73eb-4a74-9150-d106dd6c157b admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:31.011200 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:31.025247 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-dcf29a00-73eb-4a74-9150-d106dd6c157b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '035d89eed32241ad96745c3f011e8b73', 'request_id': 'req-dcf29a00-73eb-4a74-9150-d106dd6c157b'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:31.037336 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-dcf29a00-73eb-4a74-9150-d106dd6c157b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '035d89eed32241ad96745c3f011e8b73', 'request_id': 'req-dcf29a00-73eb-4a74-9150-d106dd6c157b'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:31.043423 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-dcf29a00-73eb-4a74-9150-d106dd6c157b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '035d89eed32241ad96745c3f011e8b73', 'request_id': 'req-dcf29a00-73eb-4a74-9150-d106dd6c157b'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:31.058311 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-dcf29a00-73eb-4a74-9150-d106dd6c157b admin admin] The token cache is being invalidate because project 035d89eed32241ad96745c3f011e8b73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:47:31.058656 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-dcf29a00-73eb-4a74-9150-d106dd6c157b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:31.059564 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-dcf29a00-73eb-4a74-9150-d106dd6c157b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:31.061471 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1271/2547] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Aug 2 21:47:30 2022] DELETE /identity/v3/projects/035d89eed32241ad96745c3f011e8b73 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:47:31.067512 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec25b95-d42a-44bf-933a-f76db2ea38a1 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:31.067995 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec25b95-d42a-44bf-933a-f76db2ea38a1 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:31.068132 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec25b95-d42a-44bf-933a-f76db2ea38a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:31.088471 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-5ec25b95-d42a-44bf-933a-f76db2ea38a1 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:47:31.089720 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-5ec25b95-d42a-44bf-933a-f76db2ea38a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:31.152763 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1277/2548] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:47:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:47:31.161989 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1f8c98-b12b-480c-8fed-0571d84a01c9 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:31.162309 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1f8c98-b12b-480c-8fed-0571d84a01c9 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:31.162590 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1f8c98-b12b-480c-8fed-0571d84a01c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:31.185282 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-bf1f8c98-b12b-480c-8fed-0571d84a01c9 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:47:31.186820 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-bf1f8c98-b12b-480c-8fed-0571d84a01c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:31.195737 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1272/2549] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:47:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:47:31.200019 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec25b95-d42a-44bf-933a-f76db2ea38a1 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:31.211059 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec25b95-d42a-44bf-933a-f76db2ea38a1 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:31.218715 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1c3bc3-97cf-4c0b-9efe-d4beb6904729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:31.219427 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c3bc3-97cf-4c0b-9efe-d4beb6904729 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:31.219712 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c3bc3-97cf-4c0b-9efe-d4beb6904729 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:31.219998 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c3bc3-97cf-4c0b-9efe-d4beb6904729 admin admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:31.220821 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1c3bc3-97cf-4c0b-9efe-d4beb6904729 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:47:31.221171 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1c3bc3-97cf-4c0b-9efe-d4beb6904729 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:31.223552 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1c3bc3-97cf-4c0b-9efe-d4beb6904729 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:31.237020 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1278/2550] 10.222.0.70 () {58 vars in 1153 bytes} [Tue Aug 2 21:47:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:47:31.242162 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1f8c98-b12b-480c-8fed-0571d84a01c9 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:31.252438 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1f8c98-b12b-480c-8fed-0571d84a01c9 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:31.257898 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf066b0-531c-4156-a408-1723660a9c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:31.258515 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf066b0-531c-4156-a408-1723660a9c37 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:31.258801 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf066b0-531c-4156-a408-1723660a9c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:31.259078 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf066b0-531c-4156-a408-1723660a9c37 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:31.259751 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf066b0-531c-4156-a408-1723660a9c37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:31.261747 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf066b0-531c-4156-a408-1723660a9c37 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:31.293231 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1273/2551] 10.222.0.70 () {60 vars in 1153 bytes} [Tue Aug 2 21:47:31 2022] POST /identity/v3/projects => generated 371 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:47:31.297304 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1c3bc3-97cf-4c0b-9efe-d4beb6904729 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:31.308423 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1c3bc3-97cf-4c0b-9efe-d4beb6904729 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:31.371801 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b25da8a-f6c6-4f9c-90e3-fcf251f12a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:31.372464 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b25da8a-f6c6-4f9c-90e3-fcf251f12a1c admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:31.372749 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b25da8a-f6c6-4f9c-90e3-fcf251f12a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:31.373027 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b25da8a-f6c6-4f9c-90e3-fcf251f12a1c admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:31.373706 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b25da8a-f6c6-4f9c-90e3-fcf251f12a1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:31.375872 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b25da8a-f6c6-4f9c-90e3-fcf251f12a1c admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:31.400860 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1279/2552] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 2 21:47:31 2022] POST /identity/v3/users => generated 286 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:47:31.405264 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf066b0-531c-4156-a408-1723660a9c37 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:31.416778 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf066b0-531c-4156-a408-1723660a9c37 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:31.422101 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a4dbec-74a2-4e94-8502-f6bb7c00efc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:31.422746 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a4dbec-74a2-4e94-8502-f6bb7c00efc6 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:31.423030 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a4dbec-74a2-4e94-8502-f6bb7c00efc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:31.423306 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a4dbec-74a2-4e94-8502-f6bb7c00efc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:31.424011 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a4dbec-74a2-4e94-8502-f6bb7c00efc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:31.426399 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a4dbec-74a2-4e94-8502-f6bb7c00efc6 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:31.440891 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1274/2553] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:47:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:47:31.442261 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b25da8a-f6c6-4f9c-90e3-fcf251f12a1c admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:31.453228 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b25da8a-f6c6-4f9c-90e3-fcf251f12a1c admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:31.458726 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef68d9e0-f04a-4c34-9623-1e157c2358b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:31.459350 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef68d9e0-f04a-4c34-9623-1e157c2358b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:31.460122 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef68d9e0-f04a-4c34-9623-1e157c2358b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:31.460617 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef68d9e0-f04a-4c34-9623-1e157c2358b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:31.461371 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef68d9e0-f04a-4c34-9623-1e157c2358b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:31.462926 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef68d9e0-f04a-4c34-9623-1e157c2358b8 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:31.475348 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1280/2554] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:47:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:47:31.481192 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a4dbec-74a2-4e94-8502-f6bb7c00efc6 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:31.495865 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a4dbec-74a2-4e94-8502-f6bb7c00efc6 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:31.502053 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82828f30-b909-4cd6-929c-96a642f1f97d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:31.502862 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82828f30-b909-4cd6-929c-96a642f1f97d admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:31.503414 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82828f30-b909-4cd6-929c-96a642f1f97d admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:31.503844 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82828f30-b909-4cd6-929c-96a642f1f97d admin admin] PATH_INFO: `/v3/projects/55236c1c662145eab742c3416fced3e3/users/1567bf4d4be04463a2f0f23d47837b60/roles/462e3381a85c42a9959201f9aa122f7c` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:31.522656 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82828f30-b909-4cd6-929c-96a642f1f97d admin admin] RBAC: Authorizing `identity:create_grant(project_id=55236c1c662145eab742c3416fced3e3, user_id=1567bf4d4be04463a2f0f23d47837b60, role_id=462e3381a85c42a9959201f9aa122f7c)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:31.526367 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82828f30-b909-4cd6-929c-96a642f1f97d admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:31.545802 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1275/2555] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:47:31 2022] PUT /identity/v3/projects/55236c1c662145eab742c3416fced3e3/users/1567bf4d4be04463a2f0f23d47837b60/roles/462e3381a85c42a9959201f9aa122f7c => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:47:31.555754 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee864cc1-ff0b-4d4b-9816-f32cd69cbaee None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:31.556132 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee864cc1-ff0b-4d4b-9816-f32cd69cbaee None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:31.556513 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee864cc1-ff0b-4d4b-9816-f32cd69cbaee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:31.585289 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-ee864cc1-ff0b-4d4b-9816-f32cd69cbaee None None] MFA Rules not processed for user `1567bf4d4be04463a2f0f23d47837b60`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:47:31.586585 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-ee864cc1-ff0b-4d4b-9816-f32cd69cbaee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:31.607450 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:31.654994 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1281/2556] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:47:31 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:47:31.667291 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82828f30-b909-4cd6-929c-96a642f1f97d admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:31.669033 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-82828f30-b909-4cd6-929c-96a642f1f97d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:31.728768 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82828f30-b909-4cd6-929c-96a642f1f97d admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:31.732841 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e27579-6b66-409b-9c0c-1ca7863b8178 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '123eb76f95ee4e39905944da701c712d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:31.733600 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e27579-6b66-409b-9c0c-1ca7863b8178 service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:31.733889 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e27579-6b66-409b-9c0c-1ca7863b8178 service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:31.734171 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e27579-6b66-409b-9c0c-1ca7863b8178 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:31.743465 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e27579-6b66-409b-9c0c-1ca7863b8178 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:31.744978 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e27579-6b66-409b-9c0c-1ca7863b8178 service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:31.758382 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1276/2557] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:47:31 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:47:31.780608 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee864cc1-ff0b-4d4b-9816-f32cd69cbaee None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:31.846665 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee864cc1-ff0b-4d4b-9816-f32cd69cbaee None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:31.852126 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cf3fb8-6887-44d8-8ad5-36e1db656299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:31.852823 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cf3fb8-6887-44d8-8ad5-36e1db656299 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:31.853107 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cf3fb8-6887-44d8-8ad5-36e1db656299 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:31.853385 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cf3fb8-6887-44d8-8ad5-36e1db656299 admin admin] PATH_INFO: `/v3/users/1567bf4d4be04463a2f0f23d47837b60` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:31.854974 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cf3fb8-6887-44d8-8ad5-36e1db656299 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1567bf4d4be04463a2f0f23d47837b60)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:31.856999 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cf3fb8-6887-44d8-8ad5-36e1db656299 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:31.913875 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-e8cf3fb8-6887-44d8-8ad5-36e1db656299 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1567bf4d4be04463a2f0f23d47837b60'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:31.924355 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-e8cf3fb8-6887-44d8-8ad5-36e1db656299 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1567bf4d4be04463a2f0f23d47837b60'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:31.939664 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-e8cf3fb8-6887-44d8-8ad5-36e1db656299 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1567bf4d4be04463a2f0f23d47837b60'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:31.948565 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-e8cf3fb8-6887-44d8-8ad5-36e1db656299 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1567bf4d4be04463a2f0f23d47837b60'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:31.949337 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-e8cf3fb8-6887-44d8-8ad5-36e1db656299 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1567bf4d4be04463a2f0f23d47837b60'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:31.961041 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1282/2558] 10.222.0.70 () {58 vars in 1224 bytes} [Tue Aug 2 21:47:31 2022] DELETE /identity/v3/users/1567bf4d4be04463a2f0f23d47837b60 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:47:31.965807 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee75f06-4c40-4c9b-9983-212affc7b0c2 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:31.966691 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee75f06-4c40-4c9b-9983-212affc7b0c2 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:31.966974 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee75f06-4c40-4c9b-9983-212affc7b0c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:31.988877 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-5ee75f06-4c40-4c9b-9983-212affc7b0c2 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:47:31.990051 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-5ee75f06-4c40-4c9b-9983-212affc7b0c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:32.084677 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1277/2559] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:47:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:47:32.092265 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cf3fb8-6887-44d8-8ad5-36e1db656299 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:32.094351 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-e8cf3fb8-6887-44d8-8ad5-36e1db656299 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:32.153368 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:32.172771 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cf3fb8-6887-44d8-8ad5-36e1db656299 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:32.186084 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735c1934-d7f4-48cb-a811-1aa735c8ef6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '723f5f43572a493dae0349070a2adb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:32.186759 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735c1934-d7f4-48cb-a811-1aa735c8ef6c service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:32.187049 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735c1934-d7f4-48cb-a811-1aa735c8ef6c service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:32.187329 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735c1934-d7f4-48cb-a811-1aa735c8ef6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:32.200801 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735c1934-d7f4-48cb-a811-1aa735c8ef6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:32.202426 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735c1934-d7f4-48cb-a811-1aa735c8ef6c service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:32.223096 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1283/2560] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:47:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:47:32.553033 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee75f06-4c40-4c9b-9983-212affc7b0c2 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:32.554742 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-5ee75f06-4c40-4c9b-9983-212affc7b0c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:32.577616 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:32.582815 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee75f06-4c40-4c9b-9983-212affc7b0c2 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:32.589729 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddca0e4-002d-43d0-af93-ef0d978be631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:32.590526 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddca0e4-002d-43d0-af93-ef0d978be631 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:32.590905 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddca0e4-002d-43d0-af93-ef0d978be631 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:32.591196 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddca0e4-002d-43d0-af93-ef0d978be631 admin admin] PATH_INFO: `/v3/projects/55236c1c662145eab742c3416fced3e3` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:32.592978 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddca0e4-002d-43d0-af93-ef0d978be631 admin admin] RBAC: Authorizing `identity:delete_project(project_id=55236c1c662145eab742c3416fced3e3)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:32.595366 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddca0e4-002d-43d0-af93-ef0d978be631 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:32.647120 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-1ddca0e4-002d-43d0-af93-ef0d978be631 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55236c1c662145eab742c3416fced3e3', 'request_id': 'req-1ddca0e4-002d-43d0-af93-ef0d978be631'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:32.655350 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-1ddca0e4-002d-43d0-af93-ef0d978be631 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55236c1c662145eab742c3416fced3e3', 'request_id': 'req-1ddca0e4-002d-43d0-af93-ef0d978be631'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:32.661943 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-1ddca0e4-002d-43d0-af93-ef0d978be631 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55236c1c662145eab742c3416fced3e3', 'request_id': 'req-1ddca0e4-002d-43d0-af93-ef0d978be631'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:32.673109 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-1ddca0e4-002d-43d0-af93-ef0d978be631 admin admin] The token cache is being invalidate because project 55236c1c662145eab742c3416fced3e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:47:32.673406 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-1ddca0e4-002d-43d0-af93-ef0d978be631 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:32.674058 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-1ddca0e4-002d-43d0-af93-ef0d978be631 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:32.676262 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1278/2561] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Aug 2 21:47:32 2022] DELETE /identity/v3/projects/55236c1c662145eab742c3416fced3e3 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:47:32.681413 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7377b88-d6d8-4a11-84d2-05a8794fac8e None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:32.681842 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7377b88-d6d8-4a11-84d2-05a8794fac8e None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:32.682127 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7377b88-d6d8-4a11-84d2-05a8794fac8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:32.703853 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-e7377b88-d6d8-4a11-84d2-05a8794fac8e None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:47:32.705111 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-e7377b88-d6d8-4a11-84d2-05a8794fac8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:32.768116 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1284/2562] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:47:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:47:32.775943 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cafc69-aa27-4664-9dda-abb4cd70af00 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:32.776257 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cafc69-aa27-4664-9dda-abb4cd70af00 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:32.776546 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cafc69-aa27-4664-9dda-abb4cd70af00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:32.797756 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-46cafc69-aa27-4664-9dda-abb4cd70af00 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:47:32.798832 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-46cafc69-aa27-4664-9dda-abb4cd70af00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:32.807718 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1279/2563] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:47:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:47:32.811719 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7377b88-d6d8-4a11-84d2-05a8794fac8e None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:32.821347 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7377b88-d6d8-4a11-84d2-05a8794fac8e None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:32.826411 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050bb621-3e4f-4061-9dee-e377ce307292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:32.827046 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050bb621-3e4f-4061-9dee-e377ce307292 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:32.827337 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050bb621-3e4f-4061-9dee-e377ce307292 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:32.827749 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050bb621-3e4f-4061-9dee-e377ce307292 admin admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:32.828394 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050bb621-3e4f-4061-9dee-e377ce307292 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:47:32.828774 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050bb621-3e4f-4061-9dee-e377ce307292 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:32.833544 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050bb621-3e4f-4061-9dee-e377ce307292 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:32.846841 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1285/2564] 10.222.0.70 () {58 vars in 1153 bytes} [Tue Aug 2 21:47:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:47:32.851801 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cafc69-aa27-4664-9dda-abb4cd70af00 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:32.861957 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cafc69-aa27-4664-9dda-abb4cd70af00 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:32.867535 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a45fbe-b2a0-446f-a451-38c66131f5dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:32.868331 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a45fbe-b2a0-446f-a451-38c66131f5dd admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:32.868618 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a45fbe-b2a0-446f-a451-38c66131f5dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:32.868936 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a45fbe-b2a0-446f-a451-38c66131f5dd admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:32.870016 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a45fbe-b2a0-446f-a451-38c66131f5dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:32.872337 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a45fbe-b2a0-446f-a451-38c66131f5dd admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:32.906235 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1280/2565] 10.222.0.70 () {60 vars in 1153 bytes} [Tue Aug 2 21:47:32 2022] POST /identity/v3/projects => generated 381 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 21:47:32.910775 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050bb621-3e4f-4061-9dee-e377ce307292 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:32.920762 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050bb621-3e4f-4061-9dee-e377ce307292 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:32.977524 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8530e3a1-e23c-40df-b126-6249c326f5ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:32.978150 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8530e3a1-e23c-40df-b126-6249c326f5ab admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:32.978453 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8530e3a1-e23c-40df-b126-6249c326f5ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:32.978718 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8530e3a1-e23c-40df-b126-6249c326f5ab admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:32.979382 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8530e3a1-e23c-40df-b126-6249c326f5ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:32.981647 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8530e3a1-e23c-40df-b126-6249c326f5ab admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:33.003394 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1286/2566] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 2 21:47:32 2022] POST /identity/v3/users => generated 291 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:47:33.007666 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a45fbe-b2a0-446f-a451-38c66131f5dd admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:33.020008 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a45fbe-b2a0-446f-a451-38c66131f5dd admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:33.024630 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65068781-5199-471b-9435-f135cd67e390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:33.025233 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65068781-5199-471b-9435-f135cd67e390 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:33.025513 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65068781-5199-471b-9435-f135cd67e390 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:33.025814 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65068781-5199-471b-9435-f135cd67e390 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:33.026500 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65068781-5199-471b-9435-f135cd67e390 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:33.028295 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65068781-5199-471b-9435-f135cd67e390 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:33.039713 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1281/2567] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:47:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:47:33.043747 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8530e3a1-e23c-40df-b126-6249c326f5ab admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:33.053907 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8530e3a1-e23c-40df-b126-6249c326f5ab admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:33.058782 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27057392-adc3-40c7-a0ec-9d946de3942b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:33.059377 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27057392-adc3-40c7-a0ec-9d946de3942b admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:33.059661 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27057392-adc3-40c7-a0ec-9d946de3942b admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:33.059935 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27057392-adc3-40c7-a0ec-9d946de3942b admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:33.060673 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27057392-adc3-40c7-a0ec-9d946de3942b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:33.062326 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27057392-adc3-40c7-a0ec-9d946de3942b admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:33.073465 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1287/2568] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:47:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:47:33.077853 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65068781-5199-471b-9435-f135cd67e390 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:33.089391 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65068781-5199-471b-9435-f135cd67e390 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:33.094644 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17350acd-82c7-4b94-8cca-984ecb180f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:33.095308 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17350acd-82c7-4b94-8cca-984ecb180f76 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:33.095595 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17350acd-82c7-4b94-8cca-984ecb180f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:33.095876 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17350acd-82c7-4b94-8cca-984ecb180f76 admin admin] PATH_INFO: `/v3/projects/5e0239aba9e9422eb8994a130cac0e49/users/018d1820c9da4102a359c23ea6741d0d/roles/462e3381a85c42a9959201f9aa122f7c` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:33.111478 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17350acd-82c7-4b94-8cca-984ecb180f76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e0239aba9e9422eb8994a130cac0e49, user_id=018d1820c9da4102a359c23ea6741d0d, role_id=462e3381a85c42a9959201f9aa122f7c)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:33.114409 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17350acd-82c7-4b94-8cca-984ecb180f76 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:33.127257 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1282/2569] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:47:33 2022] PUT /identity/v3/projects/5e0239aba9e9422eb8994a130cac0e49/users/018d1820c9da4102a359c23ea6741d0d/roles/462e3381a85c42a9959201f9aa122f7c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:47:33.138155 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e79fc7-24d3-47fd-b882-dcdd07693a92 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:33.138644 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e79fc7-24d3-47fd-b882-dcdd07693a92 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:33.138740 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e79fc7-24d3-47fd-b882-dcdd07693a92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:33.170439 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-71e79fc7-24d3-47fd-b882-dcdd07693a92 None None] MFA Rules not processed for user `018d1820c9da4102a359c23ea6741d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:47:33.171707 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-71e79fc7-24d3-47fd-b882-dcdd07693a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:33.216122 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:33.241954 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1288/2570] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:47:33 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:47:33.246493 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17350acd-82c7-4b94-8cca-984ecb180f76 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:33.308710 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17350acd-82c7-4b94-8cca-984ecb180f76 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:33.313372 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deb18be-e55a-4a0d-bde1-b74dd66b2e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:33.313986 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deb18be-e55a-4a0d-bde1-b74dd66b2e64 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:33.314275 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deb18be-e55a-4a0d-bde1-b74dd66b2e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:33.314560 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deb18be-e55a-4a0d-bde1-b74dd66b2e64 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:33.315235 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deb18be-e55a-4a0d-bde1-b74dd66b2e64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:33.317221 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deb18be-e55a-4a0d-bde1-b74dd66b2e64 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:33.344958 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1283/2571] 10.222.0.70 () {60 vars in 1153 bytes} [Tue Aug 2 21:47:33 2022] POST /identity/v3/projects => generated 381 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:47:33.349377 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e79fc7-24d3-47fd-b882-dcdd07693a92 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:33.360598 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e79fc7-24d3-47fd-b882-dcdd07693a92 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:33.417546 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30510b4-d131-454f-b95c-bd166342fbd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:33.418177 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30510b4-d131-454f-b95c-bd166342fbd4 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:33.418466 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30510b4-d131-454f-b95c-bd166342fbd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:33.418746 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30510b4-d131-454f-b95c-bd166342fbd4 admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:33.419431 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30510b4-d131-454f-b95c-bd166342fbd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:33.421443 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30510b4-d131-454f-b95c-bd166342fbd4 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:33.446033 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1289/2572] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 2 21:47:33 2022] POST /identity/v3/users => generated 291 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:47:33.447274 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deb18be-e55a-4a0d-bde1-b74dd66b2e64 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:33.458312 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deb18be-e55a-4a0d-bde1-b74dd66b2e64 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:33.462942 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020a785f-6974-407b-a3e4-8e875844d5c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:33.463558 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020a785f-6974-407b-a3e4-8e875844d5c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:33.463841 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020a785f-6974-407b-a3e4-8e875844d5c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:33.464127 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020a785f-6974-407b-a3e4-8e875844d5c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:33.464849 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020a785f-6974-407b-a3e4-8e875844d5c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:33.466443 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020a785f-6974-407b-a3e4-8e875844d5c9 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:33.468885 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:33.480569 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1284/2573] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:47:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:47:33.484767 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30510b4-d131-454f-b95c-bd166342fbd4 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:33.495075 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30510b4-d131-454f-b95c-bd166342fbd4 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:33.499811 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c833b6ad-5926-4a79-8fbe-ee37c5e81994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:33.500461 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c833b6ad-5926-4a79-8fbe-ee37c5e81994 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:33.500749 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c833b6ad-5926-4a79-8fbe-ee37c5e81994 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:33.501027 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c833b6ad-5926-4a79-8fbe-ee37c5e81994 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:33.501723 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c833b6ad-5926-4a79-8fbe-ee37c5e81994 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:33.503980 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c833b6ad-5926-4a79-8fbe-ee37c5e81994 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:33.517432 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1290/2574] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:47:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:47:33.518955 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020a785f-6974-407b-a3e4-8e875844d5c9 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:33.530081 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020a785f-6974-407b-a3e4-8e875844d5c9 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:33.534690 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12f0850-64e9-4b6e-95a4-a05d19b53a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:33.535342 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f0850-64e9-4b6e-95a4-a05d19b53a81 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:33.535629 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f0850-64e9-4b6e-95a4-a05d19b53a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:33.535899 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f0850-64e9-4b6e-95a4-a05d19b53a81 admin admin] PATH_INFO: `/v3/projects/0494c123f3424546b06a3bb6818a29cb/users/8b9d29766a44483fa9b4262c32ae457d/roles/462e3381a85c42a9959201f9aa122f7c` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:33.677845 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12f0850-64e9-4b6e-95a4-a05d19b53a81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0494c123f3424546b06a3bb6818a29cb, user_id=8b9d29766a44483fa9b4262c32ae457d, role_id=462e3381a85c42a9959201f9aa122f7c)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:33.680509 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12f0850-64e9-4b6e-95a4-a05d19b53a81 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:33.693410 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1285/2575] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:47:33 2022] PUT /identity/v3/projects/0494c123f3424546b06a3bb6818a29cb/users/8b9d29766a44483fa9b4262c32ae457d/roles/462e3381a85c42a9959201f9aa122f7c => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:47:33.703566 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c5ccb6-9e5d-4862-a70d-3d1476bd7f4e None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:33.703853 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c5ccb6-9e5d-4862-a70d-3d1476bd7f4e None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:33.704135 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c5ccb6-9e5d-4862-a70d-3d1476bd7f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:33.732662 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-a9c5ccb6-9e5d-4862-a70d-3d1476bd7f4e None None] MFA Rules not processed for user `8b9d29766a44483fa9b4262c32ae457d`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:47:33.733933 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-a9c5ccb6-9e5d-4862-a70d-3d1476bd7f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:33.800974 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1291/2576] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:47:33 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:47:33.805945 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12f0850-64e9-4b6e-95a4-a05d19b53a81 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:33.873405 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12f0850-64e9-4b6e-95a4-a05d19b53a81 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:33.877912 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6894104-7efe-4872-9003-df68ad478ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:33.879067 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6894104-7efe-4872-9003-df68ad478ec9 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:33.879345 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6894104-7efe-4872-9003-df68ad478ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:33.879617 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6894104-7efe-4872-9003-df68ad478ec9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:33.880300 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6894104-7efe-4872-9003-df68ad478ec9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:33.882177 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6894104-7efe-4872-9003-df68ad478ec9 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:33.911036 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1286/2577] 10.222.0.70 () {60 vars in 1153 bytes} [Tue Aug 2 21:47:33 2022] POST /identity/v3/projects => generated 383 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 21:47:33.913086 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c5ccb6-9e5d-4862-a70d-3d1476bd7f4e None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:33.924167 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c5ccb6-9e5d-4862-a70d-3d1476bd7f4e None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:33.980509 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:33.992923 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333e75ac-3bc7-4233-82ed-6ab87c5fc1b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:33.993559 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e75ac-3bc7-4233-82ed-6ab87c5fc1b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:33.993846 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e75ac-3bc7-4233-82ed-6ab87c5fc1b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:33.994125 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e75ac-3bc7-4233-82ed-6ab87c5fc1b9 admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:33.994792 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333e75ac-3bc7-4233-82ed-6ab87c5fc1b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:33.996828 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333e75ac-3bc7-4233-82ed-6ab87c5fc1b9 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:34.018873 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1292/2578] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 2 21:47:33 2022] POST /identity/v3/users => generated 298 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:47:34.022967 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6894104-7efe-4872-9003-df68ad478ec9 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:34.033510 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6894104-7efe-4872-9003-df68ad478ec9 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:34.039011 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b07ace9-9415-46d2-b1e3-161dfeff370c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:34.039705 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b07ace9-9415-46d2-b1e3-161dfeff370c admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:34.040040 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b07ace9-9415-46d2-b1e3-161dfeff370c admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:34.040633 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b07ace9-9415-46d2-b1e3-161dfeff370c admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:34.041387 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b07ace9-9415-46d2-b1e3-161dfeff370c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:34.043064 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b07ace9-9415-46d2-b1e3-161dfeff370c admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:34.055205 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1287/2579] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:47:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:47:34.059527 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333e75ac-3bc7-4233-82ed-6ab87c5fc1b9 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:34.071744 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333e75ac-3bc7-4233-82ed-6ab87c5fc1b9 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:34.076724 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe322757-2621-4b49-a3cc-59ba87cf484e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:34.077542 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe322757-2621-4b49-a3cc-59ba87cf484e admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:34.077899 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe322757-2621-4b49-a3cc-59ba87cf484e admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:34.078249 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe322757-2621-4b49-a3cc-59ba87cf484e admin admin] PATH_INFO: `/v3/projects/6a886cab94a54dd3aa77c48cee240822/users/96ef074f2a4d426591f359116fa03fd3/roles/3e32dbf75f9b41f5adb9fe59851267bb` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:34.095909 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe322757-2621-4b49-a3cc-59ba87cf484e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a886cab94a54dd3aa77c48cee240822, user_id=96ef074f2a4d426591f359116fa03fd3, role_id=3e32dbf75f9b41f5adb9fe59851267bb)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:34.099448 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe322757-2621-4b49-a3cc-59ba87cf484e admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:34.113424 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1293/2580] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:47:34 2022] PUT /identity/v3/projects/6a886cab94a54dd3aa77c48cee240822/users/96ef074f2a4d426591f359116fa03fd3/roles/3e32dbf75f9b41f5adb9fe59851267bb => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:47:34.117321 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b07ace9-9415-46d2-b1e3-161dfeff370c admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:34.127421 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b07ace9-9415-46d2-b1e3-161dfeff370c admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:34.182941 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9b22fe-f6b1-4c1a-97da-2149d1b4c3cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:34.183656 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9b22fe-f6b1-4c1a-97da-2149d1b4c3cc admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:34.183948 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9b22fe-f6b1-4c1a-97da-2149d1b4c3cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:34.184221 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9b22fe-f6b1-4c1a-97da-2149d1b4c3cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:34.184926 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9b22fe-f6b1-4c1a-97da-2149d1b4c3cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:34.186603 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9b22fe-f6b1-4c1a-97da-2149d1b4c3cc admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:34.196270 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1288/2581] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:47:34 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:47:34.200769 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe322757-2621-4b49-a3cc-59ba87cf484e admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:34.211593 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe322757-2621-4b49-a3cc-59ba87cf484e admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:34.216272 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a01614-81dd-4f21-9833-692d01b6626a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:34.216918 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a01614-81dd-4f21-9833-692d01b6626a admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:34.217202 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a01614-81dd-4f21-9833-692d01b6626a admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:34.217479 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a01614-81dd-4f21-9833-692d01b6626a admin admin] PATH_INFO: `/v3/projects/6a886cab94a54dd3aa77c48cee240822/users/96ef074f2a4d426591f359116fa03fd3/roles/3e32dbf75f9b41f5adb9fe59851267bb` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:34.219460 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a01614-81dd-4f21-9833-692d01b6626a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a886cab94a54dd3aa77c48cee240822, user_id=96ef074f2a4d426591f359116fa03fd3, role_id=3e32dbf75f9b41f5adb9fe59851267bb)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:34.222681 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a01614-81dd-4f21-9833-692d01b6626a admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:34.233335 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1294/2582] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:47:34 2022] PUT /identity/v3/projects/6a886cab94a54dd3aa77c48cee240822/users/96ef074f2a4d426591f359116fa03fd3/roles/3e32dbf75f9b41f5adb9fe59851267bb => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:47:34.244471 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77e184b-ec7b-46fc-ba3b-37ad860545c2 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:34.244760 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77e184b-ec7b-46fc-ba3b-37ad860545c2 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:34.245041 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77e184b-ec7b-46fc-ba3b-37ad860545c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:34.273778 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-b77e184b-ec7b-46fc-ba3b-37ad860545c2 None None] MFA Rules not processed for user `96ef074f2a4d426591f359116fa03fd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:47:34.275159 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-b77e184b-ec7b-46fc-ba3b-37ad860545c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:34.308553 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:34.345250 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1289/2583] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:47:34 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:47:34.357337 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a01614-81dd-4f21-9833-692d01b6626a admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:34.359059 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-d3a01614-81dd-4f21-9833-692d01b6626a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:34.416982 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a01614-81dd-4f21-9833-692d01b6626a admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:34.420654 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb3bcc9-8407-4b13-aee6-788170c2377a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '123eb76f95ee4e39905944da701c712d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:34.421266 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb3bcc9-8407-4b13-aee6-788170c2377a service cinder] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:34.421614 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb3bcc9-8407-4b13-aee6-788170c2377a service cinder] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:34.421849 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb3bcc9-8407-4b13-aee6-788170c2377a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:34.478338 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb3bcc9-8407-4b13-aee6-788170c2377a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:34.480039 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb3bcc9-8407-4b13-aee6-788170c2377a service cinder] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:34.489522 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1295/2584] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:47:34 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:47:35.213370 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77e184b-ec7b-46fc-ba3b-37ad860545c2 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:35.214872 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-b77e184b-ec7b-46fc-ba3b-37ad860545c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:35.274272 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77e184b-ec7b-46fc-ba3b-37ad860545c2 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:35.278702 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa865660-7e90-4b56-9f93-a7bd21df1f9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '723f5f43572a493dae0349070a2adb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:35.279471 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa865660-7e90-4b56-9f93-a7bd21df1f9f service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:35.279793 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa865660-7e90-4b56-9f93-a7bd21df1f9f service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:35.280125 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa865660-7e90-4b56-9f93-a7bd21df1f9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:35.282110 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-fa865660-7e90-4b56-9f93-a7bd21df1f9f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:35.351302 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa865660-7e90-4b56-9f93-a7bd21df1f9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:35.352846 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa865660-7e90-4b56-9f93-a7bd21df1f9f service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:35.364358 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1290/2585] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:47:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:47:36.043613 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb3bcc9-8407-4b13-aee6-788170c2377a service cinder] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:36.045714 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-9cb3bcc9-8407-4b13-aee6-788170c2377a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:36.057547 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb3bcc9-8407-4b13-aee6-788170c2377a service cinder] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:36.061719 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c8c5e7-e1bd-4bf8-a6e2-f1ace0955aca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '123eb76f95ee4e39905944da701c712d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:36.062422 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c8c5e7-e1bd-4bf8-a6e2-f1ace0955aca service cinder] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:36.062788 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c8c5e7-e1bd-4bf8-a6e2-f1ace0955aca service cinder] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:36.063130 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c8c5e7-e1bd-4bf8-a6e2-f1ace0955aca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:36.132108 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:36.136072 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c8c5e7-e1bd-4bf8-a6e2-f1ace0955aca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:36.138693 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c8c5e7-e1bd-4bf8-a6e2-f1ace0955aca service cinder] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:36.149241 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1296/2586] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:47:36 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:47:36.751999 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa865660-7e90-4b56-9f93-a7bd21df1f9f service neutron] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:36.762164 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa865660-7e90-4b56-9f93-a7bd21df1f9f service neutron] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:36.766050 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c406d3-9fc9-4dd5-9911-f6162fa5edf4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '123eb76f95ee4e39905944da701c712d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:36.766662 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c406d3-9fc9-4dd5-9911-f6162fa5edf4 service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:36.766950 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c406d3-9fc9-4dd5-9911-f6162fa5edf4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:36.767227 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c406d3-9fc9-4dd5-9911-f6162fa5edf4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:36.776899 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c406d3-9fc9-4dd5-9911-f6162fa5edf4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:36.778239 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c406d3-9fc9-4dd5-9911-f6162fa5edf4 service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:36.791295 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1291/2587] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:47:36 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:47:38.463375 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c8c5e7-e1bd-4bf8-a6e2-f1ace0955aca service cinder] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:38.464970 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-b1c8c5e7-e1bd-4bf8-a6e2-f1ace0955aca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:38.489700 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c8c5e7-e1bd-4bf8-a6e2-f1ace0955aca service cinder] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:38.496296 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8334b84-dd98-44f3-b136-8aedfa44cff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:38.496919 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8334b84-dd98-44f3-b136-8aedfa44cff9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:38.497208 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8334b84-dd98-44f3-b136-8aedfa44cff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:38.497479 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8334b84-dd98-44f3-b136-8aedfa44cff9 admin admin] PATH_INFO: `/v3/users/05fc0253234e42e7acbcc2f0959ac0db` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:38.498679 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8334b84-dd98-44f3-b136-8aedfa44cff9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05fc0253234e42e7acbcc2f0959ac0db)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:38.500664 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8334b84-dd98-44f3-b136-8aedfa44cff9 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:38.558350 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-e8334b84-dd98-44f3-b136-8aedfa44cff9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05fc0253234e42e7acbcc2f0959ac0db'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:38.566110 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-e8334b84-dd98-44f3-b136-8aedfa44cff9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05fc0253234e42e7acbcc2f0959ac0db'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:38.583557 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-e8334b84-dd98-44f3-b136-8aedfa44cff9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05fc0253234e42e7acbcc2f0959ac0db'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:38.591223 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-e8334b84-dd98-44f3-b136-8aedfa44cff9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05fc0253234e42e7acbcc2f0959ac0db'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:38.591939 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-e8334b84-dd98-44f3-b136-8aedfa44cff9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05fc0253234e42e7acbcc2f0959ac0db'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:38.598564 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1297/2588] 10.222.0.70 () {58 vars in 1224 bytes} [Tue Aug 2 21:47:38 2022] DELETE /identity/v3/users/05fc0253234e42e7acbcc2f0959ac0db => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:47:38.780639 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c406d3-9fc9-4dd5-9911-f6162fa5edf4 service cinder] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:38.792973 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c406d3-9fc9-4dd5-9911-f6162fa5edf4 service cinder] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:38.854168 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca14636e-988b-416f-b445-8eaa905e52b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:38.855115 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca14636e-988b-416f-b445-8eaa905e52b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:38.855392 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca14636e-988b-416f-b445-8eaa905e52b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:38.855666 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca14636e-988b-416f-b445-8eaa905e52b6 admin admin] PATH_INFO: `/v3/projects/92ec84ceff494de79b4c58e98e88cddd` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:38.856905 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca14636e-988b-416f-b445-8eaa905e52b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92ec84ceff494de79b4c58e98e88cddd)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:38.858787 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca14636e-988b-416f-b445-8eaa905e52b6 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:38.867908 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:38.905838 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ca14636e-988b-416f-b445-8eaa905e52b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92ec84ceff494de79b4c58e98e88cddd', 'request_id': 'req-ca14636e-988b-416f-b445-8eaa905e52b6'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:38.913327 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ca14636e-988b-416f-b445-8eaa905e52b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92ec84ceff494de79b4c58e98e88cddd', 'request_id': 'req-ca14636e-988b-416f-b445-8eaa905e52b6'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:38.919311 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ca14636e-988b-416f-b445-8eaa905e52b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92ec84ceff494de79b4c58e98e88cddd', 'request_id': 'req-ca14636e-988b-416f-b445-8eaa905e52b6'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:38.930944 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ca14636e-988b-416f-b445-8eaa905e52b6 admin admin] The token cache is being invalidate because project 92ec84ceff494de79b4c58e98e88cddd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:47:38.931236 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ca14636e-988b-416f-b445-8eaa905e52b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:38.931878 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ca14636e-988b-416f-b445-8eaa905e52b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:38.933395 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1292/2589] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Aug 2 21:47:38 2022] DELETE /identity/v3/projects/92ec84ceff494de79b4c58e98e88cddd => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:47:38.938658 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f7519-64cf-408d-8624-1e3ba62ab50f None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:38.938990 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f7519-64cf-408d-8624-1e3ba62ab50f None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:38.939293 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1f7519-64cf-408d-8624-1e3ba62ab50f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:38.961389 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-ac1f7519-64cf-408d-8624-1e3ba62ab50f None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:47:38.962588 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-ac1f7519-64cf-408d-8624-1e3ba62ab50f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:39.021248 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1298/2590] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:47:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:47:39.029886 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6326530c-1238-4a13-84ed-e6d59eacce75 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:39.030176 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6326530c-1238-4a13-84ed-e6d59eacce75 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:39.030454 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6326530c-1238-4a13-84ed-e6d59eacce75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:39.051898 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-6326530c-1238-4a13-84ed-e6d59eacce75 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:47:39.053131 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-6326530c-1238-4a13-84ed-e6d59eacce75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:39.061073 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1293/2591] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:47:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:47:39.065323 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1f7519-64cf-408d-8624-1e3ba62ab50f None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:39.075808 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1f7519-64cf-408d-8624-1e3ba62ab50f None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:39.080476 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3a4d47-0792-4616-97ab-65c8bd848b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:39.081093 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3a4d47-0792-4616-97ab-65c8bd848b70 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:39.081413 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3a4d47-0792-4616-97ab-65c8bd848b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:39.081696 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3a4d47-0792-4616-97ab-65c8bd848b70 admin admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:39.082434 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3a4d47-0792-4616-97ab-65c8bd848b70 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:47:39.082743 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3a4d47-0792-4616-97ab-65c8bd848b70 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:39.084385 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3a4d47-0792-4616-97ab-65c8bd848b70 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:39.096196 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1299/2592] 10.222.0.70 () {58 vars in 1153 bytes} [Tue Aug 2 21:47:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:47:39.100546 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6326530c-1238-4a13-84ed-e6d59eacce75 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:39.110185 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6326530c-1238-4a13-84ed-e6d59eacce75 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:39.115500 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d185e8-db0a-46b9-865a-263d2f715da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:39.116112 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d185e8-db0a-46b9-865a-263d2f715da3 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:39.116422 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d185e8-db0a-46b9-865a-263d2f715da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:39.116702 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d185e8-db0a-46b9-865a-263d2f715da3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:39.117384 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d185e8-db0a-46b9-865a-263d2f715da3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:39.119351 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d185e8-db0a-46b9-865a-263d2f715da3 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:39.146219 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1294/2593] 10.222.0.70 () {60 vars in 1153 bytes} [Tue Aug 2 21:47:39 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:47:39.150381 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3a4d47-0792-4616-97ab-65c8bd848b70 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:39.160373 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3a4d47-0792-4616-97ab-65c8bd848b70 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:39.208165 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:39.218803 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1ca20a-2305-4e10-8860-5087e69c8c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:39.219475 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ca20a-2305-4e10-8860-5087e69c8c43 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:39.219762 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ca20a-2305-4e10-8860-5087e69c8c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:39.220041 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ca20a-2305-4e10-8860-5087e69c8c43 admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:39.220756 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1ca20a-2305-4e10-8860-5087e69c8c43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:39.222756 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1ca20a-2305-4e10-8860-5087e69c8c43 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:39.243809 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1300/2594] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 2 21:47:39 2022] POST /identity/v3/users => generated 287 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:47:39.247992 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d185e8-db0a-46b9-865a-263d2f715da3 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:39.258909 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d185e8-db0a-46b9-865a-263d2f715da3 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:39.263530 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f70330c-d64a-4271-a995-183f73c05906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:39.264138 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f70330c-d64a-4271-a995-183f73c05906 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:39.264458 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f70330c-d64a-4271-a995-183f73c05906 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:39.264740 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f70330c-d64a-4271-a995-183f73c05906 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:39.265461 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f70330c-d64a-4271-a995-183f73c05906 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:39.267215 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f70330c-d64a-4271-a995-183f73c05906 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:39.277733 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1295/2595] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:47:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:47:39.281621 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1ca20a-2305-4e10-8860-5087e69c8c43 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:39.293792 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1ca20a-2305-4e10-8860-5087e69c8c43 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:39.298874 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaa40c5-15ff-4665-b73e-f05c7f989723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:39.299496 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaa40c5-15ff-4665-b73e-f05c7f989723 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:39.299782 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaa40c5-15ff-4665-b73e-f05c7f989723 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:39.300604 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaa40c5-15ff-4665-b73e-f05c7f989723 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:39.301303 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaa40c5-15ff-4665-b73e-f05c7f989723 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:39.302922 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaa40c5-15ff-4665-b73e-f05c7f989723 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:39.314131 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1301/2596] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:47:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:47:39.318835 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f70330c-d64a-4271-a995-183f73c05906 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:39.329463 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f70330c-d64a-4271-a995-183f73c05906 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:39.336398 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d2599b-d3e7-4d57-86a1-6cf1d6274be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:39.337147 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d2599b-d3e7-4d57-86a1-6cf1d6274be1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:39.337501 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d2599b-d3e7-4d57-86a1-6cf1d6274be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:39.337850 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d2599b-d3e7-4d57-86a1-6cf1d6274be1 admin admin] PATH_INFO: `/v3/projects/2a8964501de545d1be80745483723c32/users/68549784c84f4a1089aab9cd91e04c4e/roles/462e3381a85c42a9959201f9aa122f7c` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:39.368806 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d2599b-d3e7-4d57-86a1-6cf1d6274be1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a8964501de545d1be80745483723c32, user_id=68549784c84f4a1089aab9cd91e04c4e, role_id=462e3381a85c42a9959201f9aa122f7c)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:39.371214 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d2599b-d3e7-4d57-86a1-6cf1d6274be1 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:39.386269 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1296/2597] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:47:39 2022] PUT /identity/v3/projects/2a8964501de545d1be80745483723c32/users/68549784c84f4a1089aab9cd91e04c4e/roles/462e3381a85c42a9959201f9aa122f7c => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:47:39.396625 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e8cf5-e5ff-4876-87a2-7232e891a27a None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:39.397093 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e8cf5-e5ff-4876-87a2-7232e891a27a None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:39.397379 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605e8cf5-e5ff-4876-87a2-7232e891a27a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:39.431685 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-605e8cf5-e5ff-4876-87a2-7232e891a27a None None] MFA Rules not processed for user `68549784c84f4a1089aab9cd91e04c4e`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:47:39.433205 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-605e8cf5-e5ff-4876-87a2-7232e891a27a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:39.640700 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1302/2598] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:47:39 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:47:39.651982 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d2599b-d3e7-4d57-86a1-6cf1d6274be1 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:39.653945 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-21d2599b-d3e7-4d57-86a1-6cf1d6274be1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:39.751835 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d2599b-d3e7-4d57-86a1-6cf1d6274be1 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:39.757406 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c64dd3-8613-48e0-839c-5d5210addcc0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87dd5c1c5e854d4b96e0b7dad6aa3719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:39.758055 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c64dd3-8613-48e0-839c-5d5210addcc0 service nova] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:39.758343 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c64dd3-8613-48e0-839c-5d5210addcc0 service nova] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:39.758624 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c64dd3-8613-48e0-839c-5d5210addcc0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:39.776363 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c64dd3-8613-48e0-839c-5d5210addcc0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:39.777965 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c64dd3-8613-48e0-839c-5d5210addcc0 service nova] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:39.787677 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1297/2599] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:47:39 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:47:40.788204 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605e8cf5-e5ff-4876-87a2-7232e891a27a None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:40.789720 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-605e8cf5-e5ff-4876-87a2-7232e891a27a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:40.853793 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605e8cf5-e5ff-4876-87a2-7232e891a27a None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:40.858534 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f5018f-9e0a-41a1-a93a-0ccae094ff81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:40.859164 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f5018f-9e0a-41a1-a93a-0ccae094ff81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:40.859445 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f5018f-9e0a-41a1-a93a-0ccae094ff81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:40.859729 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f5018f-9e0a-41a1-a93a-0ccae094ff81 admin admin] PATH_INFO: `/v3/users/018d1820c9da4102a359c23ea6741d0d` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:40.860912 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f5018f-9e0a-41a1-a93a-0ccae094ff81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=018d1820c9da4102a359c23ea6741d0d)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:40.862813 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f5018f-9e0a-41a1-a93a-0ccae094ff81 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:40.907275 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-72f5018f-9e0a-41a1-a93a-0ccae094ff81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '018d1820c9da4102a359c23ea6741d0d'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:40.916038 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-72f5018f-9e0a-41a1-a93a-0ccae094ff81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '018d1820c9da4102a359c23ea6741d0d'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:40.923024 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:40.931071 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-72f5018f-9e0a-41a1-a93a-0ccae094ff81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '018d1820c9da4102a359c23ea6741d0d'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:40.938258 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-72f5018f-9e0a-41a1-a93a-0ccae094ff81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '018d1820c9da4102a359c23ea6741d0d'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:40.938956 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-72f5018f-9e0a-41a1-a93a-0ccae094ff81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '018d1820c9da4102a359c23ea6741d0d'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:40.949640 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1303/2600] 10.222.0.70 () {58 vars in 1224 bytes} [Tue Aug 2 21:47:40 2022] DELETE /identity/v3/users/018d1820c9da4102a359c23ea6741d0d => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:47:40.953966 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d0d26f-6a7a-46cc-aa57-318f8e4db54f None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:40.954429 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d0d26f-6a7a-46cc-aa57-318f8e4db54f None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:40.954525 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d0d26f-6a7a-46cc-aa57-318f8e4db54f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:40.973898 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-e4d0d26f-6a7a-46cc-aa57-318f8e4db54f None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:47:40.975022 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-e4d0d26f-6a7a-46cc-aa57-318f8e4db54f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:40.986907 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:41.034992 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1298/2601] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:47:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:47:41.045446 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f5018f-9e0a-41a1-a93a-0ccae094ff81 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:41.046862 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-72f5018f-9e0a-41a1-a93a-0ccae094ff81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:41.102804 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f5018f-9e0a-41a1-a93a-0ccae094ff81 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:41.106704 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f499c488-071c-4750-b633-5fe7c943d2d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '723f5f43572a493dae0349070a2adb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:41.107315 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f499c488-071c-4750-b633-5fe7c943d2d7 service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:41.107596 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f499c488-071c-4750-b633-5fe7c943d2d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:41.107867 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f499c488-071c-4750-b633-5fe7c943d2d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:41.117550 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f499c488-071c-4750-b633-5fe7c943d2d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:41.118972 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f499c488-071c-4750-b633-5fe7c943d2d7 service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:41.129700 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1304/2602] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:47:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:47:41.428009 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d0d26f-6a7a-46cc-aa57-318f8e4db54f None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:41.429690 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-e4d0d26f-6a7a-46cc-aa57-318f8e4db54f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:41.446201 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d0d26f-6a7a-46cc-aa57-318f8e4db54f None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:41.458084 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd84c4a-bc29-4ebf-aba8-6ee7100bdd59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:41.458767 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd84c4a-bc29-4ebf-aba8-6ee7100bdd59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:41.459078 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd84c4a-bc29-4ebf-aba8-6ee7100bdd59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:41.459362 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd84c4a-bc29-4ebf-aba8-6ee7100bdd59 admin admin] PATH_INFO: `/v3/projects/5e0239aba9e9422eb8994a130cac0e49` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:41.461488 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd84c4a-bc29-4ebf-aba8-6ee7100bdd59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e0239aba9e9422eb8994a130cac0e49)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:41.463311 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd84c4a-bc29-4ebf-aba8-6ee7100bdd59 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:41.526931 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-cfd84c4a-bc29-4ebf-aba8-6ee7100bdd59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e0239aba9e9422eb8994a130cac0e49', 'request_id': 'req-cfd84c4a-bc29-4ebf-aba8-6ee7100bdd59'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:41.533703 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-cfd84c4a-bc29-4ebf-aba8-6ee7100bdd59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e0239aba9e9422eb8994a130cac0e49', 'request_id': 'req-cfd84c4a-bc29-4ebf-aba8-6ee7100bdd59'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:41.540136 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-cfd84c4a-bc29-4ebf-aba8-6ee7100bdd59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e0239aba9e9422eb8994a130cac0e49', 'request_id': 'req-cfd84c4a-bc29-4ebf-aba8-6ee7100bdd59'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:41.551404 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-cfd84c4a-bc29-4ebf-aba8-6ee7100bdd59 admin admin] The token cache is being invalidate because project 5e0239aba9e9422eb8994a130cac0e49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:47:41.551697 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-cfd84c4a-bc29-4ebf-aba8-6ee7100bdd59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:41.552370 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-cfd84c4a-bc29-4ebf-aba8-6ee7100bdd59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:41.553875 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1299/2603] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Aug 2 21:47:41 2022] DELETE /identity/v3/projects/5e0239aba9e9422eb8994a130cac0e49 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:47:41.557923 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f499c488-071c-4750-b633-5fe7c943d2d7 service neutron] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:41.568660 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f499c488-071c-4750-b633-5fe7c943d2d7 service neutron] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:41.626183 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64094942-665b-4b67-a820-54a06908e4a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:41.626824 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64094942-665b-4b67-a820-54a06908e4a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:41.627105 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64094942-665b-4b67-a820-54a06908e4a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:41.627383 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64094942-665b-4b67-a820-54a06908e4a7 admin admin] PATH_INFO: `/v3/users/8b9d29766a44483fa9b4262c32ae457d` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:41.628577 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64094942-665b-4b67-a820-54a06908e4a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b9d29766a44483fa9b4262c32ae457d)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:41.631026 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64094942-665b-4b67-a820-54a06908e4a7 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:41.675996 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-64094942-665b-4b67-a820-54a06908e4a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b9d29766a44483fa9b4262c32ae457d'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:41.683964 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-64094942-665b-4b67-a820-54a06908e4a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b9d29766a44483fa9b4262c32ae457d'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:41.696577 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-64094942-665b-4b67-a820-54a06908e4a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b9d29766a44483fa9b4262c32ae457d'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:41.703718 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-64094942-665b-4b67-a820-54a06908e4a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b9d29766a44483fa9b4262c32ae457d'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:41.704391 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-64094942-665b-4b67-a820-54a06908e4a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b9d29766a44483fa9b4262c32ae457d'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:41.710906 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1305/2604] 10.222.0.70 () {58 vars in 1224 bytes} [Tue Aug 2 21:47:41 2022] DELETE /identity/v3/users/8b9d29766a44483fa9b4262c32ae457d => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:47:41.993484 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd84c4a-bc29-4ebf-aba8-6ee7100bdd59 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:41.994961 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-cfd84c4a-bc29-4ebf-aba8-6ee7100bdd59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:42.008384 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd84c4a-bc29-4ebf-aba8-6ee7100bdd59 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:42.069136 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5fb456-1993-4c1f-9f02-f9378027f070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:42.069785 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5fb456-1993-4c1f-9f02-f9378027f070 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:42.070071 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5fb456-1993-4c1f-9f02-f9378027f070 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:42.070350 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5fb456-1993-4c1f-9f02-f9378027f070 admin admin] PATH_INFO: `/v3/projects/0494c123f3424546b06a3bb6818a29cb` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:42.071504 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5fb456-1993-4c1f-9f02-f9378027f070 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0494c123f3424546b06a3bb6818a29cb)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:42.073443 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5fb456-1993-4c1f-9f02-f9378027f070 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:42.116567 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:42.120286 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-7a5fb456-1993-4c1f-9f02-f9378027f070 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0494c123f3424546b06a3bb6818a29cb', 'request_id': 'req-7a5fb456-1993-4c1f-9f02-f9378027f070'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:42.128656 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-7a5fb456-1993-4c1f-9f02-f9378027f070 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0494c123f3424546b06a3bb6818a29cb', 'request_id': 'req-7a5fb456-1993-4c1f-9f02-f9378027f070'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:42.134574 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-7a5fb456-1993-4c1f-9f02-f9378027f070 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0494c123f3424546b06a3bb6818a29cb', 'request_id': 'req-7a5fb456-1993-4c1f-9f02-f9378027f070'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:42.147584 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-7a5fb456-1993-4c1f-9f02-f9378027f070 admin admin] The token cache is being invalidate because project 0494c123f3424546b06a3bb6818a29cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:47:42.147875 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-7a5fb456-1993-4c1f-9f02-f9378027f070 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:42.150104 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-7a5fb456-1993-4c1f-9f02-f9378027f070 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:42.151622 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1300/2605] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Aug 2 21:47:41 2022] DELETE /identity/v3/projects/0494c123f3424546b06a3bb6818a29cb => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:47:42.155588 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64094942-665b-4b67-a820-54a06908e4a7 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:42.157117 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-64094942-665b-4b67-a820-54a06908e4a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:42.165537 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:42.171370 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64094942-665b-4b67-a820-54a06908e4a7 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:42.230933 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa3c94b-0ff2-4673-af97-d5b244ee3c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:42.231565 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa3c94b-0ff2-4673-af97-d5b244ee3c23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:42.231842 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa3c94b-0ff2-4673-af97-d5b244ee3c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:42.232114 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa3c94b-0ff2-4673-af97-d5b244ee3c23 admin admin] PATH_INFO: `/v3/users/96ef074f2a4d426591f359116fa03fd3` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:42.233289 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa3c94b-0ff2-4673-af97-d5b244ee3c23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96ef074f2a4d426591f359116fa03fd3)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:42.235223 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa3c94b-0ff2-4673-af97-d5b244ee3c23 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:42.281781 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-afa3c94b-0ff2-4673-af97-d5b244ee3c23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96ef074f2a4d426591f359116fa03fd3'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:42.293752 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-afa3c94b-0ff2-4673-af97-d5b244ee3c23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96ef074f2a4d426591f359116fa03fd3'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:42.305726 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-afa3c94b-0ff2-4673-af97-d5b244ee3c23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96ef074f2a4d426591f359116fa03fd3'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:42.312541 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-afa3c94b-0ff2-4673-af97-d5b244ee3c23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96ef074f2a4d426591f359116fa03fd3'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:42.313317 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-afa3c94b-0ff2-4673-af97-d5b244ee3c23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96ef074f2a4d426591f359116fa03fd3'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:42.319639 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1306/2606] 10.222.0.70 () {58 vars in 1224 bytes} [Tue Aug 2 21:47:42 2022] DELETE /identity/v3/users/96ef074f2a4d426591f359116fa03fd3 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:47:42.361816 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5fb456-1993-4c1f-9f02-f9378027f070 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:42.363294 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-7a5fb456-1993-4c1f-9f02-f9378027f070 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:42.376635 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5fb456-1993-4c1f-9f02-f9378027f070 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:42.437880 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e5cdeb-0b12-405a-af40-149575ef7cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:42.438593 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e5cdeb-0b12-405a-af40-149575ef7cfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:42.438878 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e5cdeb-0b12-405a-af40-149575ef7cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:42.439157 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e5cdeb-0b12-405a-af40-149575ef7cfd admin admin] PATH_INFO: `/v3/users/10281c7b5cf14440bd5ba8075d2d09e0` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:42.440431 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e5cdeb-0b12-405a-af40-149575ef7cfd admin admin] RBAC: Authorizing `identity:delete_user(user_id=10281c7b5cf14440bd5ba8075d2d09e0)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:42.442928 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e5cdeb-0b12-405a-af40-149575ef7cfd admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:42.494363 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-c6e5cdeb-0b12-405a-af40-149575ef7cfd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10281c7b5cf14440bd5ba8075d2d09e0'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:42.504690 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-c6e5cdeb-0b12-405a-af40-149575ef7cfd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10281c7b5cf14440bd5ba8075d2d09e0'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:42.517893 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-c6e5cdeb-0b12-405a-af40-149575ef7cfd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10281c7b5cf14440bd5ba8075d2d09e0'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:42.519192 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-c6e5cdeb-0b12-405a-af40-149575ef7cfd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10281c7b5cf14440bd5ba8075d2d09e0'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:42.528836 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-c6e5cdeb-0b12-405a-af40-149575ef7cfd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10281c7b5cf14440bd5ba8075d2d09e0'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:42.535556 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1301/2607] 10.222.0.70 () {58 vars in 1224 bytes} [Tue Aug 2 21:47:42 2022] DELETE /identity/v3/users/10281c7b5cf14440bd5ba8075d2d09e0 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:47:42.541255 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf930fc1-b817-46d4-921b-672eed32606a None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:42.541751 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf930fc1-b817-46d4-921b-672eed32606a None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:42.542220 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf930fc1-b817-46d4-921b-672eed32606a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:42.572408 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e5cdeb-0b12-405a-af40-149575ef7cfd admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:42.574319 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-c6e5cdeb-0b12-405a-af40-149575ef7cfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:42.576619 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-cf930fc1-b817-46d4-921b-672eed32606a None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:47:42.577880 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-cf930fc1-b817-46d4-921b-672eed32606a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:42.645401 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:42.658191 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1307/2608] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:47:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:47:42.661604 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf930fc1-b817-46d4-921b-672eed32606a None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:42.661710 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e5cdeb-0b12-405a-af40-149575ef7cfd admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:42.663144 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-cf930fc1-b817-46d4-921b-672eed32606a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:42.670027 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae44b81-0b49-46cf-95e0-d18889d91b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:42.670609 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae44b81-0b49-46cf-95e0-d18889d91b0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:42.670894 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae44b81-0b49-46cf-95e0-d18889d91b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:42.671304 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae44b81-0b49-46cf-95e0-d18889d91b0b admin admin] PATH_INFO: `/v3/users/68549784c84f4a1089aab9cd91e04c4e` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:42.672577 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae44b81-0b49-46cf-95e0-d18889d91b0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=68549784c84f4a1089aab9cd91e04c4e)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:42.674529 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae44b81-0b49-46cf-95e0-d18889d91b0b admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:42.675840 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf930fc1-b817-46d4-921b-672eed32606a None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:42.681053 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25161ae-620f-4182-b847-e6344fc3ef4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:42.681196 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25161ae-620f-4182-b847-e6344fc3ef4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:42.681554 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25161ae-620f-4182-b847-e6344fc3ef4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:42.681912 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25161ae-620f-4182-b847-e6344fc3ef4a admin admin] PATH_INFO: `/v3/projects/6a886cab94a54dd3aa77c48cee240822` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:42.683213 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25161ae-620f-4182-b847-e6344fc3ef4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a886cab94a54dd3aa77c48cee240822)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:42.685205 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25161ae-620f-4182-b847-e6344fc3ef4a admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:42.702682 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:42.728252 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-cae44b81-0b49-46cf-95e0-d18889d91b0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '68549784c84f4a1089aab9cd91e04c4e'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:42.735176 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-d25161ae-620f-4182-b847-e6344fc3ef4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a886cab94a54dd3aa77c48cee240822', 'request_id': 'req-d25161ae-620f-4182-b847-e6344fc3ef4a'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:42.737345 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-cae44b81-0b49-46cf-95e0-d18889d91b0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '68549784c84f4a1089aab9cd91e04c4e'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:42.741718 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-d25161ae-620f-4182-b847-e6344fc3ef4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a886cab94a54dd3aa77c48cee240822', 'request_id': 'req-d25161ae-620f-4182-b847-e6344fc3ef4a'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:42.749351 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-d25161ae-620f-4182-b847-e6344fc3ef4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a886cab94a54dd3aa77c48cee240822', 'request_id': 'req-d25161ae-620f-4182-b847-e6344fc3ef4a'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:42.750915 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-cae44b81-0b49-46cf-95e0-d18889d91b0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '68549784c84f4a1089aab9cd91e04c4e'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:42.751705 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-cae44b81-0b49-46cf-95e0-d18889d91b0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '68549784c84f4a1089aab9cd91e04c4e'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:42.759652 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-cae44b81-0b49-46cf-95e0-d18889d91b0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '68549784c84f4a1089aab9cd91e04c4e'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:42.761994 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-d25161ae-620f-4182-b847-e6344fc3ef4a admin admin] The token cache is being invalidate because project 6a886cab94a54dd3aa77c48cee240822 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:47:42.762310 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-d25161ae-620f-4182-b847-e6344fc3ef4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:42.762962 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-d25161ae-620f-4182-b847-e6344fc3ef4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:42.764569 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1308/2609] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Aug 2 21:47:42 2022] DELETE /identity/v3/projects/6a886cab94a54dd3aa77c48cee240822 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:47:42.765522 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25161ae-620f-4182-b847-e6344fc3ef4a admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:42.768614 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1302/2610] 10.222.0.70 () {58 vars in 1224 bytes} [Tue Aug 2 21:47:42 2022] DELETE /identity/v3/users/68549784c84f4a1089aab9cd91e04c4e => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:47:42.769260 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93bd74e-7f5f-4b14-84d0-236260ad9694 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:42.769502 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-d25161ae-620f-4182-b847-e6344fc3ef4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:42.769677 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93bd74e-7f5f-4b14-84d0-236260ad9694 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:42.769890 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93bd74e-7f5f-4b14-84d0-236260ad9694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:42.789108 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-d93bd74e-7f5f-4b14-84d0-236260ad9694 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:47:42.790222 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-d93bd74e-7f5f-4b14-84d0-236260ad9694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:42.829799 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25161ae-620f-4182-b847-e6344fc3ef4a admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:42.855425 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1303/2611] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:47:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:47:42.855425 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b965381e-3ff8-4f9c-b08c-0500b8401889 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:42.855425 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b965381e-3ff8-4f9c-b08c-0500b8401889 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:42.855425 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b965381e-3ff8-4f9c-b08c-0500b8401889 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:42.871116 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-b965381e-3ff8-4f9c-b08c-0500b8401889 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:47:42.872358 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-b965381e-3ff8-4f9c-b08c-0500b8401889 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:42.878409 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257230ff-6d16-40c8-9d67-389c5fb77c7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '723f5f43572a493dae0349070a2adb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:42.879788 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257230ff-6d16-40c8-9d67-389c5fb77c7f service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:42.880081 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257230ff-6d16-40c8-9d67-389c5fb77c7f service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:42.880398 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257230ff-6d16-40c8-9d67-389c5fb77c7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:42.880662 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1304/2612] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:47:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:47:42.881905 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e230f61-9ace-46a6-9efe-7bc1760eed61 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:42.882189 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e230f61-9ace-46a6-9efe-7bc1760eed61 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:42.882486 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e230f61-9ace-46a6-9efe-7bc1760eed61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:42.885271 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-257230ff-6d16-40c8-9d67-389c5fb77c7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:42.897795 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257230ff-6d16-40c8-9d67-389c5fb77c7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:42.899377 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257230ff-6d16-40c8-9d67-389c5fb77c7f service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:42.903006 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-2e230f61-9ace-46a6-9efe-7bc1760eed61 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:47:42.904208 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-2e230f61-9ace-46a6-9efe-7bc1760eed61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:42.909259 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1309/2613] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:47:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:47:42.910148 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257230ff-6d16-40c8-9d67-389c5fb77c7f service neutron] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:42.912434 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1305/2614] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:47:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:47:42.917136 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e230f61-9ace-46a6-9efe-7bc1760eed61 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:42.918799 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257230ff-6d16-40c8-9d67-389c5fb77c7f service neutron] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:42.923012 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4960685-55cf-439c-a491-ab5a05fe5886 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '723f5f43572a493dae0349070a2adb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:42.923289 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4960685-55cf-439c-a491-ab5a05fe5886 service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:42.923571 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4960685-55cf-439c-a491-ab5a05fe5886 service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:42.923926 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4960685-55cf-439c-a491-ab5a05fe5886 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:42.927130 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e230f61-9ace-46a6-9efe-7bc1760eed61 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:42.931842 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5ea1e1-517f-4825-9c76-ccf2c5ebfed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:42.932579 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5ea1e1-517f-4825-9c76-ccf2c5ebfed9 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:42.932939 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5ea1e1-517f-4825-9c76-ccf2c5ebfed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:42.933373 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5ea1e1-517f-4825-9c76-ccf2c5ebfed9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:42.934121 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5ea1e1-517f-4825-9c76-ccf2c5ebfed9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:47:42.934429 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5ea1e1-517f-4825-9c76-ccf2c5ebfed9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:42.935719 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4960685-55cf-439c-a491-ab5a05fe5886 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:42.936261 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5ea1e1-517f-4825-9c76-ccf2c5ebfed9 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:42.937857 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4960685-55cf-439c-a491-ab5a05fe5886 service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:42.952953 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1310/2615] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:47:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:47:42.953552 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1306/2616] 10.222.0.70 () {58 vars in 1153 bytes} [Tue Aug 2 21:47:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:47:42.954375 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4960685-55cf-439c-a491-ab5a05fe5886 service neutron] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:42.963865 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4960685-55cf-439c-a491-ab5a05fe5886 service neutron] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:42.968775 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cc0ee1-d198-49cd-b9c9-e854b1c6b0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:42.969368 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cc0ee1-d198-49cd-b9c9-e854b1c6b0a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:42.969906 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cc0ee1-d198-49cd-b9c9-e854b1c6b0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:42.969906 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cc0ee1-d198-49cd-b9c9-e854b1c6b0a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:42.970552 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cc0ee1-d198-49cd-b9c9-e854b1c6b0a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:42.972472 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cc0ee1-d198-49cd-b9c9-e854b1c6b0a2 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:43.000590 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1311/2617] 10.222.0.70 () {60 vars in 1153 bytes} [Tue Aug 2 21:47:42 2022] POST /identity/v3/projects => generated 369 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 21:47:43.005841 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5ea1e1-517f-4825-9c76-ccf2c5ebfed9 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:43.017625 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5ea1e1-517f-4825-9c76-ccf2c5ebfed9 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:43.068074 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:43.087706 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a1d7c9-4727-4756-9ace-6c8566f0185d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:43.088361 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a1d7c9-4727-4756-9ace-6c8566f0185d admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:43.088648 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a1d7c9-4727-4756-9ace-6c8566f0185d admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:43.088930 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a1d7c9-4727-4756-9ace-6c8566f0185d admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:43.089862 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a1d7c9-4727-4756-9ace-6c8566f0185d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:43.091801 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a1d7c9-4727-4756-9ace-6c8566f0185d admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:43.120516 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1307/2618] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 2 21:47:43 2022] POST /identity/v3/users => generated 285 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:47:43.121739 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cc0ee1-d198-49cd-b9c9-e854b1c6b0a2 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:43.138920 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cc0ee1-d198-49cd-b9c9-e854b1c6b0a2 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:43.144596 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1f81bd-22d4-4700-9c2c-2456dbd77778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:43.145231 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1f81bd-22d4-4700-9c2c-2456dbd77778 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:43.145522 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1f81bd-22d4-4700-9c2c-2456dbd77778 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:43.145782 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1f81bd-22d4-4700-9c2c-2456dbd77778 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:43.146476 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1f81bd-22d4-4700-9c2c-2456dbd77778 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:43.148175 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1f81bd-22d4-4700-9c2c-2456dbd77778 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:43.159465 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1312/2619] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:47:43 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 21:47:43.164208 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a1d7c9-4727-4756-9ace-6c8566f0185d admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:43.176638 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a1d7c9-4727-4756-9ace-6c8566f0185d admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:43.183877 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93c0dd4-87ca-4b11-a933-af1265d04b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:43.184197 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93c0dd4-87ca-4b11-a933-af1265d04b17 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:43.184554 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93c0dd4-87ca-4b11-a933-af1265d04b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:43.184871 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93c0dd4-87ca-4b11-a933-af1265d04b17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:43.185779 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93c0dd4-87ca-4b11-a933-af1265d04b17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:43.187282 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93c0dd4-87ca-4b11-a933-af1265d04b17 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:43.200280 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1308/2620] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:47:43 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:47:43.206040 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1f81bd-22d4-4700-9c2c-2456dbd77778 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:43.217079 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1f81bd-22d4-4700-9c2c-2456dbd77778 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:43.222460 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca7f7a7-03ab-4653-9fe5-a00b984ff381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:43.223881 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca7f7a7-03ab-4653-9fe5-a00b984ff381 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:43.224182 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca7f7a7-03ab-4653-9fe5-a00b984ff381 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:43.224580 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca7f7a7-03ab-4653-9fe5-a00b984ff381 admin admin] PATH_INFO: `/v3/projects/9deaeb5cb9fd48439437431d1fb0e45b/users/ef17a69c46a84e6191e6f2ba69ec9ffe/roles/462e3381a85c42a9959201f9aa122f7c` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:43.247266 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca7f7a7-03ab-4653-9fe5-a00b984ff381 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9deaeb5cb9fd48439437431d1fb0e45b, user_id=ef17a69c46a84e6191e6f2ba69ec9ffe, role_id=462e3381a85c42a9959201f9aa122f7c)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:43.250906 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca7f7a7-03ab-4653-9fe5-a00b984ff381 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:43.253816 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:43.276694 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1313/2621] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:47:43 2022] PUT /identity/v3/projects/9deaeb5cb9fd48439437431d1fb0e45b/users/ef17a69c46a84e6191e6f2ba69ec9ffe/roles/462e3381a85c42a9959201f9aa122f7c => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:47:43.282940 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000fe2bc-6923-4883-b2a2-a8cc5330b001 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:43.283238 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000fe2bc-6923-4883-b2a2-a8cc5330b001 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:43.283520 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000fe2bc-6923-4883-b2a2-a8cc5330b001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:43.293618 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca7f7a7-03ab-4653-9fe5-a00b984ff381 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:43.297885 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-8ca7f7a7-03ab-4653-9fe5-a00b984ff381 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:43.326051 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-000fe2bc-6923-4883-b2a2-a8cc5330b001 None None] MFA Rules not processed for user `ef17a69c46a84e6191e6f2ba69ec9ffe`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:47:43.327460 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-000fe2bc-6923-4883-b2a2-a8cc5330b001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:43.378959 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca7f7a7-03ab-4653-9fe5-a00b984ff381 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:43.387183 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da148e27-c0ac-4624-9d3a-6a6036bd861f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:43.387846 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da148e27-c0ac-4624-9d3a-6a6036bd861f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:43.388128 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da148e27-c0ac-4624-9d3a-6a6036bd861f admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:43.388435 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da148e27-c0ac-4624-9d3a-6a6036bd861f admin admin] PATH_INFO: `/v3/projects/aab78826f0ee4842bfa434b47f80736b` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:43.395204 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da148e27-c0ac-4624-9d3a-6a6036bd861f admin admin] RBAC: Authorizing `identity:delete_project(project_id=aab78826f0ee4842bfa434b47f80736b)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:43.397660 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da148e27-c0ac-4624-9d3a-6a6036bd861f admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:43.413682 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1309/2622] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:47:43 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:47:43.414529 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000fe2bc-6923-4883-b2a2-a8cc5330b001 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:43.416696 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-000fe2bc-6923-4883-b2a2-a8cc5330b001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:43.432773 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000fe2bc-6923-4883-b2a2-a8cc5330b001 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:43.437643 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c214fc57-7ada-45b0-8bb2-2cf424455745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:43.438287 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c214fc57-7ada-45b0-8bb2-2cf424455745 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:43.438575 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c214fc57-7ada-45b0-8bb2-2cf424455745 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:43.438855 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c214fc57-7ada-45b0-8bb2-2cf424455745 admin admin] PATH_INFO: `/v3/projects/2a8964501de545d1be80745483723c32` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:43.440039 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c214fc57-7ada-45b0-8bb2-2cf424455745 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a8964501de545d1be80745483723c32)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:43.442027 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c214fc57-7ada-45b0-8bb2-2cf424455745 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:43.450826 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-da148e27-c0ac-4624-9d3a-6a6036bd861f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aab78826f0ee4842bfa434b47f80736b', 'request_id': 'req-da148e27-c0ac-4624-9d3a-6a6036bd861f'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:43.456487 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-da148e27-c0ac-4624-9d3a-6a6036bd861f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aab78826f0ee4842bfa434b47f80736b', 'request_id': 'req-da148e27-c0ac-4624-9d3a-6a6036bd861f'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:43.464970 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-da148e27-c0ac-4624-9d3a-6a6036bd861f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aab78826f0ee4842bfa434b47f80736b', 'request_id': 'req-da148e27-c0ac-4624-9d3a-6a6036bd861f'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:43.477375 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-da148e27-c0ac-4624-9d3a-6a6036bd861f admin admin] The token cache is being invalidate because project aab78826f0ee4842bfa434b47f80736b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:47:43.477670 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-da148e27-c0ac-4624-9d3a-6a6036bd861f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:43.478413 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-da148e27-c0ac-4624-9d3a-6a6036bd861f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:43.480200 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1314/2623] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Aug 2 21:47:43 2022] DELETE /identity/v3/projects/aab78826f0ee4842bfa434b47f80736b => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:47:43.483185 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da148e27-c0ac-4624-9d3a-6a6036bd861f admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:43.483185 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-da148e27-c0ac-4624-9d3a-6a6036bd861f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:43.492909 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-c214fc57-7ada-45b0-8bb2-2cf424455745 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a8964501de545d1be80745483723c32', 'request_id': 'req-c214fc57-7ada-45b0-8bb2-2cf424455745'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:43.500334 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-c214fc57-7ada-45b0-8bb2-2cf424455745 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a8964501de545d1be80745483723c32', 'request_id': 'req-c214fc57-7ada-45b0-8bb2-2cf424455745'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:43.505925 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-c214fc57-7ada-45b0-8bb2-2cf424455745 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a8964501de545d1be80745483723c32', 'request_id': 'req-c214fc57-7ada-45b0-8bb2-2cf424455745'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:43.517251 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-c214fc57-7ada-45b0-8bb2-2cf424455745 admin admin] The token cache is being invalidate because project 2a8964501de545d1be80745483723c32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:47:43.517599 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-c214fc57-7ada-45b0-8bb2-2cf424455745 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:43.518280 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-c214fc57-7ada-45b0-8bb2-2cf424455745 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:43.520403 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1310/2624] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Aug 2 21:47:43 2022] DELETE /identity/v3/projects/2a8964501de545d1be80745483723c32 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:47:43.521172 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c214fc57-7ada-45b0-8bb2-2cf424455745 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:43.522465 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-c214fc57-7ada-45b0-8bb2-2cf424455745 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:43.541502 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da148e27-c0ac-4624-9d3a-6a6036bd861f admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:43.562781 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:43.579279 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:43.591089 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c214fc57-7ada-45b0-8bb2-2cf424455745 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:43.592043 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a1b336-0c04-4b91-8bd7-d66633f227e0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'accb7ab8b4f447389ed394a48fc27619', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:43.592691 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1b336-0c04-4b91-8bd7-d66633f227e0 service glance] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:43.592975 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1b336-0c04-4b91-8bd7-d66633f227e0 service glance] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:43.593247 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1b336-0c04-4b91-8bd7-d66633f227e0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:43.595041 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-16a1b336-0c04-4b91-8bd7-d66633f227e0 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:43.595827 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75ce7d9-585d-4c1d-8138-0956265ad014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:43.596498 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75ce7d9-585d-4c1d-8138-0956265ad014 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:43.596785 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75ce7d9-585d-4c1d-8138-0956265ad014 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:43.597091 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75ce7d9-585d-4c1d-8138-0956265ad014 admin admin] PATH_INFO: `/v3/users/4ecb6ded3b2c408b9650886c9c077e14` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:43.598821 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75ce7d9-585d-4c1d-8138-0956265ad014 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ecb6ded3b2c408b9650886c9c077e14)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:43.600771 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75ce7d9-585d-4c1d-8138-0956265ad014 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:43.648600 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-e75ce7d9-585d-4c1d-8138-0956265ad014 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ecb6ded3b2c408b9650886c9c077e14'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:43.655825 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-e75ce7d9-585d-4c1d-8138-0956265ad014 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ecb6ded3b2c408b9650886c9c077e14'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:43.657800 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a1b336-0c04-4b91-8bd7-d66633f227e0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:43.659382 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a1b336-0c04-4b91-8bd7-d66633f227e0 service glance] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:43.669256 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-e75ce7d9-585d-4c1d-8138-0956265ad014 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ecb6ded3b2c408b9650886c9c077e14'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:43.669824 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1315/2625] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:47:43 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:47:43.670083 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-e75ce7d9-585d-4c1d-8138-0956265ad014 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ecb6ded3b2c408b9650886c9c077e14'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:43.671453 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc25653-50d9-4510-9705-c4d47e5a1e1d None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:43.671742 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc25653-50d9-4510-9705-c4d47e5a1e1d None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:43.672024 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc25653-50d9-4510-9705-c4d47e5a1e1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:43.679250 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-e75ce7d9-585d-4c1d-8138-0956265ad014 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ecb6ded3b2c408b9650886c9c077e14'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:43.686139 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1311/2626] 10.222.0.70 () {58 vars in 1224 bytes} [Tue Aug 2 21:47:43 2022] DELETE /identity/v3/users/4ecb6ded3b2c408b9650886c9c077e14 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:47:43.695414 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-9dc25653-50d9-4510-9705-c4d47e5a1e1d None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:47:43.696951 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-9dc25653-50d9-4510-9705-c4d47e5a1e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:43.769182 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1316/2627] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:47:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:47:43.777923 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1cc02c-ce2e-44d0-99af-6b8fe51955fe None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:43.778287 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1cc02c-ce2e-44d0-99af-6b8fe51955fe None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:43.778636 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1cc02c-ce2e-44d0-99af-6b8fe51955fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:43.801138 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-6b1cc02c-ce2e-44d0-99af-6b8fe51955fe None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:47:43.802362 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-6b1cc02c-ce2e-44d0-99af-6b8fe51955fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:43.814685 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1312/2628] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:47:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:47:43.815793 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc25653-50d9-4510-9705-c4d47e5a1e1d None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:43.826254 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc25653-50d9-4510-9705-c4d47e5a1e1d None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:43.831211 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3af495-c046-4134-9ef6-2793d92a4b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:43.831828 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3af495-c046-4134-9ef6-2793d92a4b75 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:43.832803 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3af495-c046-4134-9ef6-2793d92a4b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:43.833099 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3af495-c046-4134-9ef6-2793d92a4b75 admin admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:43.833797 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3af495-c046-4134-9ef6-2793d92a4b75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:47:43.834134 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3af495-c046-4134-9ef6-2793d92a4b75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:43.835731 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3af495-c046-4134-9ef6-2793d92a4b75 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:43.861922 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1317/2629] 10.222.0.70 () {58 vars in 1153 bytes} [Tue Aug 2 21:47:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:47:43.867600 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1cc02c-ce2e-44d0-99af-6b8fe51955fe None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:43.878575 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1cc02c-ce2e-44d0-99af-6b8fe51955fe None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:43.883775 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756e5906-c8b1-4a39-b1b4-543a132e9761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:43.884443 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756e5906-c8b1-4a39-b1b4-543a132e9761 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:43.884723 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756e5906-c8b1-4a39-b1b4-543a132e9761 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:43.885029 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756e5906-c8b1-4a39-b1b4-543a132e9761 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:43.885696 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756e5906-c8b1-4a39-b1b4-543a132e9761 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:43.887586 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756e5906-c8b1-4a39-b1b4-543a132e9761 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:43.921123 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1313/2630] 10.222.0.70 () {60 vars in 1153 bytes} [Tue Aug 2 21:47:43 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 21:47:43.921880 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3af495-c046-4134-9ef6-2793d92a4b75 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:43.935199 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3af495-c046-4134-9ef6-2793d92a4b75 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:43.996360 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756e5906-c8b1-4a39-b1b4-543a132e9761 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:43.998299 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-756e5906-c8b1-4a39-b1b4-543a132e9761 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:44.007720 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3befb269-8c4f-45a2-beba-aa0329c93fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:44.009330 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3befb269-8c4f-45a2-beba-aa0329c93fc2 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:44.009942 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3befb269-8c4f-45a2-beba-aa0329c93fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:44.010514 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3befb269-8c4f-45a2-beba-aa0329c93fc2 admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:44.011216 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3befb269-8c4f-45a2-beba-aa0329c93fc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:44.013459 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3befb269-8c4f-45a2-beba-aa0329c93fc2 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:44.026352 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756e5906-c8b1-4a39-b1b4-543a132e9761 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:44.033045 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01240625-3c26-4d8c-950e-332a262022d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:44.033922 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01240625-3c26-4d8c-950e-332a262022d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:44.034316 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01240625-3c26-4d8c-950e-332a262022d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:44.034695 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01240625-3c26-4d8c-950e-332a262022d3 admin admin] PATH_INFO: `/v3/projects/da9bf5135bf74611bc5ef48d63041549` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:44.036417 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01240625-3c26-4d8c-950e-332a262022d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da9bf5135bf74611bc5ef48d63041549)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:44.038877 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01240625-3c26-4d8c-950e-332a262022d3 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:44.041360 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1318/2631] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 2 21:47:43 2022] POST /identity/v3/users => generated 287 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 21:47:44.045904 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3befb269-8c4f-45a2-beba-aa0329c93fc2 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:44.055807 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3befb269-8c4f-45a2-beba-aa0329c93fc2 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:44.060820 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc994856-3ffb-413c-80e4-5d06232aed42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:44.061441 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc994856-3ffb-413c-80e4-5d06232aed42 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:44.061725 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc994856-3ffb-413c-80e4-5d06232aed42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:44.062004 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc994856-3ffb-413c-80e4-5d06232aed42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:44.062811 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc994856-3ffb-413c-80e4-5d06232aed42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:44.064563 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc994856-3ffb-413c-80e4-5d06232aed42 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:44.071837 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:44.081270 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1319/2632] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:47:44 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:47:44.085775 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc994856-3ffb-413c-80e4-5d06232aed42 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:44.099673 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc994856-3ffb-413c-80e4-5d06232aed42 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:44.106172 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-01240625-3c26-4d8c-950e-332a262022d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da9bf5135bf74611bc5ef48d63041549', 'request_id': 'req-01240625-3c26-4d8c-950e-332a262022d3'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:44.114250 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-01240625-3c26-4d8c-950e-332a262022d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da9bf5135bf74611bc5ef48d63041549', 'request_id': 'req-01240625-3c26-4d8c-950e-332a262022d3'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:44.121975 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-01240625-3c26-4d8c-950e-332a262022d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da9bf5135bf74611bc5ef48d63041549', 'request_id': 'req-01240625-3c26-4d8c-950e-332a262022d3'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:44.137227 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-01240625-3c26-4d8c-950e-332a262022d3 admin admin] The token cache is being invalidate because project da9bf5135bf74611bc5ef48d63041549 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:47:44.137671 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-01240625-3c26-4d8c-950e-332a262022d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:44.138417 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-01240625-3c26-4d8c-950e-332a262022d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:44.140215 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1314/2633] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Aug 2 21:47:43 2022] DELETE /identity/v3/projects/da9bf5135bf74611bc5ef48d63041549 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:47:44.148294 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e2e35b-0a4b-4e4a-a20f-61de1ad0d607 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:44.148294 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e2e35b-0a4b-4e4a-a20f-61de1ad0d607 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:44.148294 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e2e35b-0a4b-4e4a-a20f-61de1ad0d607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:44.173415 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-12e2e35b-0a4b-4e4a-a20f-61de1ad0d607 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:47:44.174693 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-12e2e35b-0a4b-4e4a-a20f-61de1ad0d607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:44.180189 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:44.186233 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6836b4a-eb93-4819-896e-a179f36bbf7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:44.187257 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6836b4a-eb93-4819-896e-a179f36bbf7e admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:44.187575 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6836b4a-eb93-4819-896e-a179f36bbf7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:44.187859 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6836b4a-eb93-4819-896e-a179f36bbf7e admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:44.188749 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6836b4a-eb93-4819-896e-a179f36bbf7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:44.191970 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6836b4a-eb93-4819-896e-a179f36bbf7e admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:44.208307 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1320/2634] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:47:44 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:47:44.209578 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6836b4a-eb93-4819-896e-a179f36bbf7e admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:44.213707 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-e6836b4a-eb93-4819-896e-a179f36bbf7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:44.227267 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6836b4a-eb93-4819-896e-a179f36bbf7e admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:44.233880 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73007b4-79d7-4f5b-b345-bfea3dce462a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:44.234667 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73007b4-79d7-4f5b-b345-bfea3dce462a admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:44.234939 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73007b4-79d7-4f5b-b345-bfea3dce462a admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:44.235226 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73007b4-79d7-4f5b-b345-bfea3dce462a admin admin] PATH_INFO: `/v3/projects/d496f8eb23304dfd93845f09ff8dfe7e/users/c1c994b6fac245d6b10148c1fa4ebd9a/roles/462e3381a85c42a9959201f9aa122f7c` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:44.252909 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73007b4-79d7-4f5b-b345-bfea3dce462a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d496f8eb23304dfd93845f09ff8dfe7e, user_id=c1c994b6fac245d6b10148c1fa4ebd9a, role_id=462e3381a85c42a9959201f9aa122f7c)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:44.256334 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73007b4-79d7-4f5b-b345-bfea3dce462a admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:44.258482 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1315/2635] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:47:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:47:44.266629 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b04aec3-a103-4663-85b8-9c12ce9d2c56 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:44.266912 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b04aec3-a103-4663-85b8-9c12ce9d2c56 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:44.267192 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b04aec3-a103-4663-85b8-9c12ce9d2c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:44.273129 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1321/2636] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:47:44 2022] PUT /identity/v3/projects/d496f8eb23304dfd93845f09ff8dfe7e/users/c1c994b6fac245d6b10148c1fa4ebd9a/roles/462e3381a85c42a9959201f9aa122f7c => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:47:44.285059 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1585cdda-5ec2-456e-a1bf-ff07b4d9b52a None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:44.285381 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1585cdda-5ec2-456e-a1bf-ff07b4d9b52a None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:44.285655 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1585cdda-5ec2-456e-a1bf-ff07b4d9b52a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:44.289840 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-7b04aec3-a103-4663-85b8-9c12ce9d2c56 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:47:44.291056 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-7b04aec3-a103-4663-85b8-9c12ce9d2c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:44.314056 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-1585cdda-5ec2-456e-a1bf-ff07b4d9b52a None None] MFA Rules not processed for user `c1c994b6fac245d6b10148c1fa4ebd9a`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:47:44.315297 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-1585cdda-5ec2-456e-a1bf-ff07b4d9b52a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:44.351213 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1316/2637] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:47:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:47:44.355778 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b04aec3-a103-4663-85b8-9c12ce9d2c56 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:44.364947 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b04aec3-a103-4663-85b8-9c12ce9d2c56 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:44.369410 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c728674b-9a91-42a1-a54b-ce2287d78069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:44.370000 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c728674b-9a91-42a1-a54b-ce2287d78069 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:44.370285 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c728674b-9a91-42a1-a54b-ce2287d78069 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:44.370588 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c728674b-9a91-42a1-a54b-ce2287d78069 admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:44.371252 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c728674b-9a91-42a1-a54b-ce2287d78069 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:47:44.371600 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c728674b-9a91-42a1-a54b-ce2287d78069 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:44.373231 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c728674b-9a91-42a1-a54b-ce2287d78069 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:44.381272 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1322/2638] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:47:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:47:44.385785 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1585cdda-5ec2-456e-a1bf-ff07b4d9b52a None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:44.386191 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1317/2639] 10.222.0.70 () {58 vars in 1153 bytes} [Tue Aug 2 21:47:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:47:44.390133 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c728674b-9a91-42a1-a54b-ce2287d78069 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:44.398653 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1585cdda-5ec2-456e-a1bf-ff07b4d9b52a None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:44.400780 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c728674b-9a91-42a1-a54b-ce2287d78069 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:44.403423 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3541e9-7062-4bc2-945a-6164f77194b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:44.404068 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3541e9-7062-4bc2-945a-6164f77194b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:44.404388 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3541e9-7062-4bc2-945a-6164f77194b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:44.404698 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3541e9-7062-4bc2-945a-6164f77194b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:44.405389 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3541e9-7062-4bc2-945a-6164f77194b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:44.406123 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edca0719-e8a1-4aa3-90d3-86dcb032ad2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:44.406922 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edca0719-e8a1-4aa3-90d3-86dcb032ad2f admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:44.407213 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edca0719-e8a1-4aa3-90d3-86dcb032ad2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:44.407334 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3541e9-7062-4bc2-945a-6164f77194b5 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:44.407491 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edca0719-e8a1-4aa3-90d3-86dcb032ad2f admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:44.408545 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edca0719-e8a1-4aa3-90d3-86dcb032ad2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:44.410474 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edca0719-e8a1-4aa3-90d3-86dcb032ad2f admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:44.438076 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1323/2640] 10.222.0.70 () {60 vars in 1153 bytes} [Tue Aug 2 21:47:44 2022] POST /identity/v3/projects => generated 371 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 21:47:44.442655 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1318/2641] 10.222.0.70 () {60 vars in 1153 bytes} [Tue Aug 2 21:47:44 2022] POST /identity/v3/projects => generated 383 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 21:47:44.442761 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3541e9-7062-4bc2-945a-6164f77194b5 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:44.446780 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edca0719-e8a1-4aa3-90d3-86dcb032ad2f admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:44.491321 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:44.515044 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edca0719-e8a1-4aa3-90d3-86dcb032ad2f admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:44.515631 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3541e9-7062-4bc2-945a-6164f77194b5 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:44.519840 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5e0230-c090-4f51-85b6-cbbd3977abe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:44.520431 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b4790f-1e8c-4dd8-a34d-d30c6234fde8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:44.521057 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b4790f-1e8c-4dd8-a34d-d30c6234fde8 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:44.521169 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e0230-c090-4f51-85b6-cbbd3977abe8 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:44.521342 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b4790f-1e8c-4dd8-a34d-d30c6234fde8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:44.521467 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e0230-c090-4f51-85b6-cbbd3977abe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:44.521620 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b4790f-1e8c-4dd8-a34d-d30c6234fde8 admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:44.521722 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5e0230-c090-4f51-85b6-cbbd3977abe8 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:44.522276 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5e0230-c090-4f51-85b6-cbbd3977abe8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:44.522431 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b4790f-1e8c-4dd8-a34d-d30c6234fde8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:44.524202 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5e0230-c090-4f51-85b6-cbbd3977abe8 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:44.524385 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b4790f-1e8c-4dd8-a34d-d30c6234fde8 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:44.545011 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1319/2642] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 2 21:47:44 2022] POST /identity/v3/users => generated 292 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:47:44.548269 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1324/2643] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 2 21:47:44 2022] POST /identity/v3/users => generated 292 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 21:47:44.549931 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5e0230-c090-4f51-85b6-cbbd3977abe8 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:44.550607 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b4790f-1e8c-4dd8-a34d-d30c6234fde8 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:44.556742 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:44.561259 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b4790f-1e8c-4dd8-a34d-d30c6234fde8 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:44.561501 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5e0230-c090-4f51-85b6-cbbd3977abe8 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:44.567138 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad073a6-ea90-4ccd-bf34-f340cec6e14e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:44.568484 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad073a6-ea90-4ccd-bf34-f340cec6e14e admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:44.568484 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad073a6-ea90-4ccd-bf34-f340cec6e14e admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:44.568660 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad073a6-ea90-4ccd-bf34-f340cec6e14e admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:44.569589 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad073a6-ea90-4ccd-bf34-f340cec6e14e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:44.569846 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578dab60-4466-4a25-8d71-1514cbb974f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:44.570662 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578dab60-4466-4a25-8d71-1514cbb974f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:44.571457 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578dab60-4466-4a25-8d71-1514cbb974f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:44.571597 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad073a6-ea90-4ccd-bf34-f340cec6e14e admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:44.572466 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578dab60-4466-4a25-8d71-1514cbb974f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:44.573507 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578dab60-4466-4a25-8d71-1514cbb974f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:44.575539 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578dab60-4466-4a25-8d71-1514cbb974f5 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:44.583623 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1325/2644] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:47:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 21:47:44.587920 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad073a6-ea90-4ccd-bf34-f340cec6e14e admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:44.591031 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1320/2645] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:47:44 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:47:44.594971 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578dab60-4466-4a25-8d71-1514cbb974f5 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:44.599329 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad073a6-ea90-4ccd-bf34-f340cec6e14e admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:44.603966 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e736093e-4222-4ca2-97a6-30eafad4e995 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:44.604586 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e736093e-4222-4ca2-97a6-30eafad4e995 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:44.605129 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e736093e-4222-4ca2-97a6-30eafad4e995 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:44.605401 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e736093e-4222-4ca2-97a6-30eafad4e995 admin admin] PATH_INFO: `/v3/projects/93a1497b5ee74550adc118416e783375/users/6bdbbe615b5e45a6a58ac74c910e3bf4/roles/3e32dbf75f9b41f5adb9fe59851267bb` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:44.605502 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578dab60-4466-4a25-8d71-1514cbb974f5 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:44.610144 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a918bc-471b-4ac9-914a-0a022cd9df55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:44.610825 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a918bc-471b-4ac9-914a-0a022cd9df55 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:44.611303 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a918bc-471b-4ac9-914a-0a022cd9df55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:44.611303 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a918bc-471b-4ac9-914a-0a022cd9df55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:44.611982 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a918bc-471b-4ac9-914a-0a022cd9df55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:44.614194 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a918bc-471b-4ac9-914a-0a022cd9df55 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:44.629563 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1321/2646] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:47:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:47:44.629976 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a918bc-471b-4ac9-914a-0a022cd9df55 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:44.632674 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e736093e-4222-4ca2-97a6-30eafad4e995 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93a1497b5ee74550adc118416e783375, user_id=6bdbbe615b5e45a6a58ac74c910e3bf4, role_id=3e32dbf75f9b41f5adb9fe59851267bb)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:44.635569 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e736093e-4222-4ca2-97a6-30eafad4e995 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:44.641840 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a918bc-471b-4ac9-914a-0a022cd9df55 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:44.647754 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d30f652-9f05-47fa-87c5-8840f74c120c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:44.648595 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d30f652-9f05-47fa-87c5-8840f74c120c admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:44.648894 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d30f652-9f05-47fa-87c5-8840f74c120c admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:44.649225 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d30f652-9f05-47fa-87c5-8840f74c120c admin admin] PATH_INFO: `/v3/projects/6f56b022ba3243c591ee8963ac0f824c/users/131fc28c976a43b39bf30d566caefa46/roles/462e3381a85c42a9959201f9aa122f7c` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:44.653529 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1326/2647] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:47:44 2022] PUT /identity/v3/projects/93a1497b5ee74550adc118416e783375/users/6bdbbe615b5e45a6a58ac74c910e3bf4/roles/3e32dbf75f9b41f5adb9fe59851267bb => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:47:44.656060 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e736093e-4222-4ca2-97a6-30eafad4e995 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:44.670092 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d30f652-9f05-47fa-87c5-8840f74c120c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f56b022ba3243c591ee8963ac0f824c, user_id=131fc28c976a43b39bf30d566caefa46, role_id=462e3381a85c42a9959201f9aa122f7c)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:44.673646 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d30f652-9f05-47fa-87c5-8840f74c120c admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:44.689453 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1322/2648] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:47:44 2022] PUT /identity/v3/projects/6f56b022ba3243c591ee8963ac0f824c/users/131fc28c976a43b39bf30d566caefa46/roles/462e3381a85c42a9959201f9aa122f7c => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:47:44.700802 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db874c12-7fa7-4cb6-94bc-9d5f940eedd8 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:44.701120 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db874c12-7fa7-4cb6-94bc-9d5f940eedd8 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:44.701549 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db874c12-7fa7-4cb6-94bc-9d5f940eedd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:44.733243 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-db874c12-7fa7-4cb6-94bc-9d5f940eedd8 None None] MFA Rules not processed for user `131fc28c976a43b39bf30d566caefa46`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:47:44.734464 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-db874c12-7fa7-4cb6-94bc-9d5f940eedd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:44.740430 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e736093e-4222-4ca2-97a6-30eafad4e995 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:44.807458 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f263c1-20d0-4e82-87e8-c8f736eadd83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:44.808094 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f263c1-20d0-4e82-87e8-c8f736eadd83 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:44.808670 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f263c1-20d0-4e82-87e8-c8f736eadd83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:44.809162 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f263c1-20d0-4e82-87e8-c8f736eadd83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:44.810530 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f263c1-20d0-4e82-87e8-c8f736eadd83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:44.812372 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f263c1-20d0-4e82-87e8-c8f736eadd83 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:44.819211 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1323/2649] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:47:44 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:47:44.826693 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1327/2650] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:47:44 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:47:44.826849 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db874c12-7fa7-4cb6-94bc-9d5f940eedd8 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:44.827657 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f263c1-20d0-4e82-87e8-c8f736eadd83 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:44.834491 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db874c12-7fa7-4cb6-94bc-9d5f940eedd8 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:44.837428 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f263c1-20d0-4e82-87e8-c8f736eadd83 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:44.839236 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3418c48e-1735-4c42-883e-432c9c427dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:44.839934 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3418c48e-1735-4c42-883e-432c9c427dcb admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:44.840322 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3418c48e-1735-4c42-883e-432c9c427dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:44.840611 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3418c48e-1735-4c42-883e-432c9c427dcb admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:44.841340 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3418c48e-1735-4c42-883e-432c9c427dcb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:44.842989 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09afb99-a84b-4cdc-94e5-e1e4c85b3480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:44.843311 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3418c48e-1735-4c42-883e-432c9c427dcb admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:44.843645 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09afb99-a84b-4cdc-94e5-e1e4c85b3480 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:44.844052 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09afb99-a84b-4cdc-94e5-e1e4c85b3480 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:44.844542 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09afb99-a84b-4cdc-94e5-e1e4c85b3480 admin admin] PATH_INFO: `/v3/projects/93a1497b5ee74550adc118416e783375/users/6bdbbe615b5e45a6a58ac74c910e3bf4/roles/3e32dbf75f9b41f5adb9fe59851267bb` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:44.846898 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09afb99-a84b-4cdc-94e5-e1e4c85b3480 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93a1497b5ee74550adc118416e783375, user_id=6bdbbe615b5e45a6a58ac74c910e3bf4, role_id=3e32dbf75f9b41f5adb9fe59851267bb)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:44.850293 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09afb99-a84b-4cdc-94e5-e1e4c85b3480 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:44.861685 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1328/2651] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:47:44 2022] PUT /identity/v3/projects/93a1497b5ee74550adc118416e783375/users/6bdbbe615b5e45a6a58ac74c910e3bf4/roles/3e32dbf75f9b41f5adb9fe59851267bb => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:47:44.872645 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad8eb1-f29c-44d1-ac08-8dfacc8934ee None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:44.872937 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad8eb1-f29c-44d1-ac08-8dfacc8934ee None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:44.873248 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bad8eb1-f29c-44d1-ac08-8dfacc8934ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:44.876589 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1324/2652] 10.222.0.70 () {60 vars in 1153 bytes} [Tue Aug 2 21:47:44 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 21:47:44.877510 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3418c48e-1735-4c42-883e-432c9c427dcb admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:44.905785 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-4bad8eb1-f29c-44d1-ac08-8dfacc8934ee None None] MFA Rules not processed for user `6bdbbe615b5e45a6a58ac74c910e3bf4`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:47:44.907073 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-4bad8eb1-f29c-44d1-ac08-8dfacc8934ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:44.923350 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:44.944377 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3418c48e-1735-4c42-883e-432c9c427dcb admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:44.949260 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5855f8-f0ba-48b0-b58b-f4bba6f90190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:44.949889 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5855f8-f0ba-48b0-b58b-f4bba6f90190 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:44.950176 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5855f8-f0ba-48b0-b58b-f4bba6f90190 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:44.950456 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5855f8-f0ba-48b0-b58b-f4bba6f90190 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:44.951160 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5855f8-f0ba-48b0-b58b-f4bba6f90190 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:44.953163 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5855f8-f0ba-48b0-b58b-f4bba6f90190 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:44.980193 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1325/2653] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 2 21:47:44 2022] POST /identity/v3/users => generated 298 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 21:47:44.981499 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5855f8-f0ba-48b0-b58b-f4bba6f90190 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:44.992451 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5855f8-f0ba-48b0-b58b-f4bba6f90190 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:44.993128 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1329/2654] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:47:44 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:47:44.997609 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6daba7-badd-4c6f-ae28-684800a66cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:44.998232 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6daba7-badd-4c6f-ae28-684800a66cd6 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:44.998520 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6daba7-badd-4c6f-ae28-684800a66cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:44.998801 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6daba7-badd-4c6f-ae28-684800a66cd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:44.999503 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6daba7-badd-4c6f-ae28-684800a66cd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:45.001272 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6daba7-badd-4c6f-ae28-684800a66cd6 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:45.005729 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bad8eb1-f29c-44d1-ac08-8dfacc8934ee None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:45.007260 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-4bad8eb1-f29c-44d1-ac08-8dfacc8934ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:45.016522 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1326/2655] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:47:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:47:45.018019 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6daba7-badd-4c6f-ae28-684800a66cd6 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:45.024667 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:45.028998 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6daba7-badd-4c6f-ae28-684800a66cd6 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:45.035310 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37e0869-70ea-498c-93ab-e7eb5e4d49fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:45.036331 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37e0869-70ea-498c-93ab-e7eb5e4d49fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:45.036695 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37e0869-70ea-498c-93ab-e7eb5e4d49fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:45.037086 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37e0869-70ea-498c-93ab-e7eb5e4d49fe admin admin] PATH_INFO: `/v3/projects/53e6b04edf8c4e71b58c6375611e8a28/users/519cca57e4574800bd61084117a0e14d/roles/3e32dbf75f9b41f5adb9fe59851267bb` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:45.057077 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37e0869-70ea-498c-93ab-e7eb5e4d49fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=53e6b04edf8c4e71b58c6375611e8a28, user_id=519cca57e4574800bd61084117a0e14d, role_id=3e32dbf75f9b41f5adb9fe59851267bb)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:45.059770 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37e0869-70ea-498c-93ab-e7eb5e4d49fe admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:45.076093 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1327/2656] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:47:45 2022] PUT /identity/v3/projects/53e6b04edf8c4e71b58c6375611e8a28/users/519cca57e4574800bd61084117a0e14d/roles/3e32dbf75f9b41f5adb9fe59851267bb => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:47:45.078881 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bad8eb1-f29c-44d1-ac08-8dfacc8934ee None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:45.080488 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37e0869-70ea-498c-93ab-e7eb5e4d49fe admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:45.132984 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b9e49c-1bc8-45f3-9835-1cfd62ae3e1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '123eb76f95ee4e39905944da701c712d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:45.133532 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b9e49c-1bc8-45f3-9835-1cfd62ae3e1a service cinder] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:45.133818 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b9e49c-1bc8-45f3-9835-1cfd62ae3e1a service cinder] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:45.134119 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b9e49c-1bc8-45f3-9835-1cfd62ae3e1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:45.147607 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37e0869-70ea-498c-93ab-e7eb5e4d49fe admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:45.152350 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2a348f-cb52-4918-8411-51fafbfb855d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:45.152972 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2a348f-cb52-4918-8411-51fafbfb855d admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:45.153260 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2a348f-cb52-4918-8411-51fafbfb855d admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:45.153535 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2a348f-cb52-4918-8411-51fafbfb855d admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:45.154228 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2a348f-cb52-4918-8411-51fafbfb855d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:45.155825 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2a348f-cb52-4918-8411-51fafbfb855d admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:45.169802 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1328/2657] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:47:45 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:47:45.171443 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2a348f-cb52-4918-8411-51fafbfb855d admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:45.182322 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2a348f-cb52-4918-8411-51fafbfb855d admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:45.188689 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eda7da8-e755-4b53-b922-a26f524e1fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:45.189355 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda7da8-e755-4b53-b922-a26f524e1fed admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:45.189637 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda7da8-e755-4b53-b922-a26f524e1fed admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:45.189919 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eda7da8-e755-4b53-b922-a26f524e1fed admin admin] PATH_INFO: `/v3/projects/53e6b04edf8c4e71b58c6375611e8a28/users/519cca57e4574800bd61084117a0e14d/roles/3e32dbf75f9b41f5adb9fe59851267bb` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:45.192623 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eda7da8-e755-4b53-b922-a26f524e1fed admin admin] RBAC: Authorizing `identity:create_grant(project_id=53e6b04edf8c4e71b58c6375611e8a28, user_id=519cca57e4574800bd61084117a0e14d, role_id=3e32dbf75f9b41f5adb9fe59851267bb)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:45.195267 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eda7da8-e755-4b53-b922-a26f524e1fed admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:45.203266 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b9e49c-1bc8-45f3-9835-1cfd62ae3e1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:45.204767 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b9e49c-1bc8-45f3-9835-1cfd62ae3e1a service cinder] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:45.207184 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1329/2658] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:47:45 2022] PUT /identity/v3/projects/53e6b04edf8c4e71b58c6375611e8a28/users/519cca57e4574800bd61084117a0e14d/roles/3e32dbf75f9b41f5adb9fe59851267bb => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:47:45.216399 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1330/2659] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:47:45 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 21:47:45.217219 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129fcb8a-e84b-4bdd-bf50-3ecd357703aa None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:45.217325 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129fcb8a-e84b-4bdd-bf50-3ecd357703aa None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:45.217577 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129fcb8a-e84b-4bdd-bf50-3ecd357703aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:45.250328 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-129fcb8a-e84b-4bdd-bf50-3ecd357703aa None None] MFA Rules not processed for user `519cca57e4574800bd61084117a0e14d`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:47:45.251649 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-129fcb8a-e84b-4bdd-bf50-3ecd357703aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:45.350271 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1330/2660] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:47:45 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:47:45.367046 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b9e49c-1bc8-45f3-9835-1cfd62ae3e1a service cinder] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:45.368630 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-a9b9e49c-1bc8-45f3-9835-1cfd62ae3e1a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:45.380533 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b9e49c-1bc8-45f3-9835-1cfd62ae3e1a service cinder] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:45.395278 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:45.440294 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b54556-ba14-4dbf-bf61-0b9760c275e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '123eb76f95ee4e39905944da701c712d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:45.440829 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b54556-ba14-4dbf-bf61-0b9760c275e9 service cinder] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:45.441188 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b54556-ba14-4dbf-bf61-0b9760c275e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:45.441501 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b54556-ba14-4dbf-bf61-0b9760c275e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:45.451792 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b54556-ba14-4dbf-bf61-0b9760c275e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:45.453530 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b54556-ba14-4dbf-bf61-0b9760c275e9 service cinder] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:45.464395 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1331/2661] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:47:45 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:47:45.567099 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129fcb8a-e84b-4bdd-bf50-3ecd357703aa None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:45.580254 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129fcb8a-e84b-4bdd-bf50-3ecd357703aa None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:45.584073 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc068bd6-4fea-4d49-919b-cae36837ec8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '123eb76f95ee4e39905944da701c712d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:45.584722 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc068bd6-4fea-4d49-919b-cae36837ec8d service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:45.584992 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc068bd6-4fea-4d49-919b-cae36837ec8d service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:45.585268 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc068bd6-4fea-4d49-919b-cae36837ec8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:45.637925 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:45.638335 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b54556-ba14-4dbf-bf61-0b9760c275e9 service cinder] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:45.652343 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc068bd6-4fea-4d49-919b-cae36837ec8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:45.653849 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc068bd6-4fea-4d49-919b-cae36837ec8d service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:45.664144 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1331/2662] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:47:45 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:47:45.707438 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b54556-ba14-4dbf-bf61-0b9760c275e9 service cinder] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:45.713674 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca16cf6b-6b9c-404b-a02c-c1d369b547d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:45.714196 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca16cf6b-6b9c-404b-a02c-c1d369b547d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:45.714556 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca16cf6b-6b9c-404b-a02c-c1d369b547d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:45.714839 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca16cf6b-6b9c-404b-a02c-c1d369b547d8 admin admin] PATH_INFO: `/v3/users/c1c994b6fac245d6b10148c1fa4ebd9a` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:45.716038 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca16cf6b-6b9c-404b-a02c-c1d369b547d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1c994b6fac245d6b10148c1fa4ebd9a)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:45.717996 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca16cf6b-6b9c-404b-a02c-c1d369b547d8 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:45.770466 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-ca16cf6b-6b9c-404b-a02c-c1d369b547d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1c994b6fac245d6b10148c1fa4ebd9a'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:45.781490 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-ca16cf6b-6b9c-404b-a02c-c1d369b547d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1c994b6fac245d6b10148c1fa4ebd9a'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:45.799262 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-ca16cf6b-6b9c-404b-a02c-c1d369b547d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1c994b6fac245d6b10148c1fa4ebd9a'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:45.806756 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-ca16cf6b-6b9c-404b-a02c-c1d369b547d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1c994b6fac245d6b10148c1fa4ebd9a'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:45.807505 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-ca16cf6b-6b9c-404b-a02c-c1d369b547d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1c994b6fac245d6b10148c1fa4ebd9a'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:45.814547 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1332/2663] 10.222.0.70 () {58 vars in 1224 bytes} [Tue Aug 2 21:47:45 2022] DELETE /identity/v3/users/c1c994b6fac245d6b10148c1fa4ebd9a => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:47:45.818811 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd383c8-9254-429e-8e1d-077b0e86dd8f None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:45.819102 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd383c8-9254-429e-8e1d-077b0e86dd8f None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:45.819420 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd383c8-9254-429e-8e1d-077b0e86dd8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:45.840584 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-ebd383c8-9254-429e-8e1d-077b0e86dd8f None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:47:45.841998 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-ebd383c8-9254-429e-8e1d-077b0e86dd8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:45.907982 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1332/2664] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:47:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:47:45.918333 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca16cf6b-6b9c-404b-a02c-c1d369b547d8 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:45.919720 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-ca16cf6b-6b9c-404b-a02c-c1d369b547d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:45.963720 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd383c8-9254-429e-8e1d-077b0e86dd8f None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:45.965174 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-ebd383c8-9254-429e-8e1d-077b0e86dd8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:45.975555 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:45.980294 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd383c8-9254-429e-8e1d-077b0e86dd8f None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:45.985718 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0654e28e-80c1-45ad-b3ec-c27218e8df95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:45.986454 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0654e28e-80c1-45ad-b3ec-c27218e8df95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:45.986625 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0654e28e-80c1-45ad-b3ec-c27218e8df95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:45.986916 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0654e28e-80c1-45ad-b3ec-c27218e8df95 admin admin] PATH_INFO: `/v3/users/131fc28c976a43b39bf30d566caefa46` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:45.988190 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0654e28e-80c1-45ad-b3ec-c27218e8df95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=131fc28c976a43b39bf30d566caefa46)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:45.990216 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0654e28e-80c1-45ad-b3ec-c27218e8df95 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:46.001146 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca16cf6b-6b9c-404b-a02c-c1d369b547d8 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:46.005448 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae63218-a869-4c88-bf42-d72835f70e99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '723f5f43572a493dae0349070a2adb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:46.006084 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae63218-a869-4c88-bf42-d72835f70e99 service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:46.006361 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae63218-a869-4c88-bf42-d72835f70e99 service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:46.006633 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae63218-a869-4c88-bf42-d72835f70e99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:46.016441 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae63218-a869-4c88-bf42-d72835f70e99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:46.017957 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae63218-a869-4c88-bf42-d72835f70e99 service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:46.029595 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1333/2665] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:47:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:47:46.045736 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-0654e28e-80c1-45ad-b3ec-c27218e8df95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '131fc28c976a43b39bf30d566caefa46'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:46.057032 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-0654e28e-80c1-45ad-b3ec-c27218e8df95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '131fc28c976a43b39bf30d566caefa46'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:46.070818 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-0654e28e-80c1-45ad-b3ec-c27218e8df95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '131fc28c976a43b39bf30d566caefa46'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:46.071563 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-0654e28e-80c1-45ad-b3ec-c27218e8df95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '131fc28c976a43b39bf30d566caefa46'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:46.079797 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-0654e28e-80c1-45ad-b3ec-c27218e8df95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '131fc28c976a43b39bf30d566caefa46'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:46.088868 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1333/2666] 10.222.0.70 () {58 vars in 1224 bytes} [Tue Aug 2 21:47:45 2022] DELETE /identity/v3/users/131fc28c976a43b39bf30d566caefa46 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:47:46.094315 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca2b11-f283-4351-8b63-df51215feff2 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:46.094638 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca2b11-f283-4351-8b63-df51215feff2 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:46.094915 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beca2b11-f283-4351-8b63-df51215feff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:46.117222 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-beca2b11-f283-4351-8b63-df51215feff2 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:47:46.118794 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-beca2b11-f283-4351-8b63-df51215feff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:46.184387 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1334/2667] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:47:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:47:46.196582 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0654e28e-80c1-45ad-b3ec-c27218e8df95 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:46.198039 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-0654e28e-80c1-45ad-b3ec-c27218e8df95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:46.263544 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0654e28e-80c1-45ad-b3ec-c27218e8df95 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:46.267199 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35b7557-e3fc-4054-85c6-1c08c265aabc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '723f5f43572a493dae0349070a2adb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:46.267828 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b7557-e3fc-4054-85c6-1c08c265aabc service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:46.268111 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b7557-e3fc-4054-85c6-1c08c265aabc service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:46.268427 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35b7557-e3fc-4054-85c6-1c08c265aabc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:46.283126 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35b7557-e3fc-4054-85c6-1c08c265aabc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:46.284634 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35b7557-e3fc-4054-85c6-1c08c265aabc service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:46.295550 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1334/2668] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:47:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:47:46.341382 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beca2b11-f283-4351-8b63-df51215feff2 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:46.343449 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-beca2b11-f283-4351-8b63-df51215feff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:46.356668 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beca2b11-f283-4351-8b63-df51215feff2 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:46.362150 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9299c0f1-2dd9-4cb2-8bb6-bcd05130cced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:46.362968 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9299c0f1-2dd9-4cb2-8bb6-bcd05130cced admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:46.363112 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9299c0f1-2dd9-4cb2-8bb6-bcd05130cced admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:46.364013 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9299c0f1-2dd9-4cb2-8bb6-bcd05130cced admin admin] PATH_INFO: `/v3/projects/d496f8eb23304dfd93845f09ff8dfe7e` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:46.365537 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9299c0f1-2dd9-4cb2-8bb6-bcd05130cced admin admin] RBAC: Authorizing `identity:delete_project(project_id=d496f8eb23304dfd93845f09ff8dfe7e)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:46.367489 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9299c0f1-2dd9-4cb2-8bb6-bcd05130cced admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:46.419251 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-9299c0f1-2dd9-4cb2-8bb6-bcd05130cced admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd496f8eb23304dfd93845f09ff8dfe7e', 'request_id': 'req-9299c0f1-2dd9-4cb2-8bb6-bcd05130cced'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:46.424936 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-9299c0f1-2dd9-4cb2-8bb6-bcd05130cced admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd496f8eb23304dfd93845f09ff8dfe7e', 'request_id': 'req-9299c0f1-2dd9-4cb2-8bb6-bcd05130cced'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:46.433656 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-9299c0f1-2dd9-4cb2-8bb6-bcd05130cced admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd496f8eb23304dfd93845f09ff8dfe7e', 'request_id': 'req-9299c0f1-2dd9-4cb2-8bb6-bcd05130cced'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:46.446297 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-9299c0f1-2dd9-4cb2-8bb6-bcd05130cced admin admin] The token cache is being invalidate because project d496f8eb23304dfd93845f09ff8dfe7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:47:46.446480 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-9299c0f1-2dd9-4cb2-8bb6-bcd05130cced admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:46.447174 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-9299c0f1-2dd9-4cb2-8bb6-bcd05130cced admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:46.448958 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1335/2669] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Aug 2 21:47:46 2022] DELETE /identity/v3/projects/d496f8eb23304dfd93845f09ff8dfe7e => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:47:46.453075 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35b7557-e3fc-4054-85c6-1c08c265aabc service neutron] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:46.459231 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:46.470507 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35b7557-e3fc-4054-85c6-1c08c265aabc service neutron] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:46.538179 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8cabb4-0a86-4c7b-9d49-e27f2cad1140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:46.538830 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8cabb4-0a86-4c7b-9d49-e27f2cad1140 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:46.539117 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8cabb4-0a86-4c7b-9d49-e27f2cad1140 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:46.539431 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8cabb4-0a86-4c7b-9d49-e27f2cad1140 admin admin] PATH_INFO: `/v3/users/6bdbbe615b5e45a6a58ac74c910e3bf4` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:46.540788 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8cabb4-0a86-4c7b-9d49-e27f2cad1140 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bdbbe615b5e45a6a58ac74c910e3bf4)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:46.542745 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8cabb4-0a86-4c7b-9d49-e27f2cad1140 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:46.592352 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-3d8cabb4-0a86-4c7b-9d49-e27f2cad1140 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bdbbe615b5e45a6a58ac74c910e3bf4'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:46.603989 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-3d8cabb4-0a86-4c7b-9d49-e27f2cad1140 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bdbbe615b5e45a6a58ac74c910e3bf4'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:46.617762 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-3d8cabb4-0a86-4c7b-9d49-e27f2cad1140 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bdbbe615b5e45a6a58ac74c910e3bf4'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:46.620486 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-3d8cabb4-0a86-4c7b-9d49-e27f2cad1140 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bdbbe615b5e45a6a58ac74c910e3bf4'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:46.621223 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9299c0f1-2dd9-4cb2-8bb6-bcd05130cced admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:46.623932 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-9299c0f1-2dd9-4cb2-8bb6-bcd05130cced admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:46.631694 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-3d8cabb4-0a86-4c7b-9d49-e27f2cad1140 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bdbbe615b5e45a6a58ac74c910e3bf4'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:46.638922 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1335/2670] 10.222.0.70 () {58 vars in 1224 bytes} [Tue Aug 2 21:47:46 2022] DELETE /identity/v3/users/6bdbbe615b5e45a6a58ac74c910e3bf4 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:47:46.641632 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9299c0f1-2dd9-4cb2-8bb6-bcd05130cced admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:46.710661 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a523cebc-6b17-4eda-b117-dd40dd59ec4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:46.711474 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a523cebc-6b17-4eda-b117-dd40dd59ec4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:46.711844 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a523cebc-6b17-4eda-b117-dd40dd59ec4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:46.712128 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a523cebc-6b17-4eda-b117-dd40dd59ec4e admin admin] PATH_INFO: `/v3/projects/6f56b022ba3243c591ee8963ac0f824c` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:46.713374 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a523cebc-6b17-4eda-b117-dd40dd59ec4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f56b022ba3243c591ee8963ac0f824c)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:46.715758 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a523cebc-6b17-4eda-b117-dd40dd59ec4e admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:46.723575 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:46.768492 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-a523cebc-6b17-4eda-b117-dd40dd59ec4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f56b022ba3243c591ee8963ac0f824c', 'request_id': 'req-a523cebc-6b17-4eda-b117-dd40dd59ec4e'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:46.775046 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-a523cebc-6b17-4eda-b117-dd40dd59ec4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f56b022ba3243c591ee8963ac0f824c', 'request_id': 'req-a523cebc-6b17-4eda-b117-dd40dd59ec4e'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:46.784253 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-a523cebc-6b17-4eda-b117-dd40dd59ec4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f56b022ba3243c591ee8963ac0f824c', 'request_id': 'req-a523cebc-6b17-4eda-b117-dd40dd59ec4e'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:46.798106 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-a523cebc-6b17-4eda-b117-dd40dd59ec4e admin admin] The token cache is being invalidate because project 6f56b022ba3243c591ee8963ac0f824c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:47:46.798403 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-a523cebc-6b17-4eda-b117-dd40dd59ec4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:46.799731 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-a523cebc-6b17-4eda-b117-dd40dd59ec4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:46.801638 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1336/2671] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Aug 2 21:47:46 2022] DELETE /identity/v3/projects/6f56b022ba3243c591ee8963ac0f824c => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:47:46.805484 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8cabb4-0a86-4c7b-9d49-e27f2cad1140 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:46.806902 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-3d8cabb4-0a86-4c7b-9d49-e27f2cad1140 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:46.821125 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8cabb4-0a86-4c7b-9d49-e27f2cad1140 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:46.884066 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2e864f-9f3d-4a9a-a934-aeeff807f302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:46.884839 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2e864f-9f3d-4a9a-a934-aeeff807f302 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:46.885122 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2e864f-9f3d-4a9a-a934-aeeff807f302 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:46.885401 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2e864f-9f3d-4a9a-a934-aeeff807f302 admin admin] PATH_INFO: `/v3/users/519cca57e4574800bd61084117a0e14d` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:46.886685 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2e864f-9f3d-4a9a-a934-aeeff807f302 admin admin] RBAC: Authorizing `identity:delete_user(user_id=519cca57e4574800bd61084117a0e14d)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:46.888776 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2e864f-9f3d-4a9a-a934-aeeff807f302 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:46.915931 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:46.928578 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a523cebc-6b17-4eda-b117-dd40dd59ec4e admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:46.930664 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-a523cebc-6b17-4eda-b117-dd40dd59ec4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:46.944641 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a523cebc-6b17-4eda-b117-dd40dd59ec4e admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:46.952264 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-9e2e864f-9f3d-4a9a-a934-aeeff807f302 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '519cca57e4574800bd61084117a0e14d'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:46.961550 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e61d513-fe27-4b38-adcd-07f60d9afd6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:46.962122 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e61d513-fe27-4b38-adcd-07f60d9afd6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:46.962517 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e61d513-fe27-4b38-adcd-07f60d9afd6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:46.962812 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e61d513-fe27-4b38-adcd-07f60d9afd6d admin admin] PATH_INFO: `/v3/projects/93a1497b5ee74550adc118416e783375` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:46.963507 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-9e2e864f-9f3d-4a9a-a934-aeeff807f302 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '519cca57e4574800bd61084117a0e14d'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:46.964155 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e61d513-fe27-4b38-adcd-07f60d9afd6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=93a1497b5ee74550adc118416e783375)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:46.966122 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e61d513-fe27-4b38-adcd-07f60d9afd6d admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:46.976710 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-9e2e864f-9f3d-4a9a-a934-aeeff807f302 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '519cca57e4574800bd61084117a0e14d'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:46.977590 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-9e2e864f-9f3d-4a9a-a934-aeeff807f302 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '519cca57e4574800bd61084117a0e14d'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:46.987130 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-9e2e864f-9f3d-4a9a-a934-aeeff807f302 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '519cca57e4574800bd61084117a0e14d'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:46.993494 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1336/2672] 10.222.0.70 () {58 vars in 1224 bytes} [Tue Aug 2 21:47:46 2022] DELETE /identity/v3/users/519cca57e4574800bd61084117a0e14d => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:47:47.022836 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-2e61d513-fe27-4b38-adcd-07f60d9afd6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93a1497b5ee74550adc118416e783375', 'request_id': 'req-2e61d513-fe27-4b38-adcd-07f60d9afd6d'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:47.029032 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-2e61d513-fe27-4b38-adcd-07f60d9afd6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93a1497b5ee74550adc118416e783375', 'request_id': 'req-2e61d513-fe27-4b38-adcd-07f60d9afd6d'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:47.040456 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-2e61d513-fe27-4b38-adcd-07f60d9afd6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93a1497b5ee74550adc118416e783375', 'request_id': 'req-2e61d513-fe27-4b38-adcd-07f60d9afd6d'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:47.053697 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-2e61d513-fe27-4b38-adcd-07f60d9afd6d admin admin] The token cache is being invalidate because project 93a1497b5ee74550adc118416e783375 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:47:47.053991 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-2e61d513-fe27-4b38-adcd-07f60d9afd6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:47.055133 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-2e61d513-fe27-4b38-adcd-07f60d9afd6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:47.056734 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1337/2673] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Aug 2 21:47:46 2022] DELETE /identity/v3/projects/93a1497b5ee74550adc118416e783375 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:47:47.061623 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ce95d9-dc56-4a24-9685-ae312873f179 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:47.062206 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ce95d9-dc56-4a24-9685-ae312873f179 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:47.062206 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ce95d9-dc56-4a24-9685-ae312873f179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:47.084184 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-e1ce95d9-dc56-4a24-9685-ae312873f179 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:47:47.085431 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-e1ce95d9-dc56-4a24-9685-ae312873f179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:47.150464 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1337/2674] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:47:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:47:47.157977 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94800c5-ef6e-4585-a9e7-e1c5b75a1c9e None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:47.158268 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94800c5-ef6e-4585-a9e7-e1c5b75a1c9e None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:47.158552 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94800c5-ef6e-4585-a9e7-e1c5b75a1c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:47.179044 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-f94800c5-ef6e-4585-a9e7-e1c5b75a1c9e None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:47:47.180308 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-f94800c5-ef6e-4585-a9e7-e1c5b75a1c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:47.188341 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1338/2675] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:47:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:47:47.193160 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ce95d9-dc56-4a24-9685-ae312873f179 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:47.204549 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ce95d9-dc56-4a24-9685-ae312873f179 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:47.210011 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532dc262-9441-45a2-8a87-a2ae1e330ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:47.210774 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532dc262-9441-45a2-8a87-a2ae1e330ddb admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:47.210967 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532dc262-9441-45a2-8a87-a2ae1e330ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:47.211253 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532dc262-9441-45a2-8a87-a2ae1e330ddb admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:47.211898 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532dc262-9441-45a2-8a87-a2ae1e330ddb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:47:47.212199 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532dc262-9441-45a2-8a87-a2ae1e330ddb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:47.213872 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532dc262-9441-45a2-8a87-a2ae1e330ddb admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:47.226201 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1338/2676] 10.222.0.70 () {58 vars in 1153 bytes} [Tue Aug 2 21:47:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 02 21:47:47.231057 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94800c5-ef6e-4585-a9e7-e1c5b75a1c9e None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:47.242036 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94800c5-ef6e-4585-a9e7-e1c5b75a1c9e None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:47.247123 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6870d87e-fa7d-4eb8-ada8-f265b3406829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:47.247746 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6870d87e-fa7d-4eb8-ada8-f265b3406829 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:47.248030 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6870d87e-fa7d-4eb8-ada8-f265b3406829 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:47.248336 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6870d87e-fa7d-4eb8-ada8-f265b3406829 admin admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:47.249007 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6870d87e-fa7d-4eb8-ada8-f265b3406829 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:47.250928 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6870d87e-fa7d-4eb8-ada8-f265b3406829 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:47.284185 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1339/2677] 10.222.0.70 () {60 vars in 1153 bytes} [Tue Aug 2 21:47:47 2022] POST /identity/v3/projects => generated 369 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:47:47.286590 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532dc262-9441-45a2-8a87-a2ae1e330ddb admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:47.299102 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6870d87e-fa7d-4eb8-ada8-f265b3406829 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:47.301845 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-6870d87e-fa7d-4eb8-ada8-f265b3406829 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:47.304742 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532dc262-9441-45a2-8a87-a2ae1e330ddb admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:47.359308 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:47.388768 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6870d87e-fa7d-4eb8-ada8-f265b3406829 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:47.397279 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac804447-013c-4c4c-84af-63f6d6c475ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:47.397952 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac804447-013c-4c4c-84af-63f6d6c475ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:47.398235 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac804447-013c-4c4c-84af-63f6d6c475ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:47.398512 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac804447-013c-4c4c-84af-63f6d6c475ae admin admin] PATH_INFO: `/v3/projects/53e6b04edf8c4e71b58c6375611e8a28` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:47.399689 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac804447-013c-4c4c-84af-63f6d6c475ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=53e6b04edf8c4e71b58c6375611e8a28)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:47.401143 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe63c17-27fc-4539-83bc-f88d6c06ed2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:47.401743 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac804447-013c-4c4c-84af-63f6d6c475ae admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:47.402274 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe63c17-27fc-4539-83bc-f88d6c06ed2a admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:47.402786 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe63c17-27fc-4539-83bc-f88d6c06ed2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:47.403265 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe63c17-27fc-4539-83bc-f88d6c06ed2a admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:47.404150 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe63c17-27fc-4539-83bc-f88d6c06ed2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:47.406141 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe63c17-27fc-4539-83bc-f88d6c06ed2a admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:47.432146 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1339/2678] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 2 21:47:47 2022] POST /identity/v3/users => generated 285 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:47:47.433976 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe63c17-27fc-4539-83bc-f88d6c06ed2a admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:47.444564 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe63c17-27fc-4539-83bc-f88d6c06ed2a admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:47.455987 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-ac804447-013c-4c4c-84af-63f6d6c475ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53e6b04edf8c4e71b58c6375611e8a28', 'request_id': 'req-ac804447-013c-4c4c-84af-63f6d6c475ae'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:47.460029 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:47.462279 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-ac804447-013c-4c4c-84af-63f6d6c475ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53e6b04edf8c4e71b58c6375611e8a28', 'request_id': 'req-ac804447-013c-4c4c-84af-63f6d6c475ae'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:47.472413 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-ac804447-013c-4c4c-84af-63f6d6c475ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53e6b04edf8c4e71b58c6375611e8a28', 'request_id': 'req-ac804447-013c-4c4c-84af-63f6d6c475ae'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:47.486114 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-ac804447-013c-4c4c-84af-63f6d6c475ae admin admin] The token cache is being invalidate because project 53e6b04edf8c4e71b58c6375611e8a28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:47:47.486463 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-ac804447-013c-4c4c-84af-63f6d6c475ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:47.487839 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-ac804447-013c-4c4c-84af-63f6d6c475ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:47.490342 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1340/2679] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Aug 2 21:47:47 2022] DELETE /identity/v3/projects/53e6b04edf8c4e71b58c6375611e8a28 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:47:47.495051 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1133cf-b709-4784-972f-7de7dd34b072 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:47.495482 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1133cf-b709-4784-972f-7de7dd34b072 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:47.495766 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1133cf-b709-4784-972f-7de7dd34b072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:47.510344 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3cd6f8-1f32-4cec-8e43-2f41c2f23c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:47.511073 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3cd6f8-1f32-4cec-8e43-2f41c2f23c19 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:47.511356 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3cd6f8-1f32-4cec-8e43-2f41c2f23c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:47.511637 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3cd6f8-1f32-4cec-8e43-2f41c2f23c19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:47.512491 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3cd6f8-1f32-4cec-8e43-2f41c2f23c19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:47.514289 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3cd6f8-1f32-4cec-8e43-2f41c2f23c19 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:47.517802 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-fe1133cf-b709-4784-972f-7de7dd34b072 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:47:47.517802 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-fe1133cf-b709-4784-972f-7de7dd34b072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:47.524885 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1341/2680] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:47:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:47:47.528213 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1340/2681] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:47:47 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:47:47.530670 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1133cf-b709-4784-972f-7de7dd34b072 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:47.532063 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-fe1133cf-b709-4784-972f-7de7dd34b072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:47.532820 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35faee9f-387d-4e9a-af0e-befe9a61adb9 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:47.533119 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35faee9f-387d-4e9a-af0e-befe9a61adb9 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:47.533406 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35faee9f-387d-4e9a-af0e-befe9a61adb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:47.544047 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1133cf-b709-4784-972f-7de7dd34b072 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:47.551312 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85e842c-b55d-4874-9f22-cec06d531eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:47.551943 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85e842c-b55d-4874-9f22-cec06d531eff admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:47.552265 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85e842c-b55d-4874-9f22-cec06d531eff admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:47.552535 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85e842c-b55d-4874-9f22-cec06d531eff admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:47.553238 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85e842c-b55d-4874-9f22-cec06d531eff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:47.553868 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-35faee9f-387d-4e9a-af0e-befe9a61adb9 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:47:47.554912 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85e842c-b55d-4874-9f22-cec06d531eff admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:47.555097 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-35faee9f-387d-4e9a-af0e-befe9a61adb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:47.563583 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1341/2682] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:47:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:47:47.569279 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1342/2683] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:47:47 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 21:47:47.569433 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35faee9f-387d-4e9a-af0e-befe9a61adb9 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:47.570157 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85e842c-b55d-4874-9f22-cec06d531eff admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:47.577353 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35faee9f-387d-4e9a-af0e-befe9a61adb9 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:47.580471 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85e842c-b55d-4874-9f22-cec06d531eff admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:47.584873 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3992e2c-6c63-4b90-8234-aa596124e99f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:47.585135 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fa288f-4ae0-4d29-bfa7-c90eba685068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:47.585538 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3992e2c-6c63-4b90-8234-aa596124e99f admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:47.585792 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fa288f-4ae0-4d29-bfa7-c90eba685068 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:47.585915 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3992e2c-6c63-4b90-8234-aa596124e99f admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:47.586097 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fa288f-4ae0-4d29-bfa7-c90eba685068 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:47.586209 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3992e2c-6c63-4b90-8234-aa596124e99f admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:47.586393 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fa288f-4ae0-4d29-bfa7-c90eba685068 admin admin] PATH_INFO: `/v3/projects/a524a428bdca493bac2baab3e325e2e6/users/27208ea522f34dc086444254cdda18f7/roles/462e3381a85c42a9959201f9aa122f7c` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:47.586782 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3992e2c-6c63-4b90-8234-aa596124e99f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:47:47.587095 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3992e2c-6c63-4b90-8234-aa596124e99f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:47.588796 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3992e2c-6c63-4b90-8234-aa596124e99f admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:47.605106 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1342/2684] 10.222.0.70 () {58 vars in 1153 bytes} [Tue Aug 2 21:47:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:47:47.605297 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fa288f-4ae0-4d29-bfa7-c90eba685068 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a524a428bdca493bac2baab3e325e2e6, user_id=27208ea522f34dc086444254cdda18f7, role_id=462e3381a85c42a9959201f9aa122f7c)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:47.605297 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fa288f-4ae0-4d29-bfa7-c90eba685068 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:47.606609 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3992e2c-6c63-4b90-8234-aa596124e99f admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:47.618380 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3992e2c-6c63-4b90-8234-aa596124e99f admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:47.621051 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1343/2685] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:47:47 2022] PUT /identity/v3/projects/a524a428bdca493bac2baab3e325e2e6/users/27208ea522f34dc086444254cdda18f7/roles/462e3381a85c42a9959201f9aa122f7c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:47:47.632196 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595c9bd8-a625-4c33-bbc2-5cc1daf127a1 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:47.632529 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595c9bd8-a625-4c33-bbc2-5cc1daf127a1 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:47.632785 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595c9bd8-a625-4c33-bbc2-5cc1daf127a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:47.661080 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-595c9bd8-a625-4c33-bbc2-5cc1daf127a1 None None] MFA Rules not processed for user `27208ea522f34dc086444254cdda18f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:47:47.662437 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-595c9bd8-a625-4c33-bbc2-5cc1daf127a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:47.686008 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f3aa20-ceac-4b41-a3bd-8f85666ad2d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:47.686634 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f3aa20-ceac-4b41-a3bd-8f85666ad2d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:47.686912 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f3aa20-ceac-4b41-a3bd-8f85666ad2d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:47.687186 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f3aa20-ceac-4b41-a3bd-8f85666ad2d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:47.687875 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f3aa20-ceac-4b41-a3bd-8f85666ad2d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:47.689819 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f3aa20-ceac-4b41-a3bd-8f85666ad2d6 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:47.720942 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1343/2686] 10.222.0.70 () {60 vars in 1153 bytes} [Tue Aug 2 21:47:47 2022] POST /identity/v3/projects => generated 373 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 21:47:47.725400 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f3aa20-ceac-4b41-a3bd-8f85666ad2d6 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:47.736292 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1344/2687] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:47:47 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:47:47.739042 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595c9bd8-a625-4c33-bbc2-5cc1daf127a1 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:47.749455 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595c9bd8-a625-4c33-bbc2-5cc1daf127a1 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:47.774571 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:47.793743 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f3aa20-ceac-4b41-a3bd-8f85666ad2d6 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:47.799150 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657ee409-2262-4905-9f66-0aed8a8ad9fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:47.799779 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657ee409-2262-4905-9f66-0aed8a8ad9fd admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:47.800066 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657ee409-2262-4905-9f66-0aed8a8ad9fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:47.800381 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657ee409-2262-4905-9f66-0aed8a8ad9fd admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:47.801668 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657ee409-2262-4905-9f66-0aed8a8ad9fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:47.803655 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657ee409-2262-4905-9f66-0aed8a8ad9fd admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:47.810421 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834dae8d-8e3f-42d3-873d-9cdbda53047f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:47.811046 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834dae8d-8e3f-42d3-873d-9cdbda53047f admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:47.811327 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834dae8d-8e3f-42d3-873d-9cdbda53047f admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:47.811630 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834dae8d-8e3f-42d3-873d-9cdbda53047f admin admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:47.812321 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834dae8d-8e3f-42d3-873d-9cdbda53047f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:47.814262 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834dae8d-8e3f-42d3-873d-9cdbda53047f admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:47.824841 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1344/2688] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 2 21:47:47 2022] POST /identity/v3/users => generated 287 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 21:47:47.828755 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657ee409-2262-4905-9f66-0aed8a8ad9fd admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:47.839181 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657ee409-2262-4905-9f66-0aed8a8ad9fd admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:47.844102 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dc6c97-ef81-4bf6-a425-9ec4e55c87ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:47.844976 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dc6c97-ef81-4bf6-a425-9ec4e55c87ee admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:47.845264 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dc6c97-ef81-4bf6-a425-9ec4e55c87ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:47.845545 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dc6c97-ef81-4bf6-a425-9ec4e55c87ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:47.849346 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1345/2689] 10.222.0.70 () {60 vars in 1153 bytes} [Tue Aug 2 21:47:47 2022] POST /identity/v3/projects => generated 365 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 21:47:47.849505 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dc6c97-ef81-4bf6-a425-9ec4e55c87ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:47.849505 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dc6c97-ef81-4bf6-a425-9ec4e55c87ee admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:47.850378 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834dae8d-8e3f-42d3-873d-9cdbda53047f admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:47.851326 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:47.864970 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1345/2690] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:47:47 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 21:47:47.868021 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dc6c97-ef81-4bf6-a425-9ec4e55c87ee admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:47.879221 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dc6c97-ef81-4bf6-a425-9ec4e55c87ee admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:47.916429 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834dae8d-8e3f-42d3-873d-9cdbda53047f admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:47.921349 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83c74f3-0f9c-4eb3-8acb-1d1684e1bec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:47.921971 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83c74f3-0f9c-4eb3-8acb-1d1684e1bec7 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:47.922255 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83c74f3-0f9c-4eb3-8acb-1d1684e1bec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:47.922529 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83c74f3-0f9c-4eb3-8acb-1d1684e1bec7 admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:47.923218 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83c74f3-0f9c-4eb3-8acb-1d1684e1bec7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:47.925554 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83c74f3-0f9c-4eb3-8acb-1d1684e1bec7 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:47.942249 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2494e03-6e58-42f2-8e54-c30ce541420b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:47.942938 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2494e03-6e58-42f2-8e54-c30ce541420b admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:47.943255 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2494e03-6e58-42f2-8e54-c30ce541420b admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:47.943536 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2494e03-6e58-42f2-8e54-c30ce541420b admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:47.944248 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2494e03-6e58-42f2-8e54-c30ce541420b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:47.945855 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2494e03-6e58-42f2-8e54-c30ce541420b admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:47.948267 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1346/2691] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 2 21:47:47 2022] POST /identity/v3/users => generated 289 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 21:47:47.952075 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83c74f3-0f9c-4eb3-8acb-1d1684e1bec7 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:47.965645 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1346/2692] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:47:47 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 21:47:47.965874 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83c74f3-0f9c-4eb3-8acb-1d1684e1bec7 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:47.966788 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2494e03-6e58-42f2-8e54-c30ce541420b admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:47.970544 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1a4598-00d1-423c-be16-c53d36e123f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:47.971218 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a4598-00d1-423c-be16-c53d36e123f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:47.971446 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a4598-00d1-423c-be16-c53d36e123f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:47.971720 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1a4598-00d1-423c-be16-c53d36e123f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:47.972436 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1a4598-00d1-423c-be16-c53d36e123f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:47.974672 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1a4598-00d1-423c-be16-c53d36e123f2 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:47.978370 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2494e03-6e58-42f2-8e54-c30ce541420b admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:47.984014 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7defb0-19df-408c-a482-d2b2c3681779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:47.984723 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7defb0-19df-408c-a482-d2b2c3681779 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:47.985157 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7defb0-19df-408c-a482-d2b2c3681779 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:47.985437 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7defb0-19df-408c-a482-d2b2c3681779 admin admin] PATH_INFO: `/v3/projects/6438e54e33b244099aa8dd42b92274d9/users/0b5268fa925440c1ae2d63aecde3f83f/roles/462e3381a85c42a9959201f9aa122f7c` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:47.986600 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1347/2693] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:47:47 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 21:47:47.990729 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1a4598-00d1-423c-be16-c53d36e123f2 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:48.001173 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1a4598-00d1-423c-be16-c53d36e123f2 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:48.003969 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7defb0-19df-408c-a482-d2b2c3681779 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6438e54e33b244099aa8dd42b92274d9, user_id=0b5268fa925440c1ae2d63aecde3f83f, role_id=462e3381a85c42a9959201f9aa122f7c)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:48.005971 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee28dbf9-90fe-4958-808f-e9ea5fb6f2ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:48.006657 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7defb0-19df-408c-a482-d2b2c3681779 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:48.006773 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee28dbf9-90fe-4958-808f-e9ea5fb6f2ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:48.007051 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee28dbf9-90fe-4958-808f-e9ea5fb6f2ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:48.007334 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee28dbf9-90fe-4958-808f-e9ea5fb6f2ea admin admin] PATH_INFO: `/v3/projects/8a6e5b95c76b408490d244c960904cd9/users/7bb733465b914b709e12ff7484619f69/roles/3e32dbf75f9b41f5adb9fe59851267bb` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:48.022049 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1347/2694] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:47:47 2022] PUT /identity/v3/projects/6438e54e33b244099aa8dd42b92274d9/users/0b5268fa925440c1ae2d63aecde3f83f/roles/462e3381a85c42a9959201f9aa122f7c => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:47:48.025405 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee28dbf9-90fe-4958-808f-e9ea5fb6f2ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a6e5b95c76b408490d244c960904cd9, user_id=7bb733465b914b709e12ff7484619f69, role_id=3e32dbf75f9b41f5adb9fe59851267bb)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:48.028092 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee28dbf9-90fe-4958-808f-e9ea5fb6f2ea admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:48.046497 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1348/2695] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:47:47 2022] PUT /identity/v3/projects/8a6e5b95c76b408490d244c960904cd9/users/7bb733465b914b709e12ff7484619f69/roles/3e32dbf75f9b41f5adb9fe59851267bb => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:47:48.049463 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7defb0-19df-408c-a482-d2b2c3681779 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:48.095598 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18045d12-47d1-4ccd-ac86-e4943788289b None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:48.095890 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18045d12-47d1-4ccd-ac86-e4943788289b None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:48.096166 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18045d12-47d1-4ccd-ac86-e4943788289b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:48.120198 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7defb0-19df-408c-a482-d2b2c3681779 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:48.128221 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-18045d12-47d1-4ccd-ac86-e4943788289b None None] MFA Rules not processed for user `0b5268fa925440c1ae2d63aecde3f83f`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:47:48.129456 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-18045d12-47d1-4ccd-ac86-e4943788289b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:48.184510 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ac875b-1bbf-4108-9c47-9205860a2c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:48.185134 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ac875b-1bbf-4108-9c47-9205860a2c4f admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:48.185414 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ac875b-1bbf-4108-9c47-9205860a2c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:48.185687 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ac875b-1bbf-4108-9c47-9205860a2c4f admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:48.186377 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ac875b-1bbf-4108-9c47-9205860a2c4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:48.187972 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ac875b-1bbf-4108-9c47-9205860a2c4f admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:48.191067 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:48.200828 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1348/2696] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:47:48 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:47:48.202283 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1349/2697] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:47:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:47:48.207423 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ac875b-1bbf-4108-9c47-9205860a2c4f admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:48.216424 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18045d12-47d1-4ccd-ac86-e4943788289b None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:48.216635 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ac875b-1bbf-4108-9c47-9205860a2c4f admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:48.217838 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-18045d12-47d1-4ccd-ac86-e4943788289b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:48.221353 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf060d95-7acd-4db7-b625-7920a8243250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:48.222125 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf060d95-7acd-4db7-b625-7920a8243250 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:48.222404 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf060d95-7acd-4db7-b625-7920a8243250 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:48.223251 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf060d95-7acd-4db7-b625-7920a8243250 admin admin] PATH_INFO: `/v3/projects/8a6e5b95c76b408490d244c960904cd9/users/7bb733465b914b709e12ff7484619f69/roles/3e32dbf75f9b41f5adb9fe59851267bb` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:48.225750 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf060d95-7acd-4db7-b625-7920a8243250 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a6e5b95c76b408490d244c960904cd9, user_id=7bb733465b914b709e12ff7484619f69, role_id=3e32dbf75f9b41f5adb9fe59851267bb)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:48.228401 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf060d95-7acd-4db7-b625-7920a8243250 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:48.235896 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:48.242941 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1349/2698] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:47:48 2022] PUT /identity/v3/projects/8a6e5b95c76b408490d244c960904cd9/users/7bb733465b914b709e12ff7484619f69/roles/3e32dbf75f9b41f5adb9fe59851267bb => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:47:48.253017 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec773d3-eff4-4103-8063-fa3b68cf768a None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:48.253307 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec773d3-eff4-4103-8063-fa3b68cf768a None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:48.253603 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec773d3-eff4-4103-8063-fa3b68cf768a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:48.277257 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18045d12-47d1-4ccd-ac86-e4943788289b None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:48.284797 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-1ec773d3-eff4-4103-8063-fa3b68cf768a None None] MFA Rules not processed for user `7bb733465b914b709e12ff7484619f69`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:47:48.286586 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-1ec773d3-eff4-4103-8063-fa3b68cf768a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:48.329505 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cf2d1f-eda3-4163-8ff3-6c06d52d37a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '123eb76f95ee4e39905944da701c712d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:48.330150 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cf2d1f-eda3-4163-8ff3-6c06d52d37a0 service cinder] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:48.330447 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cf2d1f-eda3-4163-8ff3-6c06d52d37a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:48.330723 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cf2d1f-eda3-4163-8ff3-6c06d52d37a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:48.370747 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1350/2699] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:47:48 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:47:48.382831 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec773d3-eff4-4103-8063-fa3b68cf768a None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:48.384293 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-1ec773d3-eff4-4103-8063-fa3b68cf768a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:48.393410 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cf2d1f-eda3-4163-8ff3-6c06d52d37a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:48.395500 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cf2d1f-eda3-4163-8ff3-6c06d52d37a0 service cinder] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:48.398141 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec773d3-eff4-4103-8063-fa3b68cf768a None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:48.401848 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4956fd9e-f660-4ce0-b655-3eab3d271059 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '123eb76f95ee4e39905944da701c712d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:48.402469 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4956fd9e-f660-4ce0-b655-3eab3d271059 service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:48.402747 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4956fd9e-f660-4ce0-b655-3eab3d271059 service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:48.403019 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4956fd9e-f660-4ce0-b655-3eab3d271059 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:48.406079 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1350/2700] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:47:48 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 21:47:48.414060 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4956fd9e-f660-4ce0-b655-3eab3d271059 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:48.415735 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4956fd9e-f660-4ce0-b655-3eab3d271059 service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:48.426703 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1351/2701] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:47:48 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 21:47:48.513708 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cf2d1f-eda3-4163-8ff3-6c06d52d37a0 service cinder] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:48.523835 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cf2d1f-eda3-4163-8ff3-6c06d52d37a0 service cinder] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:48.527522 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e090f4-f6fb-4ce0-b41f-f11c80622b9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '123eb76f95ee4e39905944da701c712d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:48.528136 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e090f4-f6fb-4ce0-b41f-f11c80622b9c service cinder] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:48.528449 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e090f4-f6fb-4ce0-b41f-f11c80622b9c service cinder] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:48.528725 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e090f4-f6fb-4ce0-b41f-f11c80622b9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:48.593875 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e090f4-f6fb-4ce0-b41f-f11c80622b9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:48.595329 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e090f4-f6fb-4ce0-b41f-f11c80622b9c service cinder] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:48.604328 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1351/2702] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:47:48 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:47:49.791100 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35124120-7ab3-4c9a-8e14-81d2c4528fdd None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:49.791641 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35124120-7ab3-4c9a-8e14-81d2c4528fdd None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:49.791641 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35124120-7ab3-4c9a-8e14-81d2c4528fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:49.810620 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-35124120-7ab3-4c9a-8e14-81d2c4528fdd None None] MFA Rules not processed for user `0b5268fa925440c1ae2d63aecde3f83f`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:47:49.811733 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-35124120-7ab3-4c9a-8e14-81d2c4528fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:49.819068 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1352/2703] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:47:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:47:52.056501 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e090f4-f6fb-4ce0-b41f-f11c80622b9c service cinder] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:52.062396 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=100 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:52.130747 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e090f4-f6fb-4ce0-b41f-f11c80622b9c service cinder] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:52.135291 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07653412-51a1-4880-ab11-6698dddccfa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:52.135961 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07653412-51a1-4880-ab11-6698dddccfa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:52.136255 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07653412-51a1-4880-ab11-6698dddccfa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:52.136556 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07653412-51a1-4880-ab11-6698dddccfa7 admin admin] PATH_INFO: `/v3/users/27208ea522f34dc086444254cdda18f7` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:52.137711 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07653412-51a1-4880-ab11-6698dddccfa7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27208ea522f34dc086444254cdda18f7)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:52.139774 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07653412-51a1-4880-ab11-6698dddccfa7 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:52.192487 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-07653412-51a1-4880-ab11-6698dddccfa7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27208ea522f34dc086444254cdda18f7'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:52.200339 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-07653412-51a1-4880-ab11-6698dddccfa7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27208ea522f34dc086444254cdda18f7'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:52.217554 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-07653412-51a1-4880-ab11-6698dddccfa7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27208ea522f34dc086444254cdda18f7'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:52.226004 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-07653412-51a1-4880-ab11-6698dddccfa7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27208ea522f34dc086444254cdda18f7'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:52.226848 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-07653412-51a1-4880-ab11-6698dddccfa7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27208ea522f34dc086444254cdda18f7'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:52.234331 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1352/2704] 10.222.0.70 () {58 vars in 1224 bytes} [Tue Aug 2 21:47:52 2022] DELETE /identity/v3/users/27208ea522f34dc086444254cdda18f7 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:47:52.239359 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa5829-c92a-44bd-b504-af8a3dde9733 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:52.239953 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa5829-c92a-44bd-b504-af8a3dde9733 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:52.239953 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fa5829-c92a-44bd-b504-af8a3dde9733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:52.259296 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-94fa5829-c92a-44bd-b504-af8a3dde9733 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:47:52.260609 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-94fa5829-c92a-44bd-b504-af8a3dde9733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:52.332199 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1353/2705] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:47:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:47:52.343400 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07653412-51a1-4880-ab11-6698dddccfa7 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:52.345128 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-07653412-51a1-4880-ab11-6698dddccfa7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:52.421096 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07653412-51a1-4880-ab11-6698dddccfa7 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:52.427129 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c458ddd-f475-495d-b8e7-eb4b882517dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '723f5f43572a493dae0349070a2adb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:52.428088 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c458ddd-f475-495d-b8e7-eb4b882517dd service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:52.428702 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c458ddd-f475-495d-b8e7-eb4b882517dd service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:52.429062 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c458ddd-f475-495d-b8e7-eb4b882517dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:52.442585 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c458ddd-f475-495d-b8e7-eb4b882517dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:52.444517 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c458ddd-f475-495d-b8e7-eb4b882517dd service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:52.455970 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1353/2706] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:47:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:47:53.038458 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fa5829-c92a-44bd-b504-af8a3dde9733 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:53.040508 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-94fa5829-c92a-44bd-b504-af8a3dde9733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:53.058145 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fa5829-c92a-44bd-b504-af8a3dde9733 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:53.063081 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5e4d47-217d-41a0-b17a-2577ed695061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:53.063735 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5e4d47-217d-41a0-b17a-2577ed695061 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:53.064017 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5e4d47-217d-41a0-b17a-2577ed695061 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:53.064814 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5e4d47-217d-41a0-b17a-2577ed695061 admin admin] PATH_INFO: `/v3/projects/a524a428bdca493bac2baab3e325e2e6` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:53.065676 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5e4d47-217d-41a0-b17a-2577ed695061 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a524a428bdca493bac2baab3e325e2e6)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:53.068140 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5e4d47-217d-41a0-b17a-2577ed695061 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:53.136423 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-0f5e4d47-217d-41a0-b17a-2577ed695061 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a524a428bdca493bac2baab3e325e2e6', 'request_id': 'req-0f5e4d47-217d-41a0-b17a-2577ed695061'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:53.146852 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-0f5e4d47-217d-41a0-b17a-2577ed695061 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a524a428bdca493bac2baab3e325e2e6', 'request_id': 'req-0f5e4d47-217d-41a0-b17a-2577ed695061'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:53.151607 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:53.153983 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-0f5e4d47-217d-41a0-b17a-2577ed695061 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a524a428bdca493bac2baab3e325e2e6', 'request_id': 'req-0f5e4d47-217d-41a0-b17a-2577ed695061'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:53.167937 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-0f5e4d47-217d-41a0-b17a-2577ed695061 admin admin] The token cache is being invalidate because project a524a428bdca493bac2baab3e325e2e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:47:53.168249 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-0f5e4d47-217d-41a0-b17a-2577ed695061 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:53.168916 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-0f5e4d47-217d-41a0-b17a-2577ed695061 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:53.172716 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1354/2707] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Aug 2 21:47:53 2022] DELETE /identity/v3/projects/a524a428bdca493bac2baab3e325e2e6 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:47:53.175892 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c458ddd-f475-495d-b8e7-eb4b882517dd service neutron] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:53.187529 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c458ddd-f475-495d-b8e7-eb4b882517dd service neutron] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:53.221448 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:53.270074 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742bb499-9f16-41b3-9d4a-815eacf49de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:53.270733 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742bb499-9f16-41b3-9d4a-815eacf49de0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:53.271018 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742bb499-9f16-41b3-9d4a-815eacf49de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:53.271298 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742bb499-9f16-41b3-9d4a-815eacf49de0 admin admin] PATH_INFO: `/v3/users/7bb733465b914b709e12ff7484619f69` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:53.272537 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742bb499-9f16-41b3-9d4a-815eacf49de0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7bb733465b914b709e12ff7484619f69)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:53.274485 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742bb499-9f16-41b3-9d4a-815eacf49de0 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:53.327321 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-742bb499-9f16-41b3-9d4a-815eacf49de0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bb733465b914b709e12ff7484619f69'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:53.334794 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-742bb499-9f16-41b3-9d4a-815eacf49de0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bb733465b914b709e12ff7484619f69'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:53.348813 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-742bb499-9f16-41b3-9d4a-815eacf49de0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bb733465b914b709e12ff7484619f69'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:53.359208 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-742bb499-9f16-41b3-9d4a-815eacf49de0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bb733465b914b709e12ff7484619f69'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:53.359966 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-742bb499-9f16-41b3-9d4a-815eacf49de0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bb733465b914b709e12ff7484619f69'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:53.366586 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1354/2708] 10.222.0.70 () {58 vars in 1224 bytes} [Tue Aug 2 21:47:53 2022] DELETE /identity/v3/users/7bb733465b914b709e12ff7484619f69 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:47:53.888415 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5e4d47-217d-41a0-b17a-2577ed695061 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:53.890287 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-0f5e4d47-217d-41a0-b17a-2577ed695061 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:53.924611 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5e4d47-217d-41a0-b17a-2577ed695061 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:53.993484 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa473704-9f87-43da-984a-dfe38cde5989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:53.994173 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa473704-9f87-43da-984a-dfe38cde5989 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:53.994457 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa473704-9f87-43da-984a-dfe38cde5989 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:53.994742 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa473704-9f87-43da-984a-dfe38cde5989 admin admin] PATH_INFO: `/v3/projects/8a6e5b95c76b408490d244c960904cd9` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:53.996036 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa473704-9f87-43da-984a-dfe38cde5989 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a6e5b95c76b408490d244c960904cd9)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:53.998176 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa473704-9f87-43da-984a-dfe38cde5989 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:54.052774 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-fa473704-9f87-43da-984a-dfe38cde5989 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a6e5b95c76b408490d244c960904cd9', 'request_id': 'req-fa473704-9f87-43da-984a-dfe38cde5989'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:54.060369 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-fa473704-9f87-43da-984a-dfe38cde5989 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a6e5b95c76b408490d244c960904cd9', 'request_id': 'req-fa473704-9f87-43da-984a-dfe38cde5989'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:54.066396 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-fa473704-9f87-43da-984a-dfe38cde5989 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a6e5b95c76b408490d244c960904cd9', 'request_id': 'req-fa473704-9f87-43da-984a-dfe38cde5989'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:54.078320 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-fa473704-9f87-43da-984a-dfe38cde5989 admin admin] The token cache is being invalidate because project 8a6e5b95c76b408490d244c960904cd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:47:54.078611 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-fa473704-9f87-43da-984a-dfe38cde5989 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:54.079263 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-fa473704-9f87-43da-984a-dfe38cde5989 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:54.080807 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1355/2709] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Aug 2 21:47:53 2022] DELETE /identity/v3/projects/8a6e5b95c76b408490d244c960904cd9 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:47:54.086236 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bd946a-c012-4ab8-b487-7a813680bf42 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:54.086528 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bd946a-c012-4ab8-b487-7a813680bf42 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:54.086813 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bd946a-c012-4ab8-b487-7a813680bf42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:54.108738 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-49bd946a-c012-4ab8-b487-7a813680bf42 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:47:54.109963 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-49bd946a-c012-4ab8-b487-7a813680bf42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:54.170887 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1355/2710] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:47:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:47:54.180180 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e142a9-48a1-49a2-a337-9a41eba8b0b8 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:54.180621 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e142a9-48a1-49a2-a337-9a41eba8b0b8 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:54.180935 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e142a9-48a1-49a2-a337-9a41eba8b0b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:54.201891 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-77e142a9-48a1-49a2-a337-9a41eba8b0b8 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:47:54.203084 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-77e142a9-48a1-49a2-a337-9a41eba8b0b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:54.212867 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1356/2711] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:47:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:47:54.217191 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bd946a-c012-4ab8-b487-7a813680bf42 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:54.227809 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bd946a-c012-4ab8-b487-7a813680bf42 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:54.233010 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c4e559-02b5-47d6-8357-257139fe9bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:54.233616 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c4e559-02b5-47d6-8357-257139fe9bb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:54.233897 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c4e559-02b5-47d6-8357-257139fe9bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:54.234171 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c4e559-02b5-47d6-8357-257139fe9bb4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:54.234862 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c4e559-02b5-47d6-8357-257139fe9bb4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:47:54.235168 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c4e559-02b5-47d6-8357-257139fe9bb4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:54.237043 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c4e559-02b5-47d6-8357-257139fe9bb4 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:54.250333 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1356/2712] 10.222.0.70 () {58 vars in 1153 bytes} [Tue Aug 2 21:47:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:47:54.254736 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e142a9-48a1-49a2-a337-9a41eba8b0b8 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:54.264284 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e142a9-48a1-49a2-a337-9a41eba8b0b8 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:54.269117 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0da715-4e76-4e6f-a058-5d6a744dc0e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:54.270230 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0da715-4e76-4e6f-a058-5d6a744dc0e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:54.270531 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0da715-4e76-4e6f-a058-5d6a744dc0e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:54.270928 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0da715-4e76-4e6f-a058-5d6a744dc0e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:54.272499 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0da715-4e76-4e6f-a058-5d6a744dc0e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:54.274457 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0da715-4e76-4e6f-a058-5d6a744dc0e8 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:54.304283 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1357/2713] 10.222.0.70 () {60 vars in 1153 bytes} [Tue Aug 2 21:47:54 2022] POST /identity/v3/projects => generated 381 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:47:54.308489 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c4e559-02b5-47d6-8357-257139fe9bb4 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:54.319040 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c4e559-02b5-47d6-8357-257139fe9bb4 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:54.350055 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:54.378717 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484d54eb-1837-4283-8b79-febc1c8881e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:54.379556 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484d54eb-1837-4283-8b79-febc1c8881e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:54.379901 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484d54eb-1837-4283-8b79-febc1c8881e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:54.380190 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484d54eb-1837-4283-8b79-febc1c8881e4 admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:54.380912 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484d54eb-1837-4283-8b79-febc1c8881e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:54.382865 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484d54eb-1837-4283-8b79-febc1c8881e4 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:54.402590 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1357/2714] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 2 21:47:54 2022] POST /identity/v3/users => generated 291 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 21:47:54.406796 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0da715-4e76-4e6f-a058-5d6a744dc0e8 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:54.417839 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0da715-4e76-4e6f-a058-5d6a744dc0e8 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:54.422704 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7b8d3e-9b6b-4095-aae3-5de09dd9100b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:54.423258 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b8d3e-9b6b-4095-aae3-5de09dd9100b admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:54.423542 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b8d3e-9b6b-4095-aae3-5de09dd9100b admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:54.423825 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7b8d3e-9b6b-4095-aae3-5de09dd9100b admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:54.424595 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7b8d3e-9b6b-4095-aae3-5de09dd9100b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:54.426850 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7b8d3e-9b6b-4095-aae3-5de09dd9100b admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:54.437459 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1358/2715] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:47:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:47:54.441484 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484d54eb-1837-4283-8b79-febc1c8881e4 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:54.451781 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484d54eb-1837-4283-8b79-febc1c8881e4 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:54.456313 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f135fc79-1ed3-4aeb-971e-6fb222429548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:54.456921 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f135fc79-1ed3-4aeb-971e-6fb222429548 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:54.457201 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f135fc79-1ed3-4aeb-971e-6fb222429548 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:54.457494 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f135fc79-1ed3-4aeb-971e-6fb222429548 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:54.458179 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f135fc79-1ed3-4aeb-971e-6fb222429548 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:54.459756 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f135fc79-1ed3-4aeb-971e-6fb222429548 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:54.470470 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1358/2716] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:47:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:47:54.475136 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7b8d3e-9b6b-4095-aae3-5de09dd9100b admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:54.485378 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7b8d3e-9b6b-4095-aae3-5de09dd9100b admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:54.490691 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670f4de4-cb0e-4244-b123-b3b50268c908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:54.491339 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670f4de4-cb0e-4244-b123-b3b50268c908 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:54.491621 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670f4de4-cb0e-4244-b123-b3b50268c908 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:54.491892 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670f4de4-cb0e-4244-b123-b3b50268c908 admin admin] PATH_INFO: `/v3/projects/7b06120141434cbc8e1cf09f79d0602f/users/90925b7b46a8412683d7a68b5865abd5/roles/462e3381a85c42a9959201f9aa122f7c` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:54.506924 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670f4de4-cb0e-4244-b123-b3b50268c908 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b06120141434cbc8e1cf09f79d0602f, user_id=90925b7b46a8412683d7a68b5865abd5, role_id=462e3381a85c42a9959201f9aa122f7c)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:54.509618 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670f4de4-cb0e-4244-b123-b3b50268c908 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:54.523094 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1359/2717] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:47:54 2022] PUT /identity/v3/projects/7b06120141434cbc8e1cf09f79d0602f/users/90925b7b46a8412683d7a68b5865abd5/roles/462e3381a85c42a9959201f9aa122f7c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:47:54.533494 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44faef7d-2011-4a5d-a17c-5d5383fcf5f7 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:54.533790 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44faef7d-2011-4a5d-a17c-5d5383fcf5f7 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:54.534076 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44faef7d-2011-4a5d-a17c-5d5383fcf5f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:54.563339 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-44faef7d-2011-4a5d-a17c-5d5383fcf5f7 None None] MFA Rules not processed for user `90925b7b46a8412683d7a68b5865abd5`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:47:54.564748 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-44faef7d-2011-4a5d-a17c-5d5383fcf5f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:54.635189 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1359/2718] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:47:54 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:47:54.636335 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670f4de4-cb0e-4244-b123-b3b50268c908 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:54.654226 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:54.701082 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670f4de4-cb0e-4244-b123-b3b50268c908 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:54.705819 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8ff577-64e1-4d8a-90d1-0eb92c7db4c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:54.706430 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8ff577-64e1-4d8a-90d1-0eb92c7db4c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:54.706709 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8ff577-64e1-4d8a-90d1-0eb92c7db4c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:54.706981 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8ff577-64e1-4d8a-90d1-0eb92c7db4c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:54.708171 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8ff577-64e1-4d8a-90d1-0eb92c7db4c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:54.710114 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8ff577-64e1-4d8a-90d1-0eb92c7db4c3 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:54.738305 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1360/2719] 10.222.0.70 () {60 vars in 1153 bytes} [Tue Aug 2 21:47:54 2022] POST /identity/v3/projects => generated 381 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 21:47:54.742432 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44faef7d-2011-4a5d-a17c-5d5383fcf5f7 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:54.753104 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44faef7d-2011-4a5d-a17c-5d5383fcf5f7 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:54.819128 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655b94e2-9a3f-4125-9f92-9b2e8130e77c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:54.819829 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655b94e2-9a3f-4125-9f92-9b2e8130e77c admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:54.820332 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655b94e2-9a3f-4125-9f92-9b2e8130e77c admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:54.820567 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655b94e2-9a3f-4125-9f92-9b2e8130e77c admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:54.821252 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655b94e2-9a3f-4125-9f92-9b2e8130e77c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:54.823344 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655b94e2-9a3f-4125-9f92-9b2e8130e77c admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:54.851807 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1360/2720] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 2 21:47:54 2022] POST /identity/v3/users => generated 297 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:47:54.856493 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8ff577-64e1-4d8a-90d1-0eb92c7db4c3 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:54.868792 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8ff577-64e1-4d8a-90d1-0eb92c7db4c3 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:54.873814 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9d75b7-b899-4adf-932d-ad765f65cc5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:54.874529 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d75b7-b899-4adf-932d-ad765f65cc5b admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:54.874824 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d75b7-b899-4adf-932d-ad765f65cc5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:54.875104 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9d75b7-b899-4adf-932d-ad765f65cc5b admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:54.875814 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9d75b7-b899-4adf-932d-ad765f65cc5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:54.877552 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9d75b7-b899-4adf-932d-ad765f65cc5b admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:54.889241 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1361/2721] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:47:54 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 21:47:54.893760 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655b94e2-9a3f-4125-9f92-9b2e8130e77c admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:54.904782 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655b94e2-9a3f-4125-9f92-9b2e8130e77c admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:54.909573 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacad524-e616-4ed2-8ce2-c6a2fc4519b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:54.910265 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacad524-e616-4ed2-8ce2-c6a2fc4519b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:54.911113 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacad524-e616-4ed2-8ce2-c6a2fc4519b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:54.911396 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacad524-e616-4ed2-8ce2-c6a2fc4519b2 admin admin] PATH_INFO: `/v3/projects/7ff0afba16984acdbc664201f9b0944b/users/dd9a498ca9b1418cac4619c96af00144/roles/3e32dbf75f9b41f5adb9fe59851267bb` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:54.928408 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacad524-e616-4ed2-8ce2-c6a2fc4519b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ff0afba16984acdbc664201f9b0944b, user_id=dd9a498ca9b1418cac4619c96af00144, role_id=3e32dbf75f9b41f5adb9fe59851267bb)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:54.931156 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eacad524-e616-4ed2-8ce2-c6a2fc4519b2 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:54.946386 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1361/2722] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:47:54 2022] PUT /identity/v3/projects/7ff0afba16984acdbc664201f9b0944b/users/dd9a498ca9b1418cac4619c96af00144/roles/3e32dbf75f9b41f5adb9fe59851267bb => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:47:54.950162 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9d75b7-b899-4adf-932d-ad765f65cc5b admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:54.961302 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9d75b7-b899-4adf-932d-ad765f65cc5b admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:55.022239 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0f4ea3-534b-4f1e-966d-8e763765fc8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:55.022878 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f4ea3-534b-4f1e-966d-8e763765fc8e admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:55.023166 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f4ea3-534b-4f1e-966d-8e763765fc8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:55.023449 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f4ea3-534b-4f1e-966d-8e763765fc8e admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:55.024152 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0f4ea3-534b-4f1e-966d-8e763765fc8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:55.025850 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0f4ea3-534b-4f1e-966d-8e763765fc8e admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:55.037167 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1362/2723] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:47:54 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 21:47:55.041780 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacad524-e616-4ed2-8ce2-c6a2fc4519b2 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:55.052754 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacad524-e616-4ed2-8ce2-c6a2fc4519b2 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:55.057457 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04ef860-1834-4e19-a90b-5cb74e0aef30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:55.058184 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04ef860-1834-4e19-a90b-5cb74e0aef30 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:55.058467 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04ef860-1834-4e19-a90b-5cb74e0aef30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:55.058744 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04ef860-1834-4e19-a90b-5cb74e0aef30 admin admin] PATH_INFO: `/v3/projects/7ff0afba16984acdbc664201f9b0944b/users/dd9a498ca9b1418cac4619c96af00144/roles/3e32dbf75f9b41f5adb9fe59851267bb` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:55.060763 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04ef860-1834-4e19-a90b-5cb74e0aef30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ff0afba16984acdbc664201f9b0944b, user_id=dd9a498ca9b1418cac4619c96af00144, role_id=3e32dbf75f9b41f5adb9fe59851267bb)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:55.073583 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04ef860-1834-4e19-a90b-5cb74e0aef30 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:55.076141 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:55.092335 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1362/2724] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:47:55 2022] PUT /identity/v3/projects/7ff0afba16984acdbc664201f9b0944b/users/dd9a498ca9b1418cac4619c96af00144/roles/3e32dbf75f9b41f5adb9fe59851267bb => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:47:55.100791 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb5ab78-ef5d-4743-b61e-d03969164eb1 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:55.101152 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb5ab78-ef5d-4743-b61e-d03969164eb1 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:55.101363 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb5ab78-ef5d-4743-b61e-d03969164eb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:55.131767 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-dcb5ab78-ef5d-4743-b61e-d03969164eb1 None None] MFA Rules not processed for user `dd9a498ca9b1418cac4619c96af00144`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:47:55.133078 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-dcb5ab78-ef5d-4743-b61e-d03969164eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:55.214218 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1363/2725] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:47:55 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:47:55.226517 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04ef860-1834-4e19-a90b-5cb74e0aef30 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:55.228375 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-a04ef860-1834-4e19-a90b-5cb74e0aef30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:55.296563 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04ef860-1834-4e19-a90b-5cb74e0aef30 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:55.300759 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fed535-d8ae-4197-8ad2-f53e91d411b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '123eb76f95ee4e39905944da701c712d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:55.301432 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fed535-d8ae-4197-8ad2-f53e91d411b1 service cinder] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:55.301917 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fed535-d8ae-4197-8ad2-f53e91d411b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:55.302190 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fed535-d8ae-4197-8ad2-f53e91d411b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:55.312495 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fed535-d8ae-4197-8ad2-f53e91d411b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:55.314095 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fed535-d8ae-4197-8ad2-f53e91d411b1 service cinder] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:55.326661 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1363/2726] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:47:55 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:47:55.636730 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb5ab78-ef5d-4743-b61e-d03969164eb1 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:55.645892 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb5ab78-ef5d-4743-b61e-d03969164eb1 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:55.650481 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0bddb9-8990-4c7a-b0df-47605d599d5e tempest-VolumeQuotaClassesTest-1219550766 tempest-VolumeQuotaClassesTest-1219550766-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd9a498ca9b1418cac4619c96af00144', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ff0afba16984acdbc664201f9b0944b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:55.651104 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0bddb9-8990-4c7a-b0df-47605d599d5e tempest-VolumeQuotaClassesTest-1219550766 tempest-VolumeQuotaClassesTest-1219550766-project-admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:55.651385 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0bddb9-8990-4c7a-b0df-47605d599d5e tempest-VolumeQuotaClassesTest-1219550766 tempest-VolumeQuotaClassesTest-1219550766-project-admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:55.651666 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0bddb9-8990-4c7a-b0df-47605d599d5e tempest-VolumeQuotaClassesTest-1219550766 tempest-VolumeQuotaClassesTest-1219550766-project-admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:55.652401 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0bddb9-8990-4c7a-b0df-47605d599d5e tempest-VolumeQuotaClassesTest-1219550766 tempest-VolumeQuotaClassesTest-1219550766-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:47:55.652719 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0bddb9-8990-4c7a-b0df-47605d599d5e tempest-VolumeQuotaClassesTest-1219550766 tempest-VolumeQuotaClassesTest-1219550766-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:55.655136 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0bddb9-8990-4c7a-b0df-47605d599d5e tempest-VolumeQuotaClassesTest-1219550766 tempest-VolumeQuotaClassesTest-1219550766-project-admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:55.663445 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:55.672279 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1364/2727] 10.222.0.70 () {58 vars in 1153 bytes} [Tue Aug 2 21:47:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:47:55.673646 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fed535-d8ae-4197-8ad2-f53e91d411b1 service cinder] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:55.683305 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fed535-d8ae-4197-8ad2-f53e91d411b1 service cinder] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:55.688379 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cba98f7-2020-4e86-a9e8-cf8bd0015526 tempest-VolumeQuotaClassesTest-1219550766 tempest-VolumeQuotaClassesTest-1219550766-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd9a498ca9b1418cac4619c96af00144', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ff0afba16984acdbc664201f9b0944b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:55.688989 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cba98f7-2020-4e86-a9e8-cf8bd0015526 tempest-VolumeQuotaClassesTest-1219550766 tempest-VolumeQuotaClassesTest-1219550766-project-admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:55.689272 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cba98f7-2020-4e86-a9e8-cf8bd0015526 tempest-VolumeQuotaClassesTest-1219550766 tempest-VolumeQuotaClassesTest-1219550766-project-admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:55.689548 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cba98f7-2020-4e86-a9e8-cf8bd0015526 tempest-VolumeQuotaClassesTest-1219550766 tempest-VolumeQuotaClassesTest-1219550766-project-admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:55.690215 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cba98f7-2020-4e86-a9e8-cf8bd0015526 tempest-VolumeQuotaClassesTest-1219550766 tempest-VolumeQuotaClassesTest-1219550766-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:55.692866 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cba98f7-2020-4e86-a9e8-cf8bd0015526 tempest-VolumeQuotaClassesTest-1219550766 tempest-VolumeQuotaClassesTest-1219550766-project-admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:55.720633 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1364/2728] 10.222.0.70 () {60 vars in 1153 bytes} [Tue Aug 2 21:47:55 2022] POST /identity/v3/projects => generated 354 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:47:55.724721 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0bddb9-8990-4c7a-b0df-47605d599d5e tempest-VolumeQuotaClassesTest-1219550766 tempest-VolumeQuotaClassesTest-1219550766-project-admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:55.734949 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0bddb9-8990-4c7a-b0df-47605d599d5e tempest-VolumeQuotaClassesTest-1219550766 tempest-VolumeQuotaClassesTest-1219550766-project-admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:55.790038 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd2bbe3-08f2-4e90-8d07-5fcdf0b39318 tempest-VolumeQuotaClassesTest-1219550766 tempest-VolumeQuotaClassesTest-1219550766-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd9a498ca9b1418cac4619c96af00144', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ff0afba16984acdbc664201f9b0944b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:55.790652 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd2bbe3-08f2-4e90-8d07-5fcdf0b39318 tempest-VolumeQuotaClassesTest-1219550766 tempest-VolumeQuotaClassesTest-1219550766-project-admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:55.790935 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd2bbe3-08f2-4e90-8d07-5fcdf0b39318 tempest-VolumeQuotaClassesTest-1219550766 tempest-VolumeQuotaClassesTest-1219550766-project-admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:55.791216 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd2bbe3-08f2-4e90-8d07-5fcdf0b39318 tempest-VolumeQuotaClassesTest-1219550766 tempest-VolumeQuotaClassesTest-1219550766-project-admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:55.792029 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd2bbe3-08f2-4e90-8d07-5fcdf0b39318 tempest-VolumeQuotaClassesTest-1219550766 tempest-VolumeQuotaClassesTest-1219550766-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:47:55.792475 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd2bbe3-08f2-4e90-8d07-5fcdf0b39318 tempest-VolumeQuotaClassesTest-1219550766 tempest-VolumeQuotaClassesTest-1219550766-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:55.793969 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd2bbe3-08f2-4e90-8d07-5fcdf0b39318 tempest-VolumeQuotaClassesTest-1219550766 tempest-VolumeQuotaClassesTest-1219550766-project-admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:55.806404 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1365/2729] 10.222.0.70 () {58 vars in 1153 bytes} [Tue Aug 2 21:47:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:47:55.842397 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cba98f7-2020-4e86-a9e8-cf8bd0015526 tempest-VolumeQuotaClassesTest-1219550766 tempest-VolumeQuotaClassesTest-1219550766-project-admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:55.853791 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cba98f7-2020-4e86-a9e8-cf8bd0015526 tempest-VolumeQuotaClassesTest-1219550766 tempest-VolumeQuotaClassesTest-1219550766-project-admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:55.858650 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442c21fb-6a5d-4c96-bea6-2d57180b0a1f tempest-VolumeQuotaClassesTest-1219550766 tempest-VolumeQuotaClassesTest-1219550766-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dd9a498ca9b1418cac4619c96af00144', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7ff0afba16984acdbc664201f9b0944b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:55.859285 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442c21fb-6a5d-4c96-bea6-2d57180b0a1f tempest-VolumeQuotaClassesTest-1219550766 tempest-VolumeQuotaClassesTest-1219550766-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:55.859571 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442c21fb-6a5d-4c96-bea6-2d57180b0a1f tempest-VolumeQuotaClassesTest-1219550766 tempest-VolumeQuotaClassesTest-1219550766-project-admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:55.859846 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442c21fb-6a5d-4c96-bea6-2d57180b0a1f tempest-VolumeQuotaClassesTest-1219550766 tempest-VolumeQuotaClassesTest-1219550766-project-admin] PATH_INFO: `/v3/projects/6ff249bfe878490b8d3e2a3e5a3cd122` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:55.861027 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442c21fb-6a5d-4c96-bea6-2d57180b0a1f tempest-VolumeQuotaClassesTest-1219550766 tempest-VolumeQuotaClassesTest-1219550766-project-admin] RBAC: Authorizing `identity:delete_project(project_id=6ff249bfe878490b8d3e2a3e5a3cd122)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:55.862935 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442c21fb-6a5d-4c96-bea6-2d57180b0a1f tempest-VolumeQuotaClassesTest-1219550766 tempest-VolumeQuotaClassesTest-1219550766-project-admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:55.915253 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-442c21fb-6a5d-4c96-bea6-2d57180b0a1f tempest-VolumeQuotaClassesTest-1219550766 tempest-VolumeQuotaClassesTest-1219550766-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ff249bfe878490b8d3e2a3e5a3cd122', 'request_id': 'req-442c21fb-6a5d-4c96-bea6-2d57180b0a1f'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:55.921193 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-442c21fb-6a5d-4c96-bea6-2d57180b0a1f tempest-VolumeQuotaClassesTest-1219550766 tempest-VolumeQuotaClassesTest-1219550766-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ff249bfe878490b8d3e2a3e5a3cd122', 'request_id': 'req-442c21fb-6a5d-4c96-bea6-2d57180b0a1f'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:55.929645 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-442c21fb-6a5d-4c96-bea6-2d57180b0a1f tempest-VolumeQuotaClassesTest-1219550766 tempest-VolumeQuotaClassesTest-1219550766-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ff249bfe878490b8d3e2a3e5a3cd122', 'request_id': 'req-442c21fb-6a5d-4c96-bea6-2d57180b0a1f'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:55.941200 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-442c21fb-6a5d-4c96-bea6-2d57180b0a1f tempest-VolumeQuotaClassesTest-1219550766 tempest-VolumeQuotaClassesTest-1219550766-project-admin] The token cache is being invalidate because project 6ff249bfe878490b8d3e2a3e5a3cd122 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:47:55.941496 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-442c21fb-6a5d-4c96-bea6-2d57180b0a1f tempest-VolumeQuotaClassesTest-1219550766 tempest-VolumeQuotaClassesTest-1219550766-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:55.942184 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-442c21fb-6a5d-4c96-bea6-2d57180b0a1f tempest-VolumeQuotaClassesTest-1219550766 tempest-VolumeQuotaClassesTest-1219550766-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:55.943696 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1365/2730] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Aug 2 21:47:55 2022] DELETE /identity/v3/projects/6ff249bfe878490b8d3e2a3e5a3cd122 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:47:56.130762 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd2bbe3-08f2-4e90-8d07-5fcdf0b39318 tempest-VolumeQuotaClassesTest-1219550766 tempest-VolumeQuotaClassesTest-1219550766-project-admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:56.132604 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-ccd2bbe3-08f2-4e90-8d07-5fcdf0b39318 tempest-VolumeQuotaClassesTest-1219550766 tempest-VolumeQuotaClassesTest-1219550766-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:56.196916 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd2bbe3-08f2-4e90-8d07-5fcdf0b39318 tempest-VolumeQuotaClassesTest-1219550766 tempest-VolumeQuotaClassesTest-1219550766-project-admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:56.254838 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9befbaf-555a-45cc-9f01-3217bc8587d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:56.255479 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9befbaf-555a-45cc-9f01-3217bc8587d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:56.255765 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9befbaf-555a-45cc-9f01-3217bc8587d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:56.256044 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9befbaf-555a-45cc-9f01-3217bc8587d4 admin admin] PATH_INFO: `/v3/users/90925b7b46a8412683d7a68b5865abd5` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:56.257241 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9befbaf-555a-45cc-9f01-3217bc8587d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90925b7b46a8412683d7a68b5865abd5)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:56.259165 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9befbaf-555a-45cc-9f01-3217bc8587d4 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:56.309708 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:56.315923 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-b9befbaf-555a-45cc-9f01-3217bc8587d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90925b7b46a8412683d7a68b5865abd5'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:56.326523 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-b9befbaf-555a-45cc-9f01-3217bc8587d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90925b7b46a8412683d7a68b5865abd5'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:56.340036 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-b9befbaf-555a-45cc-9f01-3217bc8587d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90925b7b46a8412683d7a68b5865abd5'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:56.340903 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-b9befbaf-555a-45cc-9f01-3217bc8587d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90925b7b46a8412683d7a68b5865abd5'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:56.349711 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-b9befbaf-555a-45cc-9f01-3217bc8587d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90925b7b46a8412683d7a68b5865abd5'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:56.355901 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1366/2731] 10.222.0.70 () {58 vars in 1224 bytes} [Tue Aug 2 21:47:56 2022] DELETE /identity/v3/users/90925b7b46a8412683d7a68b5865abd5 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:47:56.360410 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331692cc-0524-4e28-9943-d6d8e2790c37 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:56.360938 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331692cc-0524-4e28-9943-d6d8e2790c37 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:56.360938 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331692cc-0524-4e28-9943-d6d8e2790c37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:56.380195 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-331692cc-0524-4e28-9943-d6d8e2790c37 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:47:56.381441 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-331692cc-0524-4e28-9943-d6d8e2790c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:56.434235 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:INSERT=3,keystone:SELECT=90,keystone:DELETE=7 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:56.444977 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1366/2732] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:47:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:47:56.454545 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9befbaf-555a-45cc-9f01-3217bc8587d4 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:56.455931 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-b9befbaf-555a-45cc-9f01-3217bc8587d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:56.513453 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9befbaf-555a-45cc-9f01-3217bc8587d4 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:56.517117 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227d5f34-85ba-412e-8089-2a0d712828fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '723f5f43572a493dae0349070a2adb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:56.517728 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227d5f34-85ba-412e-8089-2a0d712828fe service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:56.518009 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227d5f34-85ba-412e-8089-2a0d712828fe service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:56.518286 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227d5f34-85ba-412e-8089-2a0d712828fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:56.527690 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227d5f34-85ba-412e-8089-2a0d712828fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:56.529169 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227d5f34-85ba-412e-8089-2a0d712828fe service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:56.539061 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1367/2733] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:47:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:47:56.797040 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331692cc-0524-4e28-9943-d6d8e2790c37 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:56.798497 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-331692cc-0524-4e28-9943-d6d8e2790c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:56.812882 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331692cc-0524-4e28-9943-d6d8e2790c37 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:56.817901 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31228c85-0777-4c10-8fb5-14061841f68f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:56.818552 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31228c85-0777-4c10-8fb5-14061841f68f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:56.818945 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31228c85-0777-4c10-8fb5-14061841f68f admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:56.819089 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31228c85-0777-4c10-8fb5-14061841f68f admin admin] PATH_INFO: `/v3/projects/7b06120141434cbc8e1cf09f79d0602f` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:56.820923 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31228c85-0777-4c10-8fb5-14061841f68f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b06120141434cbc8e1cf09f79d0602f)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:56.823167 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31228c85-0777-4c10-8fb5-14061841f68f admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:56.869702 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-31228c85-0777-4c10-8fb5-14061841f68f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b06120141434cbc8e1cf09f79d0602f', 'request_id': 'req-31228c85-0777-4c10-8fb5-14061841f68f'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:56.875111 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-31228c85-0777-4c10-8fb5-14061841f68f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b06120141434cbc8e1cf09f79d0602f', 'request_id': 'req-31228c85-0777-4c10-8fb5-14061841f68f'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:56.882407 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-31228c85-0777-4c10-8fb5-14061841f68f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b06120141434cbc8e1cf09f79d0602f', 'request_id': 'req-31228c85-0777-4c10-8fb5-14061841f68f'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:56.893990 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-31228c85-0777-4c10-8fb5-14061841f68f admin admin] The token cache is being invalidate because project 7b06120141434cbc8e1cf09f79d0602f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:47:56.894283 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-31228c85-0777-4c10-8fb5-14061841f68f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:56.894916 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-31228c85-0777-4c10-8fb5-14061841f68f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:56.896447 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1367/2734] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Aug 2 21:47:56 2022] DELETE /identity/v3/projects/7b06120141434cbc8e1cf09f79d0602f => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:47:56.900530 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227d5f34-85ba-412e-8089-2a0d712828fe service neutron] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:56.910207 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227d5f34-85ba-412e-8089-2a0d712828fe service neutron] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:56.973495 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb262ba5-13d5-480e-bddc-499e39046894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:56.974280 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb262ba5-13d5-480e-bddc-499e39046894 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:56.974741 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb262ba5-13d5-480e-bddc-499e39046894 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:56.975354 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb262ba5-13d5-480e-bddc-499e39046894 admin admin] PATH_INFO: `/v3/users/dd9a498ca9b1418cac4619c96af00144` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:56.976482 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb262ba5-13d5-480e-bddc-499e39046894 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd9a498ca9b1418cac4619c96af00144)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:56.979027 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb262ba5-13d5-480e-bddc-499e39046894 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:57.029442 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-fb262ba5-13d5-480e-bddc-499e39046894 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd9a498ca9b1418cac4619c96af00144'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:57.037849 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-fb262ba5-13d5-480e-bddc-499e39046894 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd9a498ca9b1418cac4619c96af00144'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:57.047240 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:57.053215 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-fb262ba5-13d5-480e-bddc-499e39046894 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd9a498ca9b1418cac4619c96af00144'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:57.054233 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-fb262ba5-13d5-480e-bddc-499e39046894 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd9a498ca9b1418cac4619c96af00144'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:57.062973 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-fb262ba5-13d5-480e-bddc-499e39046894 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd9a498ca9b1418cac4619c96af00144'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:57.069154 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1368/2735] 10.222.0.70 () {58 vars in 1224 bytes} [Tue Aug 2 21:47:56 2022] DELETE /identity/v3/users/dd9a498ca9b1418cac4619c96af00144 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:47:57.353041 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31228c85-0777-4c10-8fb5-14061841f68f admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:57.354312 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-31228c85-0777-4c10-8fb5-14061841f68f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:57.367680 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31228c85-0777-4c10-8fb5-14061841f68f admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:57.435694 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fd62fb-5ba7-46fd-9302-0e6c014ae3c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:57.436528 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd62fb-5ba7-46fd-9302-0e6c014ae3c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:57.436528 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd62fb-5ba7-46fd-9302-0e6c014ae3c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:57.436818 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fd62fb-5ba7-46fd-9302-0e6c014ae3c0 admin admin] PATH_INFO: `/v3/projects/7ff0afba16984acdbc664201f9b0944b` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:57.438018 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fd62fb-5ba7-46fd-9302-0e6c014ae3c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ff0afba16984acdbc664201f9b0944b)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:57.439927 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fd62fb-5ba7-46fd-9302-0e6c014ae3c0 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:57.491391 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-d9fd62fb-5ba7-46fd-9302-0e6c014ae3c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ff0afba16984acdbc664201f9b0944b', 'request_id': 'req-d9fd62fb-5ba7-46fd-9302-0e6c014ae3c0'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:57.498054 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-d9fd62fb-5ba7-46fd-9302-0e6c014ae3c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ff0afba16984acdbc664201f9b0944b', 'request_id': 'req-d9fd62fb-5ba7-46fd-9302-0e6c014ae3c0'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:57.506175 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-d9fd62fb-5ba7-46fd-9302-0e6c014ae3c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ff0afba16984acdbc664201f9b0944b', 'request_id': 'req-d9fd62fb-5ba7-46fd-9302-0e6c014ae3c0'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:57.520690 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-d9fd62fb-5ba7-46fd-9302-0e6c014ae3c0 admin admin] The token cache is being invalidate because project 7ff0afba16984acdbc664201f9b0944b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:47:57.521534 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-d9fd62fb-5ba7-46fd-9302-0e6c014ae3c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:57.521662 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-d9fd62fb-5ba7-46fd-9302-0e6c014ae3c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:47:57.524186 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1368/2736] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Aug 2 21:47:57 2022] DELETE /identity/v3/projects/7ff0afba16984acdbc664201f9b0944b => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:47:57.528491 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef59439-d151-47d5-a8cd-0c864f9d0ed0 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:57.528974 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef59439-d151-47d5-a8cd-0c864f9d0ed0 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:57.529203 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef59439-d151-47d5-a8cd-0c864f9d0ed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:57.550040 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-aef59439-d151-47d5-a8cd-0c864f9d0ed0 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:47:57.551300 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-aef59439-d151-47d5-a8cd-0c864f9d0ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:57.620865 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1369/2737] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:47:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:47:57.629649 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a885ea-68bf-4836-b60d-fdf33d4af2b8 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:57.629941 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a885ea-68bf-4836-b60d-fdf33d4af2b8 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:57.630221 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a885ea-68bf-4836-b60d-fdf33d4af2b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:57.651811 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-30a885ea-68bf-4836-b60d-fdf33d4af2b8 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:47:57.653124 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-30a885ea-68bf-4836-b60d-fdf33d4af2b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:57.663666 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1369/2738] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:47:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:47:57.668039 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef59439-d151-47d5-a8cd-0c864f9d0ed0 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:57.678641 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef59439-d151-47d5-a8cd-0c864f9d0ed0 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:57.683484 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f1d2e5-2b12-4867-8ff0-74554764554a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:57.684095 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f1d2e5-2b12-4867-8ff0-74554764554a admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:57.684460 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f1d2e5-2b12-4867-8ff0-74554764554a admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:57.684740 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f1d2e5-2b12-4867-8ff0-74554764554a admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:57.685442 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f1d2e5-2b12-4867-8ff0-74554764554a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:47:57.686000 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f1d2e5-2b12-4867-8ff0-74554764554a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:57.687529 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f1d2e5-2b12-4867-8ff0-74554764554a admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:57.700623 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1370/2739] 10.222.0.70 () {58 vars in 1153 bytes} [Tue Aug 2 21:47:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:47:57.705344 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a885ea-68bf-4836-b60d-fdf33d4af2b8 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:57.711716 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:57.715652 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a885ea-68bf-4836-b60d-fdf33d4af2b8 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:57.722275 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572a956b-0637-4e95-b56c-c75110e26d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:57.723114 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a956b-0637-4e95-b56c-c75110e26d1c admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:57.723573 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a956b-0637-4e95-b56c-c75110e26d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:57.723853 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572a956b-0637-4e95-b56c-c75110e26d1c admin admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:57.724557 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572a956b-0637-4e95-b56c-c75110e26d1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:57.726491 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572a956b-0637-4e95-b56c-c75110e26d1c admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:57.755618 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1370/2740] 10.222.0.70 () {60 vars in 1153 bytes} [Tue Aug 2 21:47:57 2022] POST /identity/v3/projects => generated 393 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 21:47:57.760270 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f1d2e5-2b12-4867-8ff0-74554764554a admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:57.770200 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f1d2e5-2b12-4867-8ff0-74554764554a admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:57.828091 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f414fe-c4b8-4d45-9873-2a5a9742fd3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:57.828741 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f414fe-c4b8-4d45-9873-2a5a9742fd3f admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:57.829029 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f414fe-c4b8-4d45-9873-2a5a9742fd3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:57.829310 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f414fe-c4b8-4d45-9873-2a5a9742fd3f admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:57.830010 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f414fe-c4b8-4d45-9873-2a5a9742fd3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:57.831944 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f414fe-c4b8-4d45-9873-2a5a9742fd3f admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:57.852395 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1371/2741] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 2 21:47:57 2022] POST /identity/v3/users => generated 297 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:47:57.856930 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572a956b-0637-4e95-b56c-c75110e26d1c admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:57.867885 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572a956b-0637-4e95-b56c-c75110e26d1c admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:57.872482 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca623ebb-9ca2-42af-a7a6-5eb1834af88a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:57.873095 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca623ebb-9ca2-42af-a7a6-5eb1834af88a admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:57.873379 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca623ebb-9ca2-42af-a7a6-5eb1834af88a admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:57.873656 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca623ebb-9ca2-42af-a7a6-5eb1834af88a admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:57.874354 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca623ebb-9ca2-42af-a7a6-5eb1834af88a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:57.875953 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca623ebb-9ca2-42af-a7a6-5eb1834af88a admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:57.886480 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1371/2742] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:47:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:47:57.890303 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f414fe-c4b8-4d45-9873-2a5a9742fd3f admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:57.900630 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f414fe-c4b8-4d45-9873-2a5a9742fd3f admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:57.905277 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2116151-243d-4eab-b3fc-50cd451b561a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:57.905882 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2116151-243d-4eab-b3fc-50cd451b561a admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:57.906168 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2116151-243d-4eab-b3fc-50cd451b561a admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:57.906449 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2116151-243d-4eab-b3fc-50cd451b561a admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:57.907143 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2116151-243d-4eab-b3fc-50cd451b561a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:57.908770 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2116151-243d-4eab-b3fc-50cd451b561a admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:57.919294 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1372/2743] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:47:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:47:57.923315 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca623ebb-9ca2-42af-a7a6-5eb1834af88a admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:57.933775 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca623ebb-9ca2-42af-a7a6-5eb1834af88a admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:57.938417 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ed780d-e033-4bfc-b846-d261eeeb4eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:57.939010 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed780d-e033-4bfc-b846-d261eeeb4eb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:57.939294 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed780d-e033-4bfc-b846-d261eeeb4eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:57.939571 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed780d-e033-4bfc-b846-d261eeeb4eb8 admin admin] PATH_INFO: `/v3/projects/f520f70a287c4b2d9a770c6fb0409465/users/bf1fb7d970cc4e79b47131e43d4beab9/roles/462e3381a85c42a9959201f9aa122f7c` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:57.954466 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ed780d-e033-4bfc-b846-d261eeeb4eb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f520f70a287c4b2d9a770c6fb0409465, user_id=bf1fb7d970cc4e79b47131e43d4beab9, role_id=462e3381a85c42a9959201f9aa122f7c)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:57.957206 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ed780d-e033-4bfc-b846-d261eeeb4eb8 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:57.971480 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1372/2744] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:47:57 2022] PUT /identity/v3/projects/f520f70a287c4b2d9a770c6fb0409465/users/bf1fb7d970cc4e79b47131e43d4beab9/roles/462e3381a85c42a9959201f9aa122f7c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:47:57.982043 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b359c6-24e5-4289-8115-588c69b0ab97 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:57.982336 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b359c6-24e5-4289-8115-588c69b0ab97 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:57.982619 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b359c6-24e5-4289-8115-588c69b0ab97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:58.029415 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-c8b359c6-24e5-4289-8115-588c69b0ab97 None None] MFA Rules not processed for user `bf1fb7d970cc4e79b47131e43d4beab9`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:47:58.030679 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-c8b359c6-24e5-4289-8115-588c69b0ab97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:58.071489 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:58.105483 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1373/2745] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:47:57 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:47:58.109957 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ed780d-e033-4bfc-b846-d261eeeb4eb8 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:58.173954 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ed780d-e033-4bfc-b846-d261eeeb4eb8 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:58.179782 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eb44bd-9d40-46f0-bf84-a4f124144e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:58.180480 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eb44bd-9d40-46f0-bf84-a4f124144e56 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:58.180808 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eb44bd-9d40-46f0-bf84-a4f124144e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:58.181269 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eb44bd-9d40-46f0-bf84-a4f124144e56 admin admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:58.182744 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4eb44bd-9d40-46f0-bf84-a4f124144e56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:58.185278 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4eb44bd-9d40-46f0-bf84-a4f124144e56 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:58.214028 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1373/2746] 10.222.0.70 () {60 vars in 1153 bytes} [Tue Aug 2 21:47:58 2022] POST /identity/v3/projects => generated 393 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:47:58.218090 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b359c6-24e5-4289-8115-588c69b0ab97 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:58.229965 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b359c6-24e5-4289-8115-588c69b0ab97 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:58.315250 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c66363-3c98-4783-abc4-c6b532ba837f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:58.315879 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c66363-3c98-4783-abc4-c6b532ba837f admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:58.316165 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c66363-3c98-4783-abc4-c6b532ba837f admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:58.316471 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c66363-3c98-4783-abc4-c6b532ba837f admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:58.317139 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c66363-3c98-4783-abc4-c6b532ba837f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:58.319069 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c66363-3c98-4783-abc4-c6b532ba837f admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:58.345977 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1374/2747] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 2 21:47:58 2022] POST /identity/v3/users => generated 303 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 21:47:58.350639 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eb44bd-9d40-46f0-bf84-a4f124144e56 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:58.362928 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eb44bd-9d40-46f0-bf84-a4f124144e56 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:58.368435 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729aabcd-42dd-4c16-a4b0-15d964ed9440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:58.369208 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729aabcd-42dd-4c16-a4b0-15d964ed9440 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:58.369500 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729aabcd-42dd-4c16-a4b0-15d964ed9440 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:58.369780 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729aabcd-42dd-4c16-a4b0-15d964ed9440 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:58.370481 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729aabcd-42dd-4c16-a4b0-15d964ed9440 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:58.372103 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729aabcd-42dd-4c16-a4b0-15d964ed9440 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:58.384093 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1374/2748] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:47:58 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:47:58.388399 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c66363-3c98-4783-abc4-c6b532ba837f admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:58.399360 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c66363-3c98-4783-abc4-c6b532ba837f admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:58.403983 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de0e335-3b2e-4d41-af07-08c42e2e8c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:58.404728 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de0e335-3b2e-4d41-af07-08c42e2e8c8d admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:58.405014 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de0e335-3b2e-4d41-af07-08c42e2e8c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:58.405296 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de0e335-3b2e-4d41-af07-08c42e2e8c8d admin admin] PATH_INFO: `/v3/projects/2053c1e09dbc4d418145c1b18ac07991/users/26ab560e561b481fa1814c7190dc445d/roles/3e32dbf75f9b41f5adb9fe59851267bb` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:58.421507 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de0e335-3b2e-4d41-af07-08c42e2e8c8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2053c1e09dbc4d418145c1b18ac07991, user_id=26ab560e561b481fa1814c7190dc445d, role_id=3e32dbf75f9b41f5adb9fe59851267bb)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:58.424219 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de0e335-3b2e-4d41-af07-08c42e2e8c8d admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:58.437513 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1375/2749] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:47:58 2022] PUT /identity/v3/projects/2053c1e09dbc4d418145c1b18ac07991/users/26ab560e561b481fa1814c7190dc445d/roles/3e32dbf75f9b41f5adb9fe59851267bb => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:47:58.441701 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729aabcd-42dd-4c16-a4b0-15d964ed9440 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:58.451717 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729aabcd-42dd-4c16-a4b0-15d964ed9440 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:58.507740 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1958ab45-8c50-49d3-8d17-9b83b2820428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:58.508493 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1958ab45-8c50-49d3-8d17-9b83b2820428 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:58.508777 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1958ab45-8c50-49d3-8d17-9b83b2820428 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:58.509078 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1958ab45-8c50-49d3-8d17-9b83b2820428 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:58.509779 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1958ab45-8c50-49d3-8d17-9b83b2820428 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:58.511349 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1958ab45-8c50-49d3-8d17-9b83b2820428 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:58.521619 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1375/2750] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:47:58 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:47:58.525925 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de0e335-3b2e-4d41-af07-08c42e2e8c8d admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:58.536761 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de0e335-3b2e-4d41-af07-08c42e2e8c8d admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:58.541343 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af95a8c0-16f9-472d-93c0-8238bde03134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:58.542008 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af95a8c0-16f9-472d-93c0-8238bde03134 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:58.542291 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af95a8c0-16f9-472d-93c0-8238bde03134 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:58.542571 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af95a8c0-16f9-472d-93c0-8238bde03134 admin admin] PATH_INFO: `/v3/projects/2053c1e09dbc4d418145c1b18ac07991/users/26ab560e561b481fa1814c7190dc445d/roles/3e32dbf75f9b41f5adb9fe59851267bb` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:58.544532 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af95a8c0-16f9-472d-93c0-8238bde03134 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2053c1e09dbc4d418145c1b18ac07991, user_id=26ab560e561b481fa1814c7190dc445d, role_id=3e32dbf75f9b41f5adb9fe59851267bb)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:58.547179 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af95a8c0-16f9-472d-93c0-8238bde03134 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:58.557369 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1376/2751] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:47:58 2022] PUT /identity/v3/projects/2053c1e09dbc4d418145c1b18ac07991/users/26ab560e561b481fa1814c7190dc445d/roles/3e32dbf75f9b41f5adb9fe59851267bb => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:47:58.625455 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6c0050-e42a-4a61-b9a5-2f98753b2247 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:58.625750 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6c0050-e42a-4a61-b9a5-2f98753b2247 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:58.626037 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6c0050-e42a-4a61-b9a5-2f98753b2247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:58.654936 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-fe6c0050-e42a-4a61-b9a5-2f98753b2247 None None] MFA Rules not processed for user `26ab560e561b481fa1814c7190dc445d`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:47:58.656174 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-fe6c0050-e42a-4a61-b9a5-2f98753b2247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:58.662215 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:47:58.727106 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1376/2752] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:47:58 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:47:58.739082 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af95a8c0-16f9-472d-93c0-8238bde03134 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:58.740799 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-af95a8c0-16f9-472d-93c0-8238bde03134 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:58.800703 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af95a8c0-16f9-472d-93c0-8238bde03134 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:58.804397 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08ec6c8-b72c-4680-b7b5-41a2f6959613 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '123eb76f95ee4e39905944da701c712d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:58.805016 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08ec6c8-b72c-4680-b7b5-41a2f6959613 service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:58.805302 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08ec6c8-b72c-4680-b7b5-41a2f6959613 service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:58.805581 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08ec6c8-b72c-4680-b7b5-41a2f6959613 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:58.814485 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08ec6c8-b72c-4680-b7b5-41a2f6959613 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:58.815928 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08ec6c8-b72c-4680-b7b5-41a2f6959613 service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:58.826703 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1377/2753] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:47:58 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:47:58.872645 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6c0050-e42a-4a61-b9a5-2f98753b2247 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:47:58.874030 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-fe6c0050-e42a-4a61-b9a5-2f98753b2247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:47:58.886462 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6c0050-e42a-4a61-b9a5-2f98753b2247 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:47:58.890059 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc63c52-d598-470f-ad30-f87a0af02b73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '123eb76f95ee4e39905944da701c712d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:47:58.890668 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc63c52-d598-470f-ad30-f87a0af02b73 service cinder] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:47:58.890950 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc63c52-d598-470f-ad30-f87a0af02b73 service cinder] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:47:58.891225 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc63c52-d598-470f-ad30-f87a0af02b73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:47:58.949407 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc63c52-d598-470f-ad30-f87a0af02b73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:47:58.950914 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc63c52-d598-470f-ad30-f87a0af02b73 service cinder] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:47:58.960599 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1377/2754] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:47:58 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:48:02.353059 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08ec6c8-b72c-4680-b7b5-41a2f6959613 service cinder] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:48:02.387812 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:48:02.418874 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08ec6c8-b72c-4680-b7b5-41a2f6959613 service cinder] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:48:02.423527 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a3795e-78b0-4870-a272-0597432e6c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:48:02.424184 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a3795e-78b0-4870-a272-0597432e6c7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:02.424497 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a3795e-78b0-4870-a272-0597432e6c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:02.424777 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a3795e-78b0-4870-a272-0597432e6c7f admin admin] PATH_INFO: `/v3/users/bf1fb7d970cc4e79b47131e43d4beab9` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:02.426530 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a3795e-78b0-4870-a272-0597432e6c7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf1fb7d970cc4e79b47131e43d4beab9)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:48:02.428590 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a3795e-78b0-4870-a272-0597432e6c7f admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:48:02.483026 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-c9a3795e-78b0-4870-a272-0597432e6c7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf1fb7d970cc4e79b47131e43d4beab9'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:48:02.493417 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-c9a3795e-78b0-4870-a272-0597432e6c7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf1fb7d970cc4e79b47131e43d4beab9'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:48:02.511405 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-c9a3795e-78b0-4870-a272-0597432e6c7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf1fb7d970cc4e79b47131e43d4beab9'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:48:02.512692 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-c9a3795e-78b0-4870-a272-0597432e6c7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf1fb7d970cc4e79b47131e43d4beab9'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:48:02.521752 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-c9a3795e-78b0-4870-a272-0597432e6c7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf1fb7d970cc4e79b47131e43d4beab9'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:48:02.528698 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1378/2755] 10.222.0.70 () {58 vars in 1224 bytes} [Tue Aug 2 21:48:02 2022] DELETE /identity/v3/users/bf1fb7d970cc4e79b47131e43d4beab9 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:48:02.533327 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd90faca-cf7c-45a0-834b-017f3bfe2e30 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:02.533858 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd90faca-cf7c-45a0-834b-017f3bfe2e30 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:02.533990 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd90faca-cf7c-45a0-834b-017f3bfe2e30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:02.555994 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-bd90faca-cf7c-45a0-834b-017f3bfe2e30 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:48:02.557287 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-bd90faca-cf7c-45a0-834b-017f3bfe2e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:48:02.623580 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1378/2756] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:48:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:48:02.634858 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a3795e-78b0-4870-a272-0597432e6c7f admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:48:02.636550 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-c9a3795e-78b0-4870-a272-0597432e6c7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:48:02.695485 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a3795e-78b0-4870-a272-0597432e6c7f admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:48:02.699480 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8d19d7-b7e8-434e-8eb7-aeb5cf3228d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '723f5f43572a493dae0349070a2adb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:48:02.700157 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8d19d7-b7e8-434e-8eb7-aeb5cf3228d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:02.700543 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8d19d7-b7e8-434e-8eb7-aeb5cf3228d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:02.700860 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8d19d7-b7e8-434e-8eb7-aeb5cf3228d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:02.710503 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8d19d7-b7e8-434e-8eb7-aeb5cf3228d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:48:02.712065 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8d19d7-b7e8-434e-8eb7-aeb5cf3228d3 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:48:02.721897 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1379/2757] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:48:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:48:02.985774 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd90faca-cf7c-45a0-834b-017f3bfe2e30 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:48:02.987535 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-bd90faca-cf7c-45a0-834b-017f3bfe2e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:48:03.000986 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd90faca-cf7c-45a0-834b-017f3bfe2e30 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:48:03.005680 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86467fdc-1938-4b88-a447-f18c2a3c9134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:48:03.006430 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86467fdc-1938-4b88-a447-f18c2a3c9134 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:03.006783 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86467fdc-1938-4b88-a447-f18c2a3c9134 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:03.007128 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86467fdc-1938-4b88-a447-f18c2a3c9134 admin admin] PATH_INFO: `/v3/projects/f520f70a287c4b2d9a770c6fb0409465` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:03.008849 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86467fdc-1938-4b88-a447-f18c2a3c9134 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f520f70a287c4b2d9a770c6fb0409465)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:48:03.010813 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86467fdc-1938-4b88-a447-f18c2a3c9134 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:48:03.051156 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:48:03.061156 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-86467fdc-1938-4b88-a447-f18c2a3c9134 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f520f70a287c4b2d9a770c6fb0409465', 'request_id': 'req-86467fdc-1938-4b88-a447-f18c2a3c9134'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:48:03.066609 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-86467fdc-1938-4b88-a447-f18c2a3c9134 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f520f70a287c4b2d9a770c6fb0409465', 'request_id': 'req-86467fdc-1938-4b88-a447-f18c2a3c9134'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:48:03.073991 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-86467fdc-1938-4b88-a447-f18c2a3c9134 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f520f70a287c4b2d9a770c6fb0409465', 'request_id': 'req-86467fdc-1938-4b88-a447-f18c2a3c9134'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:48:03.085448 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-86467fdc-1938-4b88-a447-f18c2a3c9134 admin admin] The token cache is being invalidate because project f520f70a287c4b2d9a770c6fb0409465 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:48:03.085739 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-86467fdc-1938-4b88-a447-f18c2a3c9134 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:48:03.086359 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-86467fdc-1938-4b88-a447-f18c2a3c9134 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:48:03.087856 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1379/2758] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Aug 2 21:48:02 2022] DELETE /identity/v3/projects/f520f70a287c4b2d9a770c6fb0409465 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:48:03.091843 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8d19d7-b7e8-434e-8eb7-aeb5cf3228d3 service neutron] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:48:03.101956 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8d19d7-b7e8-434e-8eb7-aeb5cf3228d3 service neutron] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:48:03.150070 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:48:03.161521 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0a7787-79f6-401f-aaf6-fcd2587e822a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:48:03.162101 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a7787-79f6-401f-aaf6-fcd2587e822a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:03.162386 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a7787-79f6-401f-aaf6-fcd2587e822a admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:03.162663 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a7787-79f6-401f-aaf6-fcd2587e822a admin admin] PATH_INFO: `/v3/users/26ab560e561b481fa1814c7190dc445d` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:03.163882 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0a7787-79f6-401f-aaf6-fcd2587e822a admin admin] RBAC: Authorizing `identity:delete_user(user_id=26ab560e561b481fa1814c7190dc445d)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:48:03.165815 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0a7787-79f6-401f-aaf6-fcd2587e822a admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:48:03.215179 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-4a0a7787-79f6-401f-aaf6-fcd2587e822a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26ab560e561b481fa1814c7190dc445d'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:48:03.223504 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-4a0a7787-79f6-401f-aaf6-fcd2587e822a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26ab560e561b481fa1814c7190dc445d'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:48:03.236537 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-4a0a7787-79f6-401f-aaf6-fcd2587e822a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26ab560e561b481fa1814c7190dc445d'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:48:03.237217 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-4a0a7787-79f6-401f-aaf6-fcd2587e822a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26ab560e561b481fa1814c7190dc445d'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:48:03.244766 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-4a0a7787-79f6-401f-aaf6-fcd2587e822a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26ab560e561b481fa1814c7190dc445d'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:48:03.250712 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1380/2759] 10.222.0.70 () {58 vars in 1224 bytes} [Tue Aug 2 21:48:03 2022] DELETE /identity/v3/users/26ab560e561b481fa1814c7190dc445d => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:48:03.544071 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86467fdc-1938-4b88-a447-f18c2a3c9134 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:48:03.546271 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-86467fdc-1938-4b88-a447-f18c2a3c9134 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:48:03.567882 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86467fdc-1938-4b88-a447-f18c2a3c9134 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:48:03.626783 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e132e27-d5c3-4f22-8921-2eb5f4275f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:48:03.627546 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e132e27-d5c3-4f22-8921-2eb5f4275f6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:03.627861 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e132e27-d5c3-4f22-8921-2eb5f4275f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:03.628150 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e132e27-d5c3-4f22-8921-2eb5f4275f6d admin admin] PATH_INFO: `/v3/projects/2053c1e09dbc4d418145c1b18ac07991` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:03.630083 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e132e27-d5c3-4f22-8921-2eb5f4275f6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2053c1e09dbc4d418145c1b18ac07991)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:48:03.632319 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e132e27-d5c3-4f22-8921-2eb5f4275f6d admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:48:03.679863 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-4e132e27-d5c3-4f22-8921-2eb5f4275f6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2053c1e09dbc4d418145c1b18ac07991', 'request_id': 'req-4e132e27-d5c3-4f22-8921-2eb5f4275f6d'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:48:03.685427 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-4e132e27-d5c3-4f22-8921-2eb5f4275f6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2053c1e09dbc4d418145c1b18ac07991', 'request_id': 'req-4e132e27-d5c3-4f22-8921-2eb5f4275f6d'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:48:03.693144 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-4e132e27-d5c3-4f22-8921-2eb5f4275f6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2053c1e09dbc4d418145c1b18ac07991', 'request_id': 'req-4e132e27-d5c3-4f22-8921-2eb5f4275f6d'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:48:03.704350 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-4e132e27-d5c3-4f22-8921-2eb5f4275f6d admin admin] The token cache is being invalidate because project 2053c1e09dbc4d418145c1b18ac07991 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:48:03.704643 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-4e132e27-d5c3-4f22-8921-2eb5f4275f6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:48:03.705267 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-4e132e27-d5c3-4f22-8921-2eb5f4275f6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:48:03.706760 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1380/2760] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Aug 2 21:48:03 2022] DELETE /identity/v3/projects/2053c1e09dbc4d418145c1b18ac07991 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:48:03.713188 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d305cf-fa8f-4f5e-93e8-a67b8fd00b3f None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:03.713651 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d305cf-fa8f-4f5e-93e8-a67b8fd00b3f None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:03.713765 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d305cf-fa8f-4f5e-93e8-a67b8fd00b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:03.733239 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-a4d305cf-fa8f-4f5e-93e8-a67b8fd00b3f None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:48:03.734441 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-a4d305cf-fa8f-4f5e-93e8-a67b8fd00b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:48:03.793160 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1381/2761] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:48:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:48:03.801575 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ddc3ce-3291-47fd-8a60-8332773796d1 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:03.801868 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ddc3ce-3291-47fd-8a60-8332773796d1 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:03.802146 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ddc3ce-3291-47fd-8a60-8332773796d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:03.824775 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-b3ddc3ce-3291-47fd-8a60-8332773796d1 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:48:03.826007 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-b3ddc3ce-3291-47fd-8a60-8332773796d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:48:03.834111 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1381/2762] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:48:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:48:03.838400 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d305cf-fa8f-4f5e-93e8-a67b8fd00b3f None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:48:03.848046 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d305cf-fa8f-4f5e-93e8-a67b8fd00b3f None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:48:03.852606 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed187a8c-b7af-442a-9455-2354a165cca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:48:03.853215 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed187a8c-b7af-442a-9455-2354a165cca0 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:03.853498 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed187a8c-b7af-442a-9455-2354a165cca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:03.853778 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed187a8c-b7af-442a-9455-2354a165cca0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:03.854475 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed187a8c-b7af-442a-9455-2354a165cca0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:48:03.855050 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed187a8c-b7af-442a-9455-2354a165cca0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:48:03.856694 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed187a8c-b7af-442a-9455-2354a165cca0 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:48:03.873631 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1382/2763] 10.222.0.70 () {58 vars in 1153 bytes} [Tue Aug 2 21:48:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:48:03.874745 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ddc3ce-3291-47fd-8a60-8332773796d1 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:48:03.884764 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ddc3ce-3291-47fd-8a60-8332773796d1 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:48:03.889573 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591608c8-8036-44ac-ab58-0949655e341c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:48:03.890194 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591608c8-8036-44ac-ab58-0949655e341c admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:03.890515 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591608c8-8036-44ac-ab58-0949655e341c admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:03.890792 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591608c8-8036-44ac-ab58-0949655e341c admin admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:03.891536 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591608c8-8036-44ac-ab58-0949655e341c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:48:03.893496 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591608c8-8036-44ac-ab58-0949655e341c admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:48:03.922106 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1382/2764] 10.222.0.70 () {60 vars in 1153 bytes} [Tue Aug 2 21:48:03 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 21:48:03.926405 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed187a8c-b7af-442a-9455-2354a165cca0 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:48:03.936671 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed187a8c-b7af-442a-9455-2354a165cca0 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:48:03.994608 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c21186-0aaf-484f-b615-8c39df6554fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:48:03.995232 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c21186-0aaf-484f-b615-8c39df6554fb admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:03.995519 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c21186-0aaf-484f-b615-8c39df6554fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:03.995797 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c21186-0aaf-484f-b615-8c39df6554fb admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:03.996601 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c21186-0aaf-484f-b615-8c39df6554fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:48:03.998584 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c21186-0aaf-484f-b615-8c39df6554fb admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:48:04.007179 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:48:04.021235 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1383/2765] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 2 21:48:03 2022] POST /identity/v3/users => generated 287 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 21:48:04.025578 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591608c8-8036-44ac-ab58-0949655e341c admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:48:04.035845 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591608c8-8036-44ac-ab58-0949655e341c admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:48:04.040515 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc98a843-3bd1-41b3-8259-b66acb595174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:48:04.041127 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc98a843-3bd1-41b3-8259-b66acb595174 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:04.041416 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc98a843-3bd1-41b3-8259-b66acb595174 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:04.041690 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc98a843-3bd1-41b3-8259-b66acb595174 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:04.042649 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc98a843-3bd1-41b3-8259-b66acb595174 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:48:04.044289 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc98a843-3bd1-41b3-8259-b66acb595174 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:48:04.054925 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1383/2766] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:48:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:48:04.058942 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c21186-0aaf-484f-b615-8c39df6554fb admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:48:04.069880 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c21186-0aaf-484f-b615-8c39df6554fb admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:48:04.074601 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd155bfe-f585-4772-95f8-85305291554e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:48:04.075221 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd155bfe-f585-4772-95f8-85305291554e admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:04.075516 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd155bfe-f585-4772-95f8-85305291554e admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:04.075799 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd155bfe-f585-4772-95f8-85305291554e admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:04.076541 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd155bfe-f585-4772-95f8-85305291554e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:48:04.078158 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd155bfe-f585-4772-95f8-85305291554e admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:48:04.096166 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1384/2767] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:48:04 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 21:48:04.101754 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc98a843-3bd1-41b3-8259-b66acb595174 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:48:04.114673 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc98a843-3bd1-41b3-8259-b66acb595174 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:48:04.119336 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58794e06-4366-4041-889a-8f41d091f8f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:48:04.119995 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58794e06-4366-4041-889a-8f41d091f8f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:04.120304 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58794e06-4366-4041-889a-8f41d091f8f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:04.120586 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58794e06-4366-4041-889a-8f41d091f8f1 admin admin] PATH_INFO: `/v3/projects/81ebbe13985349c99028fa9515e9d930/users/5c9a2cada12e49078ee6be3439789f52/roles/462e3381a85c42a9959201f9aa122f7c` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:04.133930 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:48:04.138472 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58794e06-4366-4041-889a-8f41d091f8f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81ebbe13985349c99028fa9515e9d930, user_id=5c9a2cada12e49078ee6be3439789f52, role_id=462e3381a85c42a9959201f9aa122f7c)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:48:04.141270 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58794e06-4366-4041-889a-8f41d091f8f1 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:48:04.155155 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1384/2768] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:48:04 2022] PUT /identity/v3/projects/81ebbe13985349c99028fa9515e9d930/users/5c9a2cada12e49078ee6be3439789f52/roles/462e3381a85c42a9959201f9aa122f7c => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:48:04.165713 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf85daa-79da-4596-94eb-7f60858674e5 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:04.166003 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf85daa-79da-4596-94eb-7f60858674e5 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:04.166283 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf85daa-79da-4596-94eb-7f60858674e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:04.194141 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-bbf85daa-79da-4596-94eb-7f60858674e5 None None] MFA Rules not processed for user `5c9a2cada12e49078ee6be3439789f52`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:48:04.195287 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-bbf85daa-79da-4596-94eb-7f60858674e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:48:04.263333 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1385/2769] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:48:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:48:04.274501 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58794e06-4366-4041-889a-8f41d091f8f1 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:48:04.276413 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-58794e06-4366-4041-889a-8f41d091f8f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:48:04.339492 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58794e06-4366-4041-889a-8f41d091f8f1 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:48:04.343630 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01d3ec3-52ea-487b-a491-57d36c698816 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '123eb76f95ee4e39905944da701c712d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:48:04.344515 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01d3ec3-52ea-487b-a491-57d36c698816 service cinder] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:04.344612 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01d3ec3-52ea-487b-a491-57d36c698816 service cinder] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:04.344875 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01d3ec3-52ea-487b-a491-57d36c698816 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:04.353935 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01d3ec3-52ea-487b-a491-57d36c698816 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:48:04.355647 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01d3ec3-52ea-487b-a491-57d36c698816 service cinder] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:48:04.365253 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1385/2770] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:48:04 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:48:04.390327 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf85daa-79da-4596-94eb-7f60858674e5 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:48:04.467332 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf85daa-79da-4596-94eb-7f60858674e5 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:48:04.476389 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ae9c27-3abd-4d47-836f-d76095e2d85f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:48:04.477124 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae9c27-3abd-4d47-836f-d76095e2d85f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:04.477314 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae9c27-3abd-4d47-836f-d76095e2d85f admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:04.477592 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae9c27-3abd-4d47-836f-d76095e2d85f admin admin] PATH_INFO: `/v3/users/5c9a2cada12e49078ee6be3439789f52` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:04.478806 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ae9c27-3abd-4d47-836f-d76095e2d85f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c9a2cada12e49078ee6be3439789f52)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:48:04.481057 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ae9c27-3abd-4d47-836f-d76095e2d85f admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:48:04.535158 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-36ae9c27-3abd-4d47-836f-d76095e2d85f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c9a2cada12e49078ee6be3439789f52'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:48:04.541701 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-36ae9c27-3abd-4d47-836f-d76095e2d85f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c9a2cada12e49078ee6be3439789f52'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:48:04.554756 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:INSERT=4,keystone:SELECT=86,keystone:DELETE=10 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:48:04.556765 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-36ae9c27-3abd-4d47-836f-d76095e2d85f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c9a2cada12e49078ee6be3439789f52'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:48:04.560460 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-36ae9c27-3abd-4d47-836f-d76095e2d85f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c9a2cada12e49078ee6be3439789f52'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:48:04.570320 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-36ae9c27-3abd-4d47-836f-d76095e2d85f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c9a2cada12e49078ee6be3439789f52'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:48:04.577434 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1386/2771] 10.222.0.70 () {58 vars in 1224 bytes} [Tue Aug 2 21:48:04 2022] DELETE /identity/v3/users/5c9a2cada12e49078ee6be3439789f52 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:48:04.581762 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca63bf80-20b1-47cf-ae83-d5ca698dcba3 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:04.582810 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca63bf80-20b1-47cf-ae83-d5ca698dcba3 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:04.582931 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca63bf80-20b1-47cf-ae83-d5ca698dcba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:04.603247 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-ca63bf80-20b1-47cf-ae83-d5ca698dcba3 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:48:04.604590 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-ca63bf80-20b1-47cf-ae83-d5ca698dcba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:48:04.673760 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1386/2772] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:48:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:48:04.684533 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ae9c27-3abd-4d47-836f-d76095e2d85f admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:48:04.686541 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-36ae9c27-3abd-4d47-836f-d76095e2d85f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:48:04.763446 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ae9c27-3abd-4d47-836f-d76095e2d85f admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:48:04.767310 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80a2b70-8ad3-428b-ade6-9b68cb654409 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '723f5f43572a493dae0349070a2adb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:48:04.767948 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a2b70-8ad3-428b-ade6-9b68cb654409 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:04.768247 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a2b70-8ad3-428b-ade6-9b68cb654409 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:04.768543 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80a2b70-8ad3-428b-ade6-9b68cb654409 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:04.781017 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80a2b70-8ad3-428b-ade6-9b68cb654409 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:48:04.782638 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80a2b70-8ad3-428b-ade6-9b68cb654409 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:48:04.802152 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1387/2773] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:48:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:48:05.079974 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca63bf80-20b1-47cf-ae83-d5ca698dcba3 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:48:05.081475 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-ca63bf80-20b1-47cf-ae83-d5ca698dcba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:48:05.094630 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca63bf80-20b1-47cf-ae83-d5ca698dcba3 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:48:05.100395 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2344712-dcf2-4d2d-9546-b9e4b3c7bf58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:48:05.101237 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2344712-dcf2-4d2d-9546-b9e4b3c7bf58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:05.101524 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2344712-dcf2-4d2d-9546-b9e4b3c7bf58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:05.101800 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2344712-dcf2-4d2d-9546-b9e4b3c7bf58 admin admin] PATH_INFO: `/v3/projects/81ebbe13985349c99028fa9515e9d930` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:05.102977 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2344712-dcf2-4d2d-9546-b9e4b3c7bf58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81ebbe13985349c99028fa9515e9d930)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:48:05.105198 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2344712-dcf2-4d2d-9546-b9e4b3c7bf58 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:48:05.154306 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-e2344712-dcf2-4d2d-9546-b9e4b3c7bf58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81ebbe13985349c99028fa9515e9d930', 'request_id': 'req-e2344712-dcf2-4d2d-9546-b9e4b3c7bf58'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:48:05.161010 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-e2344712-dcf2-4d2d-9546-b9e4b3c7bf58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81ebbe13985349c99028fa9515e9d930', 'request_id': 'req-e2344712-dcf2-4d2d-9546-b9e4b3c7bf58'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:48:05.168666 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-e2344712-dcf2-4d2d-9546-b9e4b3c7bf58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81ebbe13985349c99028fa9515e9d930', 'request_id': 'req-e2344712-dcf2-4d2d-9546-b9e4b3c7bf58'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:48:05.179828 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-e2344712-dcf2-4d2d-9546-b9e4b3c7bf58 admin admin] The token cache is being invalidate because project 81ebbe13985349c99028fa9515e9d930 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:48:05.180121 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-e2344712-dcf2-4d2d-9546-b9e4b3c7bf58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:48:05.180969 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-e2344712-dcf2-4d2d-9546-b9e4b3c7bf58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:48:05.182511 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1387/2774] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Aug 2 21:48:05 2022] DELETE /identity/v3/projects/81ebbe13985349c99028fa9515e9d930 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:48:05.187392 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b943fa-0ef9-440a-b832-135cdaf05765 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:05.187682 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b943fa-0ef9-440a-b832-135cdaf05765 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:05.187961 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b943fa-0ef9-440a-b832-135cdaf05765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:05.208969 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-a2b943fa-0ef9-440a-b832-135cdaf05765 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:48:05.210408 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-a2b943fa-0ef9-440a-b832-135cdaf05765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:48:05.280423 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1388/2775] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:48:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:48:05.282251 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c9953c-ea41-496d-acfe-94e4cf678a63 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:05.282547 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c9953c-ea41-496d-acfe-94e4cf678a63 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:05.282829 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c9953c-ea41-496d-acfe-94e4cf678a63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:05.303916 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-64c9953c-ea41-496d-acfe-94e4cf678a63 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:48:05.305177 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-64c9953c-ea41-496d-acfe-94e4cf678a63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:48:05.317132 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1388/2776] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:48:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:48:05.318330 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b943fa-0ef9-440a-b832-135cdaf05765 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:48:05.329262 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b943fa-0ef9-440a-b832-135cdaf05765 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:48:05.334692 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6b969d-c8cc-4dad-b187-04da51f16f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:48:05.335302 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6b969d-c8cc-4dad-b187-04da51f16f96 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:05.335583 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6b969d-c8cc-4dad-b187-04da51f16f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:05.335857 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6b969d-c8cc-4dad-b187-04da51f16f96 admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:05.336586 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6b969d-c8cc-4dad-b187-04da51f16f96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:48:05.336895 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6b969d-c8cc-4dad-b187-04da51f16f96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:48:05.338494 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6b969d-c8cc-4dad-b187-04da51f16f96 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:48:05.351103 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1389/2777] 10.222.0.70 () {58 vars in 1153 bytes} [Tue Aug 2 21:48:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:48:05.356424 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c9953c-ea41-496d-acfe-94e4cf678a63 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:48:05.366988 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c9953c-ea41-496d-acfe-94e4cf678a63 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:48:05.372092 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42d3f96-1720-4410-8b15-4faba9355586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:48:05.372908 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d3f96-1720-4410-8b15-4faba9355586 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:05.373273 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d3f96-1720-4410-8b15-4faba9355586 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:05.373560 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d3f96-1720-4410-8b15-4faba9355586 admin admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:05.374348 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42d3f96-1720-4410-8b15-4faba9355586 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:48:05.376325 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42d3f96-1720-4410-8b15-4faba9355586 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:48:05.386064 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:48:05.405079 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1389/2778] 10.222.0.70 () {60 vars in 1153 bytes} [Tue Aug 2 21:48:05 2022] POST /identity/v3/projects => generated 397 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:48:05.409330 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6b969d-c8cc-4dad-b187-04da51f16f96 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:48:05.420032 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6b969d-c8cc-4dad-b187-04da51f16f96 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:48:05.478837 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9827be8-158d-4aef-8701-47e7d828c58f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:48:05.479383 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9827be8-158d-4aef-8701-47e7d828c58f admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:05.479668 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9827be8-158d-4aef-8701-47e7d828c58f admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:05.480205 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9827be8-158d-4aef-8701-47e7d828c58f admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:05.480905 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9827be8-158d-4aef-8701-47e7d828c58f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:48:05.482876 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9827be8-158d-4aef-8701-47e7d828c58f admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:48:05.503729 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1390/2779] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 2 21:48:05 2022] POST /identity/v3/users => generated 299 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:48:05.507948 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42d3f96-1720-4410-8b15-4faba9355586 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:48:05.518260 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42d3f96-1720-4410-8b15-4faba9355586 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:48:05.523339 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17677db-6b26-4a3b-a0af-51b49d55f16b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:48:05.523933 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17677db-6b26-4a3b-a0af-51b49d55f16b admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:05.524215 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17677db-6b26-4a3b-a0af-51b49d55f16b admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:05.524526 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17677db-6b26-4a3b-a0af-51b49d55f16b admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:05.525236 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17677db-6b26-4a3b-a0af-51b49d55f16b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:48:05.526900 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17677db-6b26-4a3b-a0af-51b49d55f16b admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:48:05.537633 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1390/2780] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:48:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:48:05.541312 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9827be8-158d-4aef-8701-47e7d828c58f admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:48:05.551471 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9827be8-158d-4aef-8701-47e7d828c58f admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:48:05.556276 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51fceb2-4aa5-4609-bb81-ac1b63ad2532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:48:05.556807 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51fceb2-4aa5-4609-bb81-ac1b63ad2532 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:05.557099 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51fceb2-4aa5-4609-bb81-ac1b63ad2532 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:05.557406 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51fceb2-4aa5-4609-bb81-ac1b63ad2532 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:05.558116 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51fceb2-4aa5-4609-bb81-ac1b63ad2532 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:48:05.559706 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51fceb2-4aa5-4609-bb81-ac1b63ad2532 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:48:05.562303 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:48:05.574817 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1391/2781] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:48:05 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 21:48:05.578955 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17677db-6b26-4a3b-a0af-51b49d55f16b admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:48:05.589644 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17677db-6b26-4a3b-a0af-51b49d55f16b admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:48:05.594596 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f40bf5-ad6a-4d0d-a801-4652e7039304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:48:05.595259 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f40bf5-ad6a-4d0d-a801-4652e7039304 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:05.595550 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f40bf5-ad6a-4d0d-a801-4652e7039304 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:05.595824 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f40bf5-ad6a-4d0d-a801-4652e7039304 admin admin] PATH_INFO: `/v3/projects/dcf2efbcf2f2484384272460c3b04d34/users/ac2ad7857c274a7a888c99beeb833c80/roles/462e3381a85c42a9959201f9aa122f7c` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:05.612152 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f40bf5-ad6a-4d0d-a801-4652e7039304 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcf2efbcf2f2484384272460c3b04d34, user_id=ac2ad7857c274a7a888c99beeb833c80, role_id=462e3381a85c42a9959201f9aa122f7c)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:48:05.615511 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f40bf5-ad6a-4d0d-a801-4652e7039304 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:48:05.632344 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1391/2782] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:48:05 2022] PUT /identity/v3/projects/dcf2efbcf2f2484384272460c3b04d34/users/ac2ad7857c274a7a888c99beeb833c80/roles/462e3381a85c42a9959201f9aa122f7c => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:48:05.642686 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c62c4c6-df92-4487-8607-bb7a296dde8b None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:05.643151 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c62c4c6-df92-4487-8607-bb7a296dde8b None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:05.643628 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c62c4c6-df92-4487-8607-bb7a296dde8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:05.673200 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-4c62c4c6-df92-4487-8607-bb7a296dde8b None None] MFA Rules not processed for user `ac2ad7857c274a7a888c99beeb833c80`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:48:05.674529 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-4c62c4c6-df92-4487-8607-bb7a296dde8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:48:05.740130 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1392/2783] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:48:05 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:48:05.751212 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f40bf5-ad6a-4d0d-a801-4652e7039304 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:48:05.752928 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-73f40bf5-ad6a-4d0d-a801-4652e7039304 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:48:05.810298 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f40bf5-ad6a-4d0d-a801-4652e7039304 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:48:05.813960 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2038627d-ea43-4b7f-babb-1c4b695cfeb0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '123eb76f95ee4e39905944da701c712d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:48:05.814573 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2038627d-ea43-4b7f-babb-1c4b695cfeb0 service cinder] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:05.814861 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2038627d-ea43-4b7f-babb-1c4b695cfeb0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:05.815147 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2038627d-ea43-4b7f-babb-1c4b695cfeb0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:05.823486 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2038627d-ea43-4b7f-babb-1c4b695cfeb0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:48:05.824962 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2038627d-ea43-4b7f-babb-1c4b695cfeb0 service cinder] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:48:05.833799 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1392/2784] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:48:05 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:48:06.291959 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb3bc73-5667-4828-b345-ffe05ece888e None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:06.292450 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb3bc73-5667-4828-b345-ffe05ece888e None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:06.292654 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb3bc73-5667-4828-b345-ffe05ece888e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:06.313791 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-0eb3bc73-5667-4828-b345-ffe05ece888e None None] MFA Rules not processed for user `6be7b2bcfebd45389ca289c34fbabc3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:48:06.315020 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-0eb3bc73-5667-4828-b345-ffe05ece888e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:48:06.374664 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1393/2785] 10.222.0.70 () {58 vars in 1009 bytes} [Tue Aug 2 21:48:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:48:06.421224 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2038627d-ea43-4b7f-babb-1c4b695cfeb0 service cinder] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:48:06.422678 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-2038627d-ea43-4b7f-babb-1c4b695cfeb0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:48:06.491762 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2038627d-ea43-4b7f-babb-1c4b695cfeb0 service cinder] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:48:06.496769 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6499efe5-3ac2-436e-b2ea-c215bf124475 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee7ebf40212465aac997b461a2d10fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:48:06.497413 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6499efe5-3ac2-436e-b2ea-c215bf124475 service swift] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:06.497755 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6499efe5-3ac2-436e-b2ea-c215bf124475 service swift] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:06.498029 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6499efe5-3ac2-436e-b2ea-c215bf124475 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:06.506445 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6499efe5-3ac2-436e-b2ea-c215bf124475 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:48:06.507974 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6499efe5-3ac2-436e-b2ea-c215bf124475 service swift] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:48:06.516000 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1393/2786] 10.222.0.70 () {60 vars in 1384 bytes} [Tue Aug 2 21:48:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 02 21:48:07.026899 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b960d5c-3ee6-493a-ba93-e277dfb4f09c None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:07.027188 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b960d5c-3ee6-493a-ba93-e277dfb4f09c None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:07.027466 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b960d5c-3ee6-493a-ba93-e277dfb4f09c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:07.048657 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-8b960d5c-3ee6-493a-ba93-e277dfb4f09c None None] MFA Rules not processed for user `6be7b2bcfebd45389ca289c34fbabc3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:48:07.049855 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-8b960d5c-3ee6-493a-ba93-e277dfb4f09c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:48:07.057658 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1394/2787] 10.222.0.70 () {58 vars in 967 bytes} [Tue Aug 2 21:48:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:48:07.070390 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6499efe5-3ac2-436e-b2ea-c215bf124475 service swift] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:48:07.081123 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6499efe5-3ac2-436e-b2ea-c215bf124475 service swift] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:48:07.086088 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f54e8d-8424-4f66-a97d-d89dd45514bf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee7ebf40212465aac997b461a2d10fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:48:07.086695 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f54e8d-8424-4f66-a97d-d89dd45514bf service swift] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:07.086977 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f54e8d-8424-4f66-a97d-d89dd45514bf service swift] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:07.087258 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f54e8d-8424-4f66-a97d-d89dd45514bf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:07.095351 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f54e8d-8424-4f66-a97d-d89dd45514bf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:48:07.097046 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f54e8d-8424-4f66-a97d-d89dd45514bf service swift] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:48:07.106110 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1394/2788] 10.222.0.70 () {60 vars in 1384 bytes} [Tue Aug 2 21:48:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 02 21:48:07.320472 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01fe22e-2ad3-41ea-b423-7defc6f5230a None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:07.320920 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01fe22e-2ad3-41ea-b423-7defc6f5230a None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:07.321013 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01fe22e-2ad3-41ea-b423-7defc6f5230a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:07.342312 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-a01fe22e-2ad3-41ea-b423-7defc6f5230a None None] MFA Rules not processed for user `6be7b2bcfebd45389ca289c34fbabc3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:48:07.343500 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-a01fe22e-2ad3-41ea-b423-7defc6f5230a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:48:07.353419 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1395/2789] 10.222.0.70 () {58 vars in 1009 bytes} [Tue Aug 2 21:48:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:48:07.365873 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f54e8d-8424-4f66-a97d-d89dd45514bf service swift] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:48:07.376522 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f54e8d-8424-4f66-a97d-d89dd45514bf service swift] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:48:07.382150 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441b9644-c347-4738-a470-4afe79f955ce service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee7ebf40212465aac997b461a2d10fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:48:07.382764 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441b9644-c347-4738-a470-4afe79f955ce service swift] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:07.383046 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441b9644-c347-4738-a470-4afe79f955ce service swift] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:07.383325 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441b9644-c347-4738-a470-4afe79f955ce service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:07.391849 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441b9644-c347-4738-a470-4afe79f955ce service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:48:07.393606 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441b9644-c347-4738-a470-4afe79f955ce service swift] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:48:07.402570 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1395/2790] 10.222.0.70 () {60 vars in 1384 bytes} [Tue Aug 2 21:48:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 02 21:48:07.741228 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5ed88e-c87f-4d14-b02b-b45e2e8c5adf None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:07.741518 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5ed88e-c87f-4d14-b02b-b45e2e8c5adf None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:07.741801 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5ed88e-c87f-4d14-b02b-b45e2e8c5adf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:07.761305 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-9f5ed88e-c87f-4d14-b02b-b45e2e8c5adf None None] MFA Rules not processed for user `6be7b2bcfebd45389ca289c34fbabc3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:48:07.762502 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-9f5ed88e-c87f-4d14-b02b-b45e2e8c5adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:48:07.769628 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1396/2791] 10.222.0.70 () {58 vars in 967 bytes} [Tue Aug 2 21:48:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:48:07.787026 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441b9644-c347-4738-a470-4afe79f955ce service swift] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:48:07.797613 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441b9644-c347-4738-a470-4afe79f955ce service swift] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:48:07.803045 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad26ea12-5ace-48f1-ad58-e8d23a54f616 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2ee7ebf40212465aac997b461a2d10fc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:48:07.803653 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad26ea12-5ace-48f1-ad58-e8d23a54f616 service swift] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:07.803957 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad26ea12-5ace-48f1-ad58-e8d23a54f616 service swift] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:07.804220 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad26ea12-5ace-48f1-ad58-e8d23a54f616 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:07.812227 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad26ea12-5ace-48f1-ad58-e8d23a54f616 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:48:07.815264 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad26ea12-5ace-48f1-ad58-e8d23a54f616 service swift] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:48:07.825113 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1396/2792] 10.222.0.70 () {60 vars in 1384 bytes} [Tue Aug 2 21:48:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 02 21:48:07.837931 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5ed88e-c87f-4d14-b02b-b45e2e8c5adf None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:48:07.839472 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-9f5ed88e-c87f-4d14-b02b-b45e2e8c5adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:48:07.908987 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5ed88e-c87f-4d14-b02b-b45e2e8c5adf None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:48:07.914434 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa2f424-62aa-4089-9974-5b2469daba41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:48:07.915229 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa2f424-62aa-4089-9974-5b2469daba41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:07.915687 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa2f424-62aa-4089-9974-5b2469daba41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:07.916037 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa2f424-62aa-4089-9974-5b2469daba41 admin admin] PATH_INFO: `/v3/users/ef17a69c46a84e6191e6f2ba69ec9ffe` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:07.917383 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa2f424-62aa-4089-9974-5b2469daba41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef17a69c46a84e6191e6f2ba69ec9ffe)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:48:07.919630 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa2f424-62aa-4089-9974-5b2469daba41 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:48:07.939325 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:48:07.977607 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-6aa2f424-62aa-4089-9974-5b2469daba41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef17a69c46a84e6191e6f2ba69ec9ffe'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:48:07.986095 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-6aa2f424-62aa-4089-9974-5b2469daba41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef17a69c46a84e6191e6f2ba69ec9ffe'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:48:07.998510 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-6aa2f424-62aa-4089-9974-5b2469daba41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef17a69c46a84e6191e6f2ba69ec9ffe'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:48:07.999214 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-6aa2f424-62aa-4089-9974-5b2469daba41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef17a69c46a84e6191e6f2ba69ec9ffe'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:48:08.007432 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-6aa2f424-62aa-4089-9974-5b2469daba41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef17a69c46a84e6191e6f2ba69ec9ffe'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:48:08.013900 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1397/2793] 10.222.0.70 () {58 vars in 1224 bytes} [Tue Aug 2 21:48:07 2022] DELETE /identity/v3/users/ef17a69c46a84e6191e6f2ba69ec9ffe => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:48:08.018343 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e069bf4-28e4-4513-8c50-ff346c47d6fa None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:08.018668 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e069bf4-28e4-4513-8c50-ff346c47d6fa None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:08.018994 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e069bf4-28e4-4513-8c50-ff346c47d6fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:08.033833 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:48:08.041955 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-9e069bf4-28e4-4513-8c50-ff346c47d6fa None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:48:08.044803 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-9e069bf4-28e4-4513-8c50-ff346c47d6fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:48:08.116446 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1397/2794] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:48:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:48:08.122744 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa2f424-62aa-4089-9974-5b2469daba41 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:48:08.124124 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-6aa2f424-62aa-4089-9974-5b2469daba41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:48:08.185458 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa2f424-62aa-4089-9974-5b2469daba41 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:48:08.189492 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d72059e-c301-4a54-a406-13aa4b991f57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '723f5f43572a493dae0349070a2adb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:48:08.190110 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d72059e-c301-4a54-a406-13aa4b991f57 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:08.192927 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d72059e-c301-4a54-a406-13aa4b991f57 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:08.192927 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d72059e-c301-4a54-a406-13aa4b991f57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:08.204923 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d72059e-c301-4a54-a406-13aa4b991f57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:48:08.206373 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d72059e-c301-4a54-a406-13aa4b991f57 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:48:08.217101 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1398/2795] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:48:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:48:08.501510 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e069bf4-28e4-4513-8c50-ff346c47d6fa None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:48:08.503094 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-9e069bf4-28e4-4513-8c50-ff346c47d6fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:48:08.519327 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e069bf4-28e4-4513-8c50-ff346c47d6fa None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:48:08.524863 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8184d162-664a-4bec-a7d5-2529e1136d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:48:08.525750 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8184d162-664a-4bec-a7d5-2529e1136d8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:08.526035 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8184d162-664a-4bec-a7d5-2529e1136d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:08.526470 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8184d162-664a-4bec-a7d5-2529e1136d8a admin admin] PATH_INFO: `/v3/projects/9deaeb5cb9fd48439437431d1fb0e45b` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:08.528797 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8184d162-664a-4bec-a7d5-2529e1136d8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9deaeb5cb9fd48439437431d1fb0e45b)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:48:08.530950 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8184d162-664a-4bec-a7d5-2529e1136d8a admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:48:08.604295 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-8184d162-664a-4bec-a7d5-2529e1136d8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9deaeb5cb9fd48439437431d1fb0e45b', 'request_id': 'req-8184d162-664a-4bec-a7d5-2529e1136d8a'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:48:08.613319 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-8184d162-664a-4bec-a7d5-2529e1136d8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9deaeb5cb9fd48439437431d1fb0e45b', 'request_id': 'req-8184d162-664a-4bec-a7d5-2529e1136d8a'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:48:08.624080 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-8184d162-664a-4bec-a7d5-2529e1136d8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9deaeb5cb9fd48439437431d1fb0e45b', 'request_id': 'req-8184d162-664a-4bec-a7d5-2529e1136d8a'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:48:08.646015 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-8184d162-664a-4bec-a7d5-2529e1136d8a admin admin] The token cache is being invalidate because project 9deaeb5cb9fd48439437431d1fb0e45b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:48:08.646513 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-8184d162-664a-4bec-a7d5-2529e1136d8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:48:08.647632 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-8184d162-664a-4bec-a7d5-2529e1136d8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:48:08.649736 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1398/2796] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Aug 2 21:48:08 2022] DELETE /identity/v3/projects/9deaeb5cb9fd48439437431d1fb0e45b => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:48:08.655056 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff210e-c34b-4f23-b854-cd5538a209c0 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:08.655525 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff210e-c34b-4f23-b854-cd5538a209c0 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:08.655698 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ff210e-c34b-4f23-b854-cd5538a209c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:08.680275 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-a8ff210e-c34b-4f23-b854-cd5538a209c0 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:48:08.681514 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-a8ff210e-c34b-4f23-b854-cd5538a209c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:48:08.760554 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1399/2797] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:48:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:48:08.826244 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6985027c-f2cd-4b18-863f-4f3abcd441cd None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:08.826537 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6985027c-f2cd-4b18-863f-4f3abcd441cd None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:08.826842 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6985027c-f2cd-4b18-863f-4f3abcd441cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:08.852504 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-6985027c-f2cd-4b18-863f-4f3abcd441cd None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:48:08.853725 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-6985027c-f2cd-4b18-863f-4f3abcd441cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:48:08.862274 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1399/2798] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:48:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:48:08.867081 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ff210e-c34b-4f23-b854-cd5538a209c0 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:48:08.879203 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ff210e-c34b-4f23-b854-cd5538a209c0 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:48:08.884342 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d779c0db-bc1d-49fe-98f6-32ba422e88dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:48:08.885147 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d779c0db-bc1d-49fe-98f6-32ba422e88dc admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:08.885434 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d779c0db-bc1d-49fe-98f6-32ba422e88dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:08.885782 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d779c0db-bc1d-49fe-98f6-32ba422e88dc admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:08.886573 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d779c0db-bc1d-49fe-98f6-32ba422e88dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:48:08.886820 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d779c0db-bc1d-49fe-98f6-32ba422e88dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:48:08.888738 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d779c0db-bc1d-49fe-98f6-32ba422e88dc admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:48:08.901611 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1400/2799] 10.222.0.70 () {58 vars in 1153 bytes} [Tue Aug 2 21:48:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:48:08.906270 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6985027c-f2cd-4b18-863f-4f3abcd441cd None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:48:08.917211 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6985027c-f2cd-4b18-863f-4f3abcd441cd None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:48:08.923226 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264e8a07-aefd-4078-bf40-7a3bcb06294c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:48:08.924114 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264e8a07-aefd-4078-bf40-7a3bcb06294c admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:08.924448 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264e8a07-aefd-4078-bf40-7a3bcb06294c admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:08.924778 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264e8a07-aefd-4078-bf40-7a3bcb06294c admin admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:08.925741 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264e8a07-aefd-4078-bf40-7a3bcb06294c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:48:08.927964 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264e8a07-aefd-4078-bf40-7a3bcb06294c admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:48:08.960275 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1400/2800] 10.222.0.70 () {60 vars in 1153 bytes} [Tue Aug 2 21:48:08 2022] POST /identity/v3/projects => generated 371 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:48:08.962455 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d779c0db-bc1d-49fe-98f6-32ba422e88dc admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:48:08.974075 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d779c0db-bc1d-49fe-98f6-32ba422e88dc admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:48:09.001656 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:48:09.046138 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b064fe0-20bc-4f6c-85dd-2b22fe5455b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:48:09.046860 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b064fe0-20bc-4f6c-85dd-2b22fe5455b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:09.047147 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b064fe0-20bc-4f6c-85dd-2b22fe5455b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:09.047426 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b064fe0-20bc-4f6c-85dd-2b22fe5455b0 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:09.048206 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b064fe0-20bc-4f6c-85dd-2b22fe5455b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:48:09.050579 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b064fe0-20bc-4f6c-85dd-2b22fe5455b0 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:48:09.073086 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1401/2801] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 2 21:48:08 2022] POST /identity/v3/users => generated 286 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:48:09.077363 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264e8a07-aefd-4078-bf40-7a3bcb06294c admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:48:09.091148 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264e8a07-aefd-4078-bf40-7a3bcb06294c admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:48:09.095934 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe20a4c-0ca6-41fc-b453-0f7b96d7f829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:48:09.097299 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe20a4c-0ca6-41fc-b453-0f7b96d7f829 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:09.098419 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe20a4c-0ca6-41fc-b453-0f7b96d7f829 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:09.098917 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe20a4c-0ca6-41fc-b453-0f7b96d7f829 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:09.099689 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe20a4c-0ca6-41fc-b453-0f7b96d7f829 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:48:09.101423 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe20a4c-0ca6-41fc-b453-0f7b96d7f829 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:48:09.112429 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1401/2802] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:48:09 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:48:09.116890 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b064fe0-20bc-4f6c-85dd-2b22fe5455b0 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:48:09.127144 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b064fe0-20bc-4f6c-85dd-2b22fe5455b0 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:48:09.132003 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db771e9-9521-42e2-b65a-9e87d48f95d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:48:09.132703 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db771e9-9521-42e2-b65a-9e87d48f95d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:09.133165 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db771e9-9521-42e2-b65a-9e87d48f95d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:09.133443 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db771e9-9521-42e2-b65a-9e87d48f95d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:09.134175 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db771e9-9521-42e2-b65a-9e87d48f95d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:48:09.136296 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db771e9-9521-42e2-b65a-9e87d48f95d7 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:48:09.149154 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1402/2803] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:48:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:48:09.153683 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe20a4c-0ca6-41fc-b453-0f7b96d7f829 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:48:09.164708 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe20a4c-0ca6-41fc-b453-0f7b96d7f829 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:48:09.169465 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5db635-ec48-4100-9deb-d94bf2889894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:48:09.170149 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5db635-ec48-4100-9deb-d94bf2889894 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:09.170435 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5db635-ec48-4100-9deb-d94bf2889894 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:09.170718 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5db635-ec48-4100-9deb-d94bf2889894 admin admin] PATH_INFO: `/v3/projects/b2ebb0f531b84698a2cfc119480d81e4/users/18ad12945df746e7a026118d983fb49c/roles/462e3381a85c42a9959201f9aa122f7c` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:09.186557 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5db635-ec48-4100-9deb-d94bf2889894 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2ebb0f531b84698a2cfc119480d81e4, user_id=18ad12945df746e7a026118d983fb49c, role_id=462e3381a85c42a9959201f9aa122f7c)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:48:09.189430 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5db635-ec48-4100-9deb-d94bf2889894 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:48:09.203045 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1402/2804] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:48:09 2022] PUT /identity/v3/projects/b2ebb0f531b84698a2cfc119480d81e4/users/18ad12945df746e7a026118d983fb49c/roles/462e3381a85c42a9959201f9aa122f7c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:48:09.214991 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defdeac1-44cc-4efa-9d2a-0d90a8a5d70f None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:09.215283 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defdeac1-44cc-4efa-9d2a-0d90a8a5d70f None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:09.215562 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defdeac1-44cc-4efa-9d2a-0d90a8a5d70f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:09.244075 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-defdeac1-44cc-4efa-9d2a-0d90a8a5d70f None None] MFA Rules not processed for user `18ad12945df746e7a026118d983fb49c`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:48:09.245332 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-defdeac1-44cc-4efa-9d2a-0d90a8a5d70f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:48:09.315526 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1403/2805] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:48:09 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:48:09.326945 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5db635-ec48-4100-9deb-d94bf2889894 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:48:09.328616 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-6f5db635-ec48-4100-9deb-d94bf2889894 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:48:09.360589 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:48:09.390475 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5db635-ec48-4100-9deb-d94bf2889894 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:48:09.394159 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d02c99-a33d-40f1-a881-4cd01cacf59b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'accb7ab8b4f447389ed394a48fc27619', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:48:09.394775 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d02c99-a33d-40f1-a881-4cd01cacf59b service glance] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:09.395061 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d02c99-a33d-40f1-a881-4cd01cacf59b service glance] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:09.395341 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d02c99-a33d-40f1-a881-4cd01cacf59b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:09.403612 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d02c99-a33d-40f1-a881-4cd01cacf59b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:48:09.405128 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d02c99-a33d-40f1-a881-4cd01cacf59b service glance] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:48:09.414689 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1403/2806] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:48:09 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:48:10.015354 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defdeac1-44cc-4efa-9d2a-0d90a8a5d70f None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:48:10.016789 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-defdeac1-44cc-4efa-9d2a-0d90a8a5d70f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:48:10.086282 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defdeac1-44cc-4efa-9d2a-0d90a8a5d70f None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:48:10.090736 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33ce13e-75d0-4d68-9f86-06187df20a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:48:10.091377 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33ce13e-75d0-4d68-9f86-06187df20a15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:10.091660 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33ce13e-75d0-4d68-9f86-06187df20a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:10.091936 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33ce13e-75d0-4d68-9f86-06187df20a15 admin admin] PATH_INFO: `/v3/users/0b5268fa925440c1ae2d63aecde3f83f` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:10.093129 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33ce13e-75d0-4d68-9f86-06187df20a15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b5268fa925440c1ae2d63aecde3f83f)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:48:10.095071 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33ce13e-75d0-4d68-9f86-06187df20a15 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:48:10.129248 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:48:10.145121 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-e33ce13e-75d0-4d68-9f86-06187df20a15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b5268fa925440c1ae2d63aecde3f83f'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:48:10.153264 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-e33ce13e-75d0-4d68-9f86-06187df20a15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b5268fa925440c1ae2d63aecde3f83f'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:48:10.165726 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-e33ce13e-75d0-4d68-9f86-06187df20a15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b5268fa925440c1ae2d63aecde3f83f'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:48:10.166353 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-e33ce13e-75d0-4d68-9f86-06187df20a15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b5268fa925440c1ae2d63aecde3f83f'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:48:10.173545 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-e33ce13e-75d0-4d68-9f86-06187df20a15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b5268fa925440c1ae2d63aecde3f83f'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:48:10.180698 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1404/2807] 10.222.0.70 () {58 vars in 1224 bytes} [Tue Aug 2 21:48:10 2022] DELETE /identity/v3/users/0b5268fa925440c1ae2d63aecde3f83f => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:48:10.185168 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efc84bb-7f8e-4922-9f03-42037ca54402 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:10.185645 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efc84bb-7f8e-4922-9f03-42037ca54402 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:10.185764 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efc84bb-7f8e-4922-9f03-42037ca54402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:10.204679 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-0efc84bb-7f8e-4922-9f03-42037ca54402 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:48:10.205874 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-0efc84bb-7f8e-4922-9f03-42037ca54402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:48:10.268719 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1404/2808] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:48:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:48:10.279754 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33ce13e-75d0-4d68-9f86-06187df20a15 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:48:10.281650 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-e33ce13e-75d0-4d68-9f86-06187df20a15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:48:10.349633 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33ce13e-75d0-4d68-9f86-06187df20a15 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:48:10.353208 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2667ec-1f78-492a-b581-41216610b02e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '723f5f43572a493dae0349070a2adb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:48:10.353845 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2667ec-1f78-492a-b581-41216610b02e service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:10.354159 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2667ec-1f78-492a-b581-41216610b02e service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:10.354417 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2667ec-1f78-492a-b581-41216610b02e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:10.365294 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2667ec-1f78-492a-b581-41216610b02e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:48:10.366756 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2667ec-1f78-492a-b581-41216610b02e service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:48:10.378513 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1405/2809] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:48:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:48:10.561311 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efc84bb-7f8e-4922-9f03-42037ca54402 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:48:10.562799 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-0efc84bb-7f8e-4922-9f03-42037ca54402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:48:10.575782 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efc84bb-7f8e-4922-9f03-42037ca54402 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:48:10.580539 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798782ee-d640-44fd-9e7e-a536e3e3d29b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:48:10.581196 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798782ee-d640-44fd-9e7e-a536e3e3d29b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:10.581480 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798782ee-d640-44fd-9e7e-a536e3e3d29b admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:10.581761 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798782ee-d640-44fd-9e7e-a536e3e3d29b admin admin] PATH_INFO: `/v3/projects/6438e54e33b244099aa8dd42b92274d9` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:10.583515 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798782ee-d640-44fd-9e7e-a536e3e3d29b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6438e54e33b244099aa8dd42b92274d9)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:48:10.585467 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798782ee-d640-44fd-9e7e-a536e3e3d29b admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:48:10.635740 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-798782ee-d640-44fd-9e7e-a536e3e3d29b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6438e54e33b244099aa8dd42b92274d9', 'request_id': 'req-798782ee-d640-44fd-9e7e-a536e3e3d29b'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:48:10.641461 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-798782ee-d640-44fd-9e7e-a536e3e3d29b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6438e54e33b244099aa8dd42b92274d9', 'request_id': 'req-798782ee-d640-44fd-9e7e-a536e3e3d29b'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:48:10.649668 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-798782ee-d640-44fd-9e7e-a536e3e3d29b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6438e54e33b244099aa8dd42b92274d9', 'request_id': 'req-798782ee-d640-44fd-9e7e-a536e3e3d29b'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:48:10.661373 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-798782ee-d640-44fd-9e7e-a536e3e3d29b admin admin] The token cache is being invalidate because project 6438e54e33b244099aa8dd42b92274d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:48:10.661626 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-798782ee-d640-44fd-9e7e-a536e3e3d29b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:48:10.662443 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-798782ee-d640-44fd-9e7e-a536e3e3d29b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:48:10.664175 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1405/2810] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Aug 2 21:48:10 2022] DELETE /identity/v3/projects/6438e54e33b244099aa8dd42b92274d9 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:48:10.669118 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee3cab2-8ef0-420b-b949-6a0e2f4acc74 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:10.669402 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee3cab2-8ef0-420b-b949-6a0e2f4acc74 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:10.669675 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee3cab2-8ef0-420b-b949-6a0e2f4acc74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:10.689031 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-dee3cab2-8ef0-420b-b949-6a0e2f4acc74 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:48:10.690221 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-dee3cab2-8ef0-420b-b949-6a0e2f4acc74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:48:10.761178 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1406/2811] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:48:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:48:10.768838 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b745790a-cb31-4533-aa13-c730347f26ea None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:10.769128 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b745790a-cb31-4533-aa13-c730347f26ea None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:10.769974 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b745790a-cb31-4533-aa13-c730347f26ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:10.790084 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-b745790a-cb31-4533-aa13-c730347f26ea None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:48:10.791413 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-b745790a-cb31-4533-aa13-c730347f26ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:48:10.799340 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1406/2812] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:48:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:48:10.803625 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee3cab2-8ef0-420b-b949-6a0e2f4acc74 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:48:10.813330 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee3cab2-8ef0-420b-b949-6a0e2f4acc74 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:48:10.818384 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15971bb-6593-44ea-8af4-a99706f0d3c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:48:10.818992 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15971bb-6593-44ea-8af4-a99706f0d3c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:10.819283 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15971bb-6593-44ea-8af4-a99706f0d3c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:10.819562 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15971bb-6593-44ea-8af4-a99706f0d3c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:10.820278 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15971bb-6593-44ea-8af4-a99706f0d3c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:48:10.820594 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15971bb-6593-44ea-8af4-a99706f0d3c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:48:10.822194 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15971bb-6593-44ea-8af4-a99706f0d3c4 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:48:10.834327 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1407/2813] 10.222.0.70 () {58 vars in 1153 bytes} [Tue Aug 2 21:48:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:48:10.839113 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b745790a-cb31-4533-aa13-c730347f26ea None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:48:10.849779 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b745790a-cb31-4533-aa13-c730347f26ea None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:48:10.854687 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92304ee5-3ddd-45b1-ae36-929c44ebb509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:48:10.855562 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92304ee5-3ddd-45b1-ae36-929c44ebb509 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:10.855846 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92304ee5-3ddd-45b1-ae36-929c44ebb509 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:10.856155 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92304ee5-3ddd-45b1-ae36-929c44ebb509 admin admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:10.856848 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92304ee5-3ddd-45b1-ae36-929c44ebb509 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:48:10.858796 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92304ee5-3ddd-45b1-ae36-929c44ebb509 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:48:10.899029 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1407/2814] 10.222.0.70 () {60 vars in 1153 bytes} [Tue Aug 2 21:48:10 2022] POST /identity/v3/projects => generated 371 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:48:10.901172 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15971bb-6593-44ea-8af4-a99706f0d3c4 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:48:10.906761 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92304ee5-3ddd-45b1-ae36-929c44ebb509 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:48:10.908777 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-92304ee5-3ddd-45b1-ae36-929c44ebb509 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:48:10.914150 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15971bb-6593-44ea-8af4-a99706f0d3c4 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:48:10.942588 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:48:10.950064 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:48:10.983776 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ef970b-9001-4c1c-9e40-3a6580351172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:48:10.984440 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ef970b-9001-4c1c-9e40-3a6580351172 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:10.984744 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ef970b-9001-4c1c-9e40-3a6580351172 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:10.985002 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ef970b-9001-4c1c-9e40-3a6580351172 admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:10.985679 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ef970b-9001-4c1c-9e40-3a6580351172 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:48:10.987611 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ef970b-9001-4c1c-9e40-3a6580351172 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:48:10.992296 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92304ee5-3ddd-45b1-ae36-929c44ebb509 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:48:10.997018 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea4607b-7865-40d8-a0ec-cc0c0912dc27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:48:10.997669 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea4607b-7865-40d8-a0ec-cc0c0912dc27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:10.997963 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea4607b-7865-40d8-a0ec-cc0c0912dc27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:10.998235 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea4607b-7865-40d8-a0ec-cc0c0912dc27 admin admin] PATH_INFO: `/v3/users/ac2ad7857c274a7a888c99beeb833c80` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:10.999417 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea4607b-7865-40d8-a0ec-cc0c0912dc27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac2ad7857c274a7a888c99beeb833c80)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:48:11.001617 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea4607b-7865-40d8-a0ec-cc0c0912dc27 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:48:11.010191 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1408/2815] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 2 21:48:10 2022] POST /identity/v3/users => generated 286 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:48:11.014216 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ef970b-9001-4c1c-9e40-3a6580351172 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:48:11.025153 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ef970b-9001-4c1c-9e40-3a6580351172 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:48:11.031200 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f99810-aeb1-4787-8d90-db80d78afc34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:48:11.031812 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f99810-aeb1-4787-8d90-db80d78afc34 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:11.032102 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f99810-aeb1-4787-8d90-db80d78afc34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:11.032541 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f99810-aeb1-4787-8d90-db80d78afc34 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:11.033459 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f99810-aeb1-4787-8d90-db80d78afc34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:48:11.035943 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f99810-aeb1-4787-8d90-db80d78afc34 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:48:11.051989 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1409/2816] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:48:11 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 21:48:11.053151 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f99810-aeb1-4787-8d90-db80d78afc34 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:48:11.063187 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-aea4607b-7865-40d8-a0ec-cc0c0912dc27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac2ad7857c274a7a888c99beeb833c80'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:48:11.063377 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f99810-aeb1-4787-8d90-db80d78afc34 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:48:11.068596 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb97c87-b24b-4536-9bdb-bcb7dfe6cad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:48:11.069395 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb97c87-b24b-4536-9bdb-bcb7dfe6cad7 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:11.069785 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb97c87-b24b-4536-9bdb-bcb7dfe6cad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:11.070071 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb97c87-b24b-4536-9bdb-bcb7dfe6cad7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:11.070775 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb97c87-b24b-4536-9bdb-bcb7dfe6cad7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:48:11.070892 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-aea4607b-7865-40d8-a0ec-cc0c0912dc27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac2ad7857c274a7a888c99beeb833c80'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:48:11.072596 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb97c87-b24b-4536-9bdb-bcb7dfe6cad7 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:48:11.082745 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1410/2817] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:48:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 02 21:48:11.086644 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-aea4607b-7865-40d8-a0ec-cc0c0912dc27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac2ad7857c274a7a888c99beeb833c80'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:48:11.086792 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb97c87-b24b-4536-9bdb-bcb7dfe6cad7 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:48:11.093777 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-aea4607b-7865-40d8-a0ec-cc0c0912dc27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac2ad7857c274a7a888c99beeb833c80'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:48:11.094488 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-aea4607b-7865-40d8-a0ec-cc0c0912dc27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac2ad7857c274a7a888c99beeb833c80'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:48:11.096547 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb97c87-b24b-4536-9bdb-bcb7dfe6cad7 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:48:11.101048 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1408/2818] 10.222.0.70 () {58 vars in 1224 bytes} [Tue Aug 2 21:48:10 2022] DELETE /identity/v3/users/ac2ad7857c274a7a888c99beeb833c80 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:48:11.101905 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477fc6fe-7df1-4377-bed0-7f480a83cc14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:48:11.102566 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477fc6fe-7df1-4377-bed0-7f480a83cc14 admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:11.102853 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477fc6fe-7df1-4377-bed0-7f480a83cc14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:11.103137 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477fc6fe-7df1-4377-bed0-7f480a83cc14 admin admin] PATH_INFO: `/v3/projects/f4e77399cf994276b8bd4bd435a8f13e/users/a99a7053baf442bca0033417c7eb56d1/roles/462e3381a85c42a9959201f9aa122f7c` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:11.105882 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca7056b-4983-48ad-84c8-423ad646eb92 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:11.106173 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca7056b-4983-48ad-84c8-423ad646eb92 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:11.106456 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca7056b-4983-48ad-84c8-423ad646eb92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:11.121935 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477fc6fe-7df1-4377-bed0-7f480a83cc14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4e77399cf994276b8bd4bd435a8f13e, user_id=a99a7053baf442bca0033417c7eb56d1, role_id=462e3381a85c42a9959201f9aa122f7c)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:48:11.124705 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477fc6fe-7df1-4377-bed0-7f480a83cc14 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:48:11.126455 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-7ca7056b-4983-48ad-84c8-423ad646eb92 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:48:11.127686 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-7ca7056b-4983-48ad-84c8-423ad646eb92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:48:11.140723 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1411/2819] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:48:11 2022] PUT /identity/v3/projects/f4e77399cf994276b8bd4bd435a8f13e/users/a99a7053baf442bca0033417c7eb56d1/roles/462e3381a85c42a9959201f9aa122f7c => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:48:11.145998 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df02875-1155-472e-8aa6-50d47043da01 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:11.146284 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df02875-1155-472e-8aa6-50d47043da01 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:11.146558 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df02875-1155-472e-8aa6-50d47043da01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:11.165481 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-0df02875-1155-472e-8aa6-50d47043da01 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:48:11.166774 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-0df02875-1155-472e-8aa6-50d47043da01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:48:11.196306 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1409/2820] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:48:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:48:11.206027 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca7056b-4983-48ad-84c8-423ad646eb92 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:48:11.207995 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-7ca7056b-4983-48ad-84c8-423ad646eb92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:48:11.232464 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1412/2821] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:48:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 02 21:48:11.242290 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df02875-1155-472e-8aa6-50d47043da01 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:48:11.243712 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-0df02875-1155-472e-8aa6-50d47043da01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:48:11.263736 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:48:11.276873 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca7056b-4983-48ad-84c8-423ad646eb92 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:48:11.304310 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df02875-1155-472e-8aa6-50d47043da01 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:48:11.307946 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbb267b-e13f-4a5a-af67-a0f7620a1410 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '723f5f43572a493dae0349070a2adb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:48:11.308596 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbb267b-e13f-4a5a-af67-a0f7620a1410 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:11.308880 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbb267b-e13f-4a5a-af67-a0f7620a1410 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:11.309154 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbb267b-e13f-4a5a-af67-a0f7620a1410 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:11.318156 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbb267b-e13f-4a5a-af67-a0f7620a1410 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:48:11.319585 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbb267b-e13f-4a5a-af67-a0f7620a1410 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:48:11.329028 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1413/2822] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:48:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 21:48:11.334222 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb4ea39-cbe0-46fa-a387-5ec55254ed09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '723f5f43572a493dae0349070a2adb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:48:11.334868 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb4ea39-cbe0-46fa-a387-5ec55254ed09 service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:11.335152 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb4ea39-cbe0-46fa-a387-5ec55254ed09 service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:11.335423 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb4ea39-cbe0-46fa-a387-5ec55254ed09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:11.345453 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb4ea39-cbe0-46fa-a387-5ec55254ed09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:48:11.346931 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb4ea39-cbe0-46fa-a387-5ec55254ed09 service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:48:11.358461 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1410/2823] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:48:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 21:48:11.748336 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbb267b-e13f-4a5a-af67-a0f7620a1410 service neutron] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:48:11.754415 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-2dbb267b-e13f-4a5a-af67-a0f7620a1410 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:48:11.779374 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbb267b-e13f-4a5a-af67-a0f7620a1410 service neutron] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:48:11.784096 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f69c34-ef03-43ec-b730-2616719d8fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:48:11.784964 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f69c34-ef03-43ec-b730-2616719d8fde admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:11.785826 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f69c34-ef03-43ec-b730-2616719d8fde admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:11.786301 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f69c34-ef03-43ec-b730-2616719d8fde admin admin] PATH_INFO: `/v3/projects/dcf2efbcf2f2484384272460c3b04d34` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:11.788438 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f69c34-ef03-43ec-b730-2616719d8fde admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcf2efbcf2f2484384272460c3b04d34)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:48:11.790855 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f69c34-ef03-43ec-b730-2616719d8fde admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:48:11.820496 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:48:11.863082 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-33f69c34-ef03-43ec-b730-2616719d8fde admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcf2efbcf2f2484384272460c3b04d34', 'request_id': 'req-33f69c34-ef03-43ec-b730-2616719d8fde'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:48:11.878846 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-33f69c34-ef03-43ec-b730-2616719d8fde admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcf2efbcf2f2484384272460c3b04d34', 'request_id': 'req-33f69c34-ef03-43ec-b730-2616719d8fde'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:48:11.887312 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-33f69c34-ef03-43ec-b730-2616719d8fde admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcf2efbcf2f2484384272460c3b04d34', 'request_id': 'req-33f69c34-ef03-43ec-b730-2616719d8fde'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:48:11.903192 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-33f69c34-ef03-43ec-b730-2616719d8fde admin admin] The token cache is being invalidate because project dcf2efbcf2f2484384272460c3b04d34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:48:11.903836 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-33f69c34-ef03-43ec-b730-2616719d8fde admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:48:11.904790 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-33f69c34-ef03-43ec-b730-2616719d8fde admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:48:11.906858 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1414/2824] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Aug 2 21:48:11 2022] DELETE /identity/v3/projects/dcf2efbcf2f2484384272460c3b04d34 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:48:15.717778 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f85007-ce33-49ba-bd02-3115b1c01504 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:15.719115 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f85007-ce33-49ba-bd02-3115b1c01504 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:15.719881 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f85007-ce33-49ba-bd02-3115b1c01504 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:15.758436 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-e8f85007-ce33-49ba-bd02-3115b1c01504 None None] MFA Rules not processed for user `a99a7053baf442bca0033417c7eb56d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:48:15.759699 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-e8f85007-ce33-49ba-bd02-3115b1c01504 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:48:15.841833 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1411/2825] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:48:15 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:48:15.846355 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f69c34-ef03-43ec-b730-2616719d8fde admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:48:15.847811 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-33f69c34-ef03-43ec-b730-2616719d8fde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:48:15.922383 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f69c34-ef03-43ec-b730-2616719d8fde admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:48:15.931462 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e728c6-a918-4804-847d-d204342a85a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:48:15.931462 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e728c6-a918-4804-847d-d204342a85a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:15.931462 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e728c6-a918-4804-847d-d204342a85a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:15.931462 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e728c6-a918-4804-847d-d204342a85a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:15.931971 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e728c6-a918-4804-847d-d204342a85a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:48:15.932670 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e728c6-a918-4804-847d-d204342a85a6 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:48:15.964921 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1415/2826] 10.222.0.70 () {60 vars in 1153 bytes} [Tue Aug 2 21:48:15 2022] POST /identity/v3/projects => generated 373 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:48:15.966058 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f85007-ce33-49ba-bd02-3115b1c01504 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:48:15.976864 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f85007-ce33-49ba-bd02-3115b1c01504 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:48:16.033237 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d8653f-760a-40df-8e0b-848274f06ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:48:16.033907 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d8653f-760a-40df-8e0b-848274f06ae2 admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:16.034189 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d8653f-760a-40df-8e0b-848274f06ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:16.034450 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d8653f-760a-40df-8e0b-848274f06ae2 admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:16.035187 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d8653f-760a-40df-8e0b-848274f06ae2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:48:16.037235 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d8653f-760a-40df-8e0b-848274f06ae2 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:48:16.063864 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1412/2827] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 2 21:48:15 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 21:48:16.065229 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e728c6-a918-4804-847d-d204342a85a6 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:48:16.076328 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e728c6-a918-4804-847d-d204342a85a6 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:48:16.081066 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f752e2d-ae53-4534-bb38-07211da07a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:48:16.081680 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f752e2d-ae53-4534-bb38-07211da07a2f admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:16.081983 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f752e2d-ae53-4534-bb38-07211da07a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:16.082266 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f752e2d-ae53-4534-bb38-07211da07a2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:16.082955 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f752e2d-ae53-4534-bb38-07211da07a2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:48:16.084603 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f752e2d-ae53-4534-bb38-07211da07a2f admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:48:16.095161 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1416/2828] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:48:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:48:16.099705 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d8653f-760a-40df-8e0b-848274f06ae2 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:48:16.109832 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d8653f-760a-40df-8e0b-848274f06ae2 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:48:16.115093 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f87e5f6-5176-4740-a940-81abd142504f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:48:16.115746 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f87e5f6-5176-4740-a940-81abd142504f admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:16.116031 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f87e5f6-5176-4740-a940-81abd142504f admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:16.116356 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f87e5f6-5176-4740-a940-81abd142504f admin admin] PATH_INFO: `/v3/projects/a5f7ba00f1d94c999b70e0fd36d3fc21/users/7ff036b1ebfc43dc8344da48d9e81f45/roles/3e32dbf75f9b41f5adb9fe59851267bb` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:16.130919 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f87e5f6-5176-4740-a940-81abd142504f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5f7ba00f1d94c999b70e0fd36d3fc21, user_id=7ff036b1ebfc43dc8344da48d9e81f45, role_id=3e32dbf75f9b41f5adb9fe59851267bb)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:48:16.133629 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f87e5f6-5176-4740-a940-81abd142504f admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:48:16.142995 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:48:16.152260 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1413/2829] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:48:16 2022] PUT /identity/v3/projects/a5f7ba00f1d94c999b70e0fd36d3fc21/users/7ff036b1ebfc43dc8344da48d9e81f45/roles/3e32dbf75f9b41f5adb9fe59851267bb => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:48:16.156281 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f752e2d-ae53-4534-bb38-07211da07a2f admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:48:16.167094 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f752e2d-ae53-4534-bb38-07211da07a2f admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:48:16.223578 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad80e85a-d1ff-49a8-9c3b-5528643dae20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:48:16.224209 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad80e85a-d1ff-49a8-9c3b-5528643dae20 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:16.224521 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad80e85a-d1ff-49a8-9c3b-5528643dae20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:16.224799 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad80e85a-d1ff-49a8-9c3b-5528643dae20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:16.225497 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad80e85a-d1ff-49a8-9c3b-5528643dae20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:48:16.227079 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad80e85a-d1ff-49a8-9c3b-5528643dae20 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:48:16.240692 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1417/2830] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:48:16 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:48:16.244627 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f87e5f6-5176-4740-a940-81abd142504f admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:48:16.257302 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f87e5f6-5176-4740-a940-81abd142504f admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:48:16.262367 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ee680c-ea80-4d3d-ad93-96a77420e3f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:48:16.263046 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ee680c-ea80-4d3d-ad93-96a77420e3f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:16.263330 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ee680c-ea80-4d3d-ad93-96a77420e3f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:16.263608 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ee680c-ea80-4d3d-ad93-96a77420e3f0 admin admin] PATH_INFO: `/v3/projects/a5f7ba00f1d94c999b70e0fd36d3fc21/users/7ff036b1ebfc43dc8344da48d9e81f45/roles/3e32dbf75f9b41f5adb9fe59851267bb` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:16.265640 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ee680c-ea80-4d3d-ad93-96a77420e3f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5f7ba00f1d94c999b70e0fd36d3fc21, user_id=7ff036b1ebfc43dc8344da48d9e81f45, role_id=3e32dbf75f9b41f5adb9fe59851267bb)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:48:16.268390 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ee680c-ea80-4d3d-ad93-96a77420e3f0 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:48:16.279388 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1414/2831] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:48:16 2022] PUT /identity/v3/projects/a5f7ba00f1d94c999b70e0fd36d3fc21/users/7ff036b1ebfc43dc8344da48d9e81f45/roles/3e32dbf75f9b41f5adb9fe59851267bb => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:48:20.933176 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a81f90-3f71-4f36-b60e-cc55a75a5bb7 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:20.934096 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a81f90-3f71-4f36-b60e-cc55a75a5bb7 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:20.934384 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a81f90-3f71-4f36-b60e-cc55a75a5bb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:20.973974 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-03a81f90-3f71-4f36-b60e-cc55a75a5bb7 None None] MFA Rules not processed for user `7ff036b1ebfc43dc8344da48d9e81f45`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:48:20.975526 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-03a81f90-3f71-4f36-b60e-cc55a75a5bb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:48:20.981752 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:48:21.064296 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1418/2832] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:48:20 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:48:21.082354 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ee680c-ea80-4d3d-ad93-96a77420e3f0 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:48:21.084136 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-12ee680c-ea80-4d3d-ad93-96a77420e3f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:48:21.174588 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ee680c-ea80-4d3d-ad93-96a77420e3f0 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:48:21.180186 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f5308c-af7e-4b75-8107-301cd9126e37 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87dd5c1c5e854d4b96e0b7dad6aa3719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:48:21.180843 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f5308c-af7e-4b75-8107-301cd9126e37 service nova] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:21.181136 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f5308c-af7e-4b75-8107-301cd9126e37 service nova] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:21.181444 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f5308c-af7e-4b75-8107-301cd9126e37 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:21.242474 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f5308c-af7e-4b75-8107-301cd9126e37 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:48:21.244412 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f5308c-af7e-4b75-8107-301cd9126e37 service nova] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:48:21.254535 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1415/2833] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:48:21 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:48:22.293491 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c1ad5-4ade-4ec5-84e9-a4f173025ade None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:22.293984 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c1ad5-4ade-4ec5-84e9-a4f173025ade None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:22.294096 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c1ad5-4ade-4ec5-84e9-a4f173025ade None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:22.313620 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-5f8c1ad5-4ade-4ec5-84e9-a4f173025ade None None] MFA Rules not processed for user `a99a7053baf442bca0033417c7eb56d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:48:22.314926 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-5f8c1ad5-4ade-4ec5-84e9-a4f173025ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:48:22.321940 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1419/2834] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:48:22 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:48:31.250201 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=62,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:48:32.200808 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f5308c-af7e-4b75-8107-301cd9126e37 service nova] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:48:32.202228 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-f9f5308c-af7e-4b75-8107-301cd9126e37 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:48:32.273159 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f5308c-af7e-4b75-8107-301cd9126e37 service nova] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:48:32.278742 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1cf090-7084-4953-905f-07ab61968c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:48:32.279435 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1cf090-7084-4953-905f-07ab61968c3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:32.279753 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1cf090-7084-4953-905f-07ab61968c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:32.280051 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1cf090-7084-4953-905f-07ab61968c3f admin admin] PATH_INFO: `/v3/users/18ad12945df746e7a026118d983fb49c` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:32.281545 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1cf090-7084-4953-905f-07ab61968c3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=18ad12945df746e7a026118d983fb49c)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:48:32.283718 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1cf090-7084-4953-905f-07ab61968c3f admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:48:32.308140 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=29 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:48:32.333158 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-4a1cf090-7084-4953-905f-07ab61968c3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18ad12945df746e7a026118d983fb49c'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:48:32.342113 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-4a1cf090-7084-4953-905f-07ab61968c3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18ad12945df746e7a026118d983fb49c'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:48:32.354165 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-4a1cf090-7084-4953-905f-07ab61968c3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18ad12945df746e7a026118d983fb49c'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:48:32.361404 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-4a1cf090-7084-4953-905f-07ab61968c3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18ad12945df746e7a026118d983fb49c'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:48:32.362123 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-4a1cf090-7084-4953-905f-07ab61968c3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18ad12945df746e7a026118d983fb49c'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:48:32.369443 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1416/2835] 10.222.0.70 () {58 vars in 1224 bytes} [Tue Aug 2 21:48:32 2022] DELETE /identity/v3/users/18ad12945df746e7a026118d983fb49c => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:48:32.374260 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c5fb95-887d-4c0b-ba4f-bd2ef495ceee None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:32.374580 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c5fb95-887d-4c0b-ba4f-bd2ef495ceee None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:32.374856 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c5fb95-887d-4c0b-ba4f-bd2ef495ceee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:32.393689 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-e7c5fb95-887d-4c0b-ba4f-bd2ef495ceee None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:48:32.394815 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-e7c5fb95-887d-4c0b-ba4f-bd2ef495ceee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:48:32.454383 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1420/2836] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:48:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:48:32.464870 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1cf090-7084-4953-905f-07ab61968c3f admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:48:32.466306 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-4a1cf090-7084-4953-905f-07ab61968c3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:48:32.528766 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1cf090-7084-4953-905f-07ab61968c3f admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:48:32.532760 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059fe22c-97e0-4178-b7f8-8dce85c25bc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '723f5f43572a493dae0349070a2adb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:48:32.533431 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059fe22c-97e0-4178-b7f8-8dce85c25bc8 service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:32.533717 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059fe22c-97e0-4178-b7f8-8dce85c25bc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:32.533996 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059fe22c-97e0-4178-b7f8-8dce85c25bc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:32.546441 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059fe22c-97e0-4178-b7f8-8dce85c25bc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:48:32.547885 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059fe22c-97e0-4178-b7f8-8dce85c25bc8 service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:48:32.560475 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1417/2837] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:48:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:48:32.836084 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c5fb95-887d-4c0b-ba4f-bd2ef495ceee None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:48:32.837698 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-e7c5fb95-887d-4c0b-ba4f-bd2ef495ceee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:48:32.850329 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c5fb95-887d-4c0b-ba4f-bd2ef495ceee None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:48:32.855386 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f24844-c389-4b68-aa32-23d7b6244daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:48:32.856037 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f24844-c389-4b68-aa32-23d7b6244daf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:32.856376 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f24844-c389-4b68-aa32-23d7b6244daf admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:32.856673 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f24844-c389-4b68-aa32-23d7b6244daf admin admin] PATH_INFO: `/v3/projects/b2ebb0f531b84698a2cfc119480d81e4` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:32.857854 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f24844-c389-4b68-aa32-23d7b6244daf admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2ebb0f531b84698a2cfc119480d81e4)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:48:32.859874 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f24844-c389-4b68-aa32-23d7b6244daf admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:48:32.917798 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-35f24844-c389-4b68-aa32-23d7b6244daf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2ebb0f531b84698a2cfc119480d81e4', 'request_id': 'req-35f24844-c389-4b68-aa32-23d7b6244daf'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:48:32.925407 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-35f24844-c389-4b68-aa32-23d7b6244daf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2ebb0f531b84698a2cfc119480d81e4', 'request_id': 'req-35f24844-c389-4b68-aa32-23d7b6244daf'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:48:32.931786 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-35f24844-c389-4b68-aa32-23d7b6244daf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2ebb0f531b84698a2cfc119480d81e4', 'request_id': 'req-35f24844-c389-4b68-aa32-23d7b6244daf'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:48:32.943335 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-35f24844-c389-4b68-aa32-23d7b6244daf admin admin] The token cache is being invalidate because project b2ebb0f531b84698a2cfc119480d81e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:48:32.943629 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-35f24844-c389-4b68-aa32-23d7b6244daf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:48:32.944295 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-35f24844-c389-4b68-aa32-23d7b6244daf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:48:32.946220 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1421/2838] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Aug 2 21:48:32 2022] DELETE /identity/v3/projects/b2ebb0f531b84698a2cfc119480d81e4 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:48:32.951170 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e849dac-c71e-47e6-8a9a-da8d9fa0ecb4 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:32.951460 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e849dac-c71e-47e6-8a9a-da8d9fa0ecb4 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:32.951768 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e849dac-c71e-47e6-8a9a-da8d9fa0ecb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:32.971652 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-4e849dac-c71e-47e6-8a9a-da8d9fa0ecb4 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:48:32.972983 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-4e849dac-c71e-47e6-8a9a-da8d9fa0ecb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:48:32.993104 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:48:33.037097 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1418/2839] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:48:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:48:33.047315 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c13caa-091b-4981-b296-04a6799191b8 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:33.048001 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c13caa-091b-4981-b296-04a6799191b8 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:33.048291 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c13caa-091b-4981-b296-04a6799191b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:33.068432 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-d1c13caa-091b-4981-b296-04a6799191b8 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:48:33.069645 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-d1c13caa-091b-4981-b296-04a6799191b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:48:33.077924 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1422/2840] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:48:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:48:33.082213 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e849dac-c71e-47e6-8a9a-da8d9fa0ecb4 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:48:33.092856 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e849dac-c71e-47e6-8a9a-da8d9fa0ecb4 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:48:33.097516 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fd400f-5525-4a73-bd15-69890f843385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:48:33.098132 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fd400f-5525-4a73-bd15-69890f843385 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:33.098974 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fd400f-5525-4a73-bd15-69890f843385 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:33.099257 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fd400f-5525-4a73-bd15-69890f843385 admin admin] PATH_INFO: `/v3/domains` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:33.099955 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fd400f-5525-4a73-bd15-69890f843385 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80420) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:48:33.100296 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fd400f-5525-4a73-bd15-69890f843385 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:48:33.101908 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fd400f-5525-4a73-bd15-69890f843385 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:48:33.114159 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1419/2841] 10.222.0.70 () {58 vars in 1153 bytes} [Tue Aug 2 21:48:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:48:33.118469 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c13caa-091b-4981-b296-04a6799191b8 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:48:33.129028 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c13caa-091b-4981-b296-04a6799191b8 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:48:33.134155 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cad4d9c-2a47-45cf-914f-eb2bfbc9d099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:48:33.134795 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad4d9c-2a47-45cf-914f-eb2bfbc9d099 admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:33.135079 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad4d9c-2a47-45cf-914f-eb2bfbc9d099 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:33.135374 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad4d9c-2a47-45cf-914f-eb2bfbc9d099 admin admin] PATH_INFO: `/v3/projects` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:33.139205 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cad4d9c-2a47-45cf-914f-eb2bfbc9d099 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:48:33.139205 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cad4d9c-2a47-45cf-914f-eb2bfbc9d099 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:48:33.166862 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1423/2842] 10.222.0.70 () {60 vars in 1153 bytes} [Tue Aug 2 21:48:33 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:48:33.171323 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fd400f-5525-4a73-bd15-69890f843385 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:48:33.181174 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fd400f-5525-4a73-bd15-69890f843385 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:48:33.241638 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f72b68-b2bd-4302-b9b5-00f71cdb090e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:48:33.242260 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f72b68-b2bd-4302-b9b5-00f71cdb090e admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:33.242548 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f72b68-b2bd-4302-b9b5-00f71cdb090e admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:33.242828 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f72b68-b2bd-4302-b9b5-00f71cdb090e admin admin] PATH_INFO: `/v3/users` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:33.243494 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f72b68-b2bd-4302-b9b5-00f71cdb090e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:48:33.245457 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f72b68-b2bd-4302-b9b5-00f71cdb090e admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:48:33.269260 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1420/2843] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 2 21:48:33 2022] POST /identity/v3/users => generated 288 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:48:33.272364 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cad4d9c-2a47-45cf-914f-eb2bfbc9d099 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:48:33.282631 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cad4d9c-2a47-45cf-914f-eb2bfbc9d099 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:48:33.291756 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e6ba8a-d5d8-4e91-b415-dd1d246943f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:48:33.291756 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e6ba8a-d5d8-4e91-b415-dd1d246943f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:33.291756 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e6ba8a-d5d8-4e91-b415-dd1d246943f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:33.291756 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e6ba8a-d5d8-4e91-b415-dd1d246943f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:33.292403 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e6ba8a-d5d8-4e91-b415-dd1d246943f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:48:33.292403 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e6ba8a-d5d8-4e91-b415-dd1d246943f2 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:48:33.306191 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1424/2844] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:48:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:48:33.307282 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f72b68-b2bd-4302-b9b5-00f71cdb090e admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:48:33.317940 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f72b68-b2bd-4302-b9b5-00f71cdb090e admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:48:33.322625 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a04343d-5fbf-44fb-8a23-3d18eff768a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:48:33.323230 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a04343d-5fbf-44fb-8a23-3d18eff768a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:33.323515 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a04343d-5fbf-44fb-8a23-3d18eff768a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:33.323795 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a04343d-5fbf-44fb-8a23-3d18eff768a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:33.324518 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a04343d-5fbf-44fb-8a23-3d18eff768a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:48:33.326110 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a04343d-5fbf-44fb-8a23-3d18eff768a5 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:48:33.337346 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1421/2845] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:48:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:48:33.341414 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e6ba8a-d5d8-4e91-b415-dd1d246943f2 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:48:33.351496 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e6ba8a-d5d8-4e91-b415-dd1d246943f2 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:48:33.356421 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e872a3-7c32-4010-9307-2b522bdcad5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:48:33.357077 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e872a3-7c32-4010-9307-2b522bdcad5a admin admin] REQUEST_METHOD: `PUT` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:33.357359 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e872a3-7c32-4010-9307-2b522bdcad5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:33.357639 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e872a3-7c32-4010-9307-2b522bdcad5a admin admin] PATH_INFO: `/v3/projects/1f1d06802c9342be9efc3350f70a65ef/users/11cc689e03ee408f85d8c46453653fcb/roles/462e3381a85c42a9959201f9aa122f7c` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:33.373243 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e872a3-7c32-4010-9307-2b522bdcad5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f1d06802c9342be9efc3350f70a65ef, user_id=11cc689e03ee408f85d8c46453653fcb, role_id=462e3381a85c42a9959201f9aa122f7c)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:48:33.375980 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e872a3-7c32-4010-9307-2b522bdcad5a admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:48:33.389849 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1425/2846] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:48:33 2022] PUT /identity/v3/projects/1f1d06802c9342be9efc3350f70a65ef/users/11cc689e03ee408f85d8c46453653fcb/roles/462e3381a85c42a9959201f9aa122f7c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:48:33.400758 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6014d739-9a79-4e9a-96ae-b24afa7baf2e None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:33.401047 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6014d739-9a79-4e9a-96ae-b24afa7baf2e None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:33.401325 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6014d739-9a79-4e9a-96ae-b24afa7baf2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:33.428163 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-6014d739-9a79-4e9a-96ae-b24afa7baf2e None None] MFA Rules not processed for user `11cc689e03ee408f85d8c46453653fcb`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:48:33.429312 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-6014d739-9a79-4e9a-96ae-b24afa7baf2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:48:33.496275 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1422/2847] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:48:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:48:33.507277 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e872a3-7c32-4010-9307-2b522bdcad5a admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:48:33.509047 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-57e872a3-7c32-4010-9307-2b522bdcad5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:48:33.531480 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:48:33.569900 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e872a3-7c32-4010-9307-2b522bdcad5a admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:48:33.573881 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc88d48-8baa-4356-a6a7-612fe9347c5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '123eb76f95ee4e39905944da701c712d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:48:33.574543 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc88d48-8baa-4356-a6a7-612fe9347c5b service cinder] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:33.574811 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc88d48-8baa-4356-a6a7-612fe9347c5b service cinder] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:33.575080 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc88d48-8baa-4356-a6a7-612fe9347c5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:33.584985 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc88d48-8baa-4356-a6a7-612fe9347c5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:48:33.586437 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc88d48-8baa-4356-a6a7-612fe9347c5b service cinder] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:48:33.595345 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1426/2848] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:48:33 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:48:38.910175 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6014d739-9a79-4e9a-96ae-b24afa7baf2e None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:48:38.911688 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-6014d739-9a79-4e9a-96ae-b24afa7baf2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:48:38.931977 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:48:38.970973 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6014d739-9a79-4e9a-96ae-b24afa7baf2e None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:48:38.984804 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e04e33-ada3-4089-9b48-410804693e3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '723f5f43572a493dae0349070a2adb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:48:38.984804 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e04e33-ada3-4089-9b48-410804693e3b service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:38.984804 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e04e33-ada3-4089-9b48-410804693e3b service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:38.984804 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e04e33-ada3-4089-9b48-410804693e3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:38.985219 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-49e04e33-ada3-4089-9b48-410804693e3b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:48:38.989377 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e04e33-ada3-4089-9b48-410804693e3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:48:38.990967 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e04e33-ada3-4089-9b48-410804693e3b service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:48:38.999826 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1423/2849] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:48:38 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:48:43.450229 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc88d48-8baa-4356-a6a7-612fe9347c5b service cinder] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:48:43.514000 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc88d48-8baa-4356-a6a7-612fe9347c5b service cinder] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:48:43.518504 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4af110-ccc6-4dbf-9bd9-ed00f5a69346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:48:43.519133 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4af110-ccc6-4dbf-9bd9-ed00f5a69346 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:43.519414 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4af110-ccc6-4dbf-9bd9-ed00f5a69346 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:43.519691 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4af110-ccc6-4dbf-9bd9-ed00f5a69346 admin admin] PATH_INFO: `/v3/users/11cc689e03ee408f85d8c46453653fcb` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:43.520860 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4af110-ccc6-4dbf-9bd9-ed00f5a69346 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11cc689e03ee408f85d8c46453653fcb)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:48:43.522778 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4af110-ccc6-4dbf-9bd9-ed00f5a69346 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:48:43.570534 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-2a4af110-ccc6-4dbf-9bd9-ed00f5a69346 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11cc689e03ee408f85d8c46453653fcb'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:48:43.578178 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-2a4af110-ccc6-4dbf-9bd9-ed00f5a69346 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11cc689e03ee408f85d8c46453653fcb'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:48:43.590552 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-2a4af110-ccc6-4dbf-9bd9-ed00f5a69346 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11cc689e03ee408f85d8c46453653fcb'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:48:43.591227 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-2a4af110-ccc6-4dbf-9bd9-ed00f5a69346 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11cc689e03ee408f85d8c46453653fcb'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:48:43.598238 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-2a4af110-ccc6-4dbf-9bd9-ed00f5a69346 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11cc689e03ee408f85d8c46453653fcb'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:48:43.604868 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1427/2850] 10.222.0.70 () {58 vars in 1224 bytes} [Tue Aug 2 21:48:43 2022] DELETE /identity/v3/users/11cc689e03ee408f85d8c46453653fcb => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:48:43.609869 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e2025-15b6-49b6-a29c-b28d142d440f None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:43.610341 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e2025-15b6-49b6-a29c-b28d142d440f None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:43.610440 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e2025-15b6-49b6-a29c-b28d142d440f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:43.629651 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-d59e2025-15b6-49b6-a29c-b28d142d440f None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:48:43.630857 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-d59e2025-15b6-49b6-a29c-b28d142d440f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:48:43.691352 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1424/2851] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:48:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:48:43.701490 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4af110-ccc6-4dbf-9bd9-ed00f5a69346 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:48:43.702937 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-2a4af110-ccc6-4dbf-9bd9-ed00f5a69346 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:48:43.750595 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:48:43.765476 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4af110-ccc6-4dbf-9bd9-ed00f5a69346 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:48:43.769576 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4045d4-d50a-4937-a724-75b90af19744 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '723f5f43572a493dae0349070a2adb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:48:43.770302 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4045d4-d50a-4937-a724-75b90af19744 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:43.770602 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4045d4-d50a-4937-a724-75b90af19744 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:43.770878 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4045d4-d50a-4937-a724-75b90af19744 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:43.780468 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4045d4-d50a-4937-a724-75b90af19744 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:48:43.781992 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4045d4-d50a-4937-a724-75b90af19744 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:48:43.792692 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1428/2852] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:48:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:48:44.115647 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59e2025-15b6-49b6-a29c-b28d142d440f None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:48:44.117361 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-d59e2025-15b6-49b6-a29c-b28d142d440f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:48:44.129211 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59e2025-15b6-49b6-a29c-b28d142d440f None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:48:44.134340 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de5a257-3080-4c02-808a-fb9de651bf13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:48:44.134982 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de5a257-3080-4c02-808a-fb9de651bf13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:44.135266 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de5a257-3080-4c02-808a-fb9de651bf13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:44.135543 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de5a257-3080-4c02-808a-fb9de651bf13 admin admin] PATH_INFO: `/v3/projects/1f1d06802c9342be9efc3350f70a65ef` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:44.136730 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de5a257-3080-4c02-808a-fb9de651bf13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f1d06802c9342be9efc3350f70a65ef)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:48:44.138646 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de5a257-3080-4c02-808a-fb9de651bf13 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:48:44.194759 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-8de5a257-3080-4c02-808a-fb9de651bf13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f1d06802c9342be9efc3350f70a65ef', 'request_id': 'req-8de5a257-3080-4c02-808a-fb9de651bf13'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:48:44.200479 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-8de5a257-3080-4c02-808a-fb9de651bf13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f1d06802c9342be9efc3350f70a65ef', 'request_id': 'req-8de5a257-3080-4c02-808a-fb9de651bf13'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:48:44.208165 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-8de5a257-3080-4c02-808a-fb9de651bf13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f1d06802c9342be9efc3350f70a65ef', 'request_id': 'req-8de5a257-3080-4c02-808a-fb9de651bf13'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:48:44.219393 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-8de5a257-3080-4c02-808a-fb9de651bf13 admin admin] The token cache is being invalidate because project 1f1d06802c9342be9efc3350f70a65ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:48:44.219674 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-8de5a257-3080-4c02-808a-fb9de651bf13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:48:44.220328 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-8de5a257-3080-4c02-808a-fb9de651bf13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:48:44.221841 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1425/2853] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Aug 2 21:48:44 2022] DELETE /identity/v3/projects/1f1d06802c9342be9efc3350f70a65ef => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:48:44.227149 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41663ce-5fad-4200-a14d-f12f58755b3e None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:44.227460 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41663ce-5fad-4200-a14d-f12f58755b3e None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:44.227736 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41663ce-5fad-4200-a14d-f12f58755b3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:44.248263 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-b41663ce-5fad-4200-a14d-f12f58755b3e None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:48:44.249467 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-b41663ce-5fad-4200-a14d-f12f58755b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:48:44.310197 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1429/2854] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:48:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:48:44.319045 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47f8552-5e4d-43ba-a3c2-5009506679a0 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:44.319336 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47f8552-5e4d-43ba-a3c2-5009506679a0 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:44.319617 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47f8552-5e4d-43ba-a3c2-5009506679a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:44.339011 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-a47f8552-5e4d-43ba-a3c2-5009506679a0 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:48:44.340308 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-a47f8552-5e4d-43ba-a3c2-5009506679a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:48:44.349272 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1426/2855] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:48:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:48:44.353441 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41663ce-5fad-4200-a14d-f12f58755b3e None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:48:44.363625 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41663ce-5fad-4200-a14d-f12f58755b3e None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:48:44.368792 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef23e702-d967-49b7-b55b-646ab1cab18e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:48:44.369398 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef23e702-d967-49b7-b55b-646ab1cab18e admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:44.369683 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef23e702-d967-49b7-b55b-646ab1cab18e admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:44.369979 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef23e702-d967-49b7-b55b-646ab1cab18e admin admin] PATH_INFO: `/v3/domains` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:44.370682 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef23e702-d967-49b7-b55b-646ab1cab18e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80419) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 02 21:48:44.370990 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef23e702-d967-49b7-b55b-646ab1cab18e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:48:44.372658 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef23e702-d967-49b7-b55b-646ab1cab18e admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:48:44.384019 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1430/2856] 10.222.0.70 () {58 vars in 1153 bytes} [Tue Aug 2 21:48:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 02 21:48:44.388215 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47f8552-5e4d-43ba-a3c2-5009506679a0 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:48:44.397559 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47f8552-5e4d-43ba-a3c2-5009506679a0 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:48:44.402193 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f41690-c059-4eeb-b501-092b4fb5974a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:48:44.402795 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f41690-c059-4eeb-b501-092b4fb5974a admin admin] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:44.403076 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f41690-c059-4eeb-b501-092b4fb5974a admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:44.403350 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f41690-c059-4eeb-b501-092b4fb5974a admin admin] PATH_INFO: `/v3/projects` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:44.404017 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f41690-c059-4eeb-b501-092b4fb5974a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:48:44.405959 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f41690-c059-4eeb-b501-092b4fb5974a admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:48:44.434448 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1427/2857] 10.222.0.70 () {60 vars in 1153 bytes} [Tue Aug 2 21:48:44 2022] POST /identity/v3/projects => generated 381 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 02 21:48:44.438578 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef23e702-d967-49b7-b55b-646ab1cab18e admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:48:44.450566 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef23e702-d967-49b7-b55b-646ab1cab18e admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:48:44.508180 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b90c85-411f-44d8-af02-3e3acefee90c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:48:44.508823 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b90c85-411f-44d8-af02-3e3acefee90c admin admin] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:44.509134 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b90c85-411f-44d8-af02-3e3acefee90c admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:44.509416 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b90c85-411f-44d8-af02-3e3acefee90c admin admin] PATH_INFO: `/v3/users` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:44.510086 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b90c85-411f-44d8-af02-3e3acefee90c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:48:44.512045 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b90c85-411f-44d8-af02-3e3acefee90c admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:48:44.533083 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1431/2858] 10.222.0.70 () {60 vars in 1144 bytes} [Tue Aug 2 21:48:44 2022] POST /identity/v3/users => generated 291 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 02 21:48:44.537744 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f41690-c059-4eeb-b501-092b4fb5974a admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:48:44.548160 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f41690-c059-4eeb-b501-092b4fb5974a admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:48:44.553532 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7e6020-3afe-4b66-b7e7-b8eb1e1159eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:48:44.554142 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7e6020-3afe-4b66-b7e7-b8eb1e1159eb admin admin] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:44.554426 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7e6020-3afe-4b66-b7e7-b8eb1e1159eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:44.554704 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7e6020-3afe-4b66-b7e7-b8eb1e1159eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:44.555389 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7e6020-3afe-4b66-b7e7-b8eb1e1159eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:48:44.557050 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7e6020-3afe-4b66-b7e7-b8eb1e1159eb admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:48:44.566893 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1428/2859] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:48:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:48:44.571068 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b90c85-411f-44d8-af02-3e3acefee90c admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:48:44.581511 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b90c85-411f-44d8-af02-3e3acefee90c admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:48:44.586721 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de45c00-4211-4533-9fcf-47d4652f9511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:48:44.587355 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de45c00-4211-4533-9fcf-47d4652f9511 admin admin] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:44.587637 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de45c00-4211-4533-9fcf-47d4652f9511 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:44.587917 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de45c00-4211-4533-9fcf-47d4652f9511 admin admin] PATH_INFO: `/v3/roles` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:44.588648 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de45c00-4211-4533-9fcf-47d4652f9511 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:48:44.590323 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de45c00-4211-4533-9fcf-47d4652f9511 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:48:44.601364 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1432/2860] 10.222.0.70 () {58 vars in 1122 bytes} [Tue Aug 2 21:48:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 02 21:48:44.606017 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7e6020-3afe-4b66-b7e7-b8eb1e1159eb admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:48:44.612543 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:48:44.616505 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7e6020-3afe-4b66-b7e7-b8eb1e1159eb admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:48:44.623086 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b016644d-77a0-443b-93b5-4cfab4614c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:48:44.624028 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b016644d-77a0-443b-93b5-4cfab4614c92 admin admin] REQUEST_METHOD: `PUT` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:44.624404 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b016644d-77a0-443b-93b5-4cfab4614c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:44.624852 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b016644d-77a0-443b-93b5-4cfab4614c92 admin admin] PATH_INFO: `/v3/projects/16f26363c7fd414da1c9e0d1e8b0984f/users/974157258da8410cbb638cb1a1c53b9d/roles/462e3381a85c42a9959201f9aa122f7c` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:44.640400 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b016644d-77a0-443b-93b5-4cfab4614c92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16f26363c7fd414da1c9e0d1e8b0984f, user_id=974157258da8410cbb638cb1a1c53b9d, role_id=462e3381a85c42a9959201f9aa122f7c)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:48:44.643073 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b016644d-77a0-443b-93b5-4cfab4614c92 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:48:44.656950 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1429/2861] 10.222.0.70 () {60 vars in 1483 bytes} [Tue Aug 2 21:48:44 2022] PUT /identity/v3/projects/16f26363c7fd414da1c9e0d1e8b0984f/users/974157258da8410cbb638cb1a1c53b9d/roles/462e3381a85c42a9959201f9aa122f7c => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:48:44.662661 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71f268c-a5b5-4f9c-b8b5-a7e62d6fac25 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:44.662950 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71f268c-a5b5-4f9c-b8b5-a7e62d6fac25 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:44.663227 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71f268c-a5b5-4f9c-b8b5-a7e62d6fac25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:44.682570 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-e71f268c-a5b5-4f9c-b8b5-a7e62d6fac25 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:48:44.683785 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-e71f268c-a5b5-4f9c-b8b5-a7e62d6fac25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:48:44.729344 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:48:44.744068 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1433/2862] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:48:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:48:44.753879 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b016644d-77a0-443b-93b5-4cfab4614c92 admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:48:44.755578 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-b016644d-77a0-443b-93b5-4cfab4614c92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:48:44.814154 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b016644d-77a0-443b-93b5-4cfab4614c92 admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:48:44.817869 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ccc6a2-6c2c-49fa-adcb-bcad7e080041 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '723f5f43572a493dae0349070a2adb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:48:44.818490 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ccc6a2-6c2c-49fa-adcb-bcad7e080041 service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:44.818776 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ccc6a2-6c2c-49fa-adcb-bcad7e080041 service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:44.819053 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ccc6a2-6c2c-49fa-adcb-bcad7e080041 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:44.828095 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ccc6a2-6c2c-49fa-adcb-bcad7e080041 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:48:44.829576 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ccc6a2-6c2c-49fa-adcb-bcad7e080041 service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:48:44.839872 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1430/2863] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:48:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:48:45.539573 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b176c2cc-94e9-46b6-8a52-4d90d29cc7b1 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:45.540131 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b176c2cc-94e9-46b6-8a52-4d90d29cc7b1 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:45.540377 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b176c2cc-94e9-46b6-8a52-4d90d29cc7b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:45.572547 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-b176c2cc-94e9-46b6-8a52-4d90d29cc7b1 None None] MFA Rules not processed for user `974157258da8410cbb638cb1a1c53b9d`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:48:45.574297 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-b176c2cc-94e9-46b6-8a52-4d90d29cc7b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:48:45.644185 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1434/2864] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:48:45 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:48:45.655898 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ccc6a2-6c2c-49fa-adcb-bcad7e080041 service neutron] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:48:45.657320 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-05ccc6a2-6c2c-49fa-adcb-bcad7e080041 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:48:45.720762 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ccc6a2-6c2c-49fa-adcb-bcad7e080041 service neutron] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:48:45.724412 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86521231-2855-4cdd-ae9c-352d7556aee9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '123eb76f95ee4e39905944da701c712d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:48:45.725034 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86521231-2855-4cdd-ae9c-352d7556aee9 service cinder] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:45.725348 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86521231-2855-4cdd-ae9c-352d7556aee9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:45.725628 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86521231-2855-4cdd-ae9c-352d7556aee9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:45.735135 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86521231-2855-4cdd-ae9c-352d7556aee9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:48:45.736635 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86521231-2855-4cdd-ae9c-352d7556aee9 service cinder] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:48:45.745739 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1431/2865] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:48:45 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:48:47.113373 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d8c708-a9a1-4e09-8965-b97428a8a4f7 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:47.113881 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d8c708-a9a1-4e09-8965-b97428a8a4f7 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:47.113993 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d8c708-a9a1-4e09-8965-b97428a8a4f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:47.134923 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-29d8c708-a9a1-4e09-8965-b97428a8a4f7 None None] MFA Rules not processed for user `974157258da8410cbb638cb1a1c53b9d`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:48:47.136132 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-29d8c708-a9a1-4e09-8965-b97428a8a4f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:48:47.142985 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1435/2866] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:48:47 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:48:47.383966 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86521231-2855-4cdd-ae9c-352d7556aee9 service cinder] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:48:47.385439 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-86521231-2855-4cdd-ae9c-352d7556aee9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:48:47.397506 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86521231-2855-4cdd-ae9c-352d7556aee9 service cinder] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:48:47.401280 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e4984b-b8d5-48e5-a827-352ddd3e6cae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '723f5f43572a493dae0349070a2adb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:48:47.401904 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e4984b-b8d5-48e5-a827-352ddd3e6cae service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:47.402188 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e4984b-b8d5-48e5-a827-352ddd3e6cae service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:47.402464 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e4984b-b8d5-48e5-a827-352ddd3e6cae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:47.404210 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-11e4984b-b8d5-48e5-a827-352ddd3e6cae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:48:47.415462 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e4984b-b8d5-48e5-a827-352ddd3e6cae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:48:47.417104 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e4984b-b8d5-48e5-a827-352ddd3e6cae service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:48:47.425973 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1432/2867] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:48:47 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:48:50.495460 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d8c708-a9a1-4e09-8965-b97428a8a4f7 None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:48:50.506163 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d8c708-a9a1-4e09-8965-b97428a8a4f7 None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:48:50.510202 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658d6fc3-907a-4f35-967b-e167fcfd52d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '723f5f43572a493dae0349070a2adb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:48:50.510940 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658d6fc3-907a-4f35-967b-e167fcfd52d5 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:50.511211 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658d6fc3-907a-4f35-967b-e167fcfd52d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:50.511489 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658d6fc3-907a-4f35-967b-e167fcfd52d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:50.513348 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-658d6fc3-907a-4f35-967b-e167fcfd52d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:48:50.586432 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658d6fc3-907a-4f35-967b-e167fcfd52d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:48:50.587824 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658d6fc3-907a-4f35-967b-e167fcfd52d5 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:48:50.599301 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1436/2868] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:48:50 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:48:52.206156 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e4984b-b8d5-48e5-a827-352ddd3e6cae service neutron] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:48:52.207688 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-11e4984b-b8d5-48e5-a827-352ddd3e6cae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:48:52.285181 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e4984b-b8d5-48e5-a827-352ddd3e6cae service neutron] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:48:52.291820 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546353c0-51ed-40fa-9556-542b3e14934c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87dd5c1c5e854d4b96e0b7dad6aa3719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:48:52.292603 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546353c0-51ed-40fa-9556-542b3e14934c service nova] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:48:52.292908 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546353c0-51ed-40fa-9556-542b3e14934c service nova] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:48:52.293157 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546353c0-51ed-40fa-9556-542b3e14934c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:48:52.295053 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-546353c0-51ed-40fa-9556-542b3e14934c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:48:52.307997 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546353c0-51ed-40fa-9556-542b3e14934c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:48:52.309632 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546353c0-51ed-40fa-9556-542b3e14934c service nova] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:48:52.314489 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:48:52.321742 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1433/2869] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:48:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:49:00.593833 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=69 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:49:02.324923 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:49:09.649506 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658d6fc3-907a-4f35-967b-e167fcfd52d5 service neutron] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:49:09.650956 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-658d6fc3-907a-4f35-967b-e167fcfd52d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:49:09.787112 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658d6fc3-907a-4f35-967b-e167fcfd52d5 service neutron] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:49:09.792157 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998f424d-7536-42ee-a633-7f514f20cfbc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83fcd951771e42959506b70b0137003f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:49:09.792809 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998f424d-7536-42ee-a633-7f514f20cfbc service placement] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:49:09.793092 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998f424d-7536-42ee-a633-7f514f20cfbc service placement] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:49:09.793368 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998f424d-7536-42ee-a633-7f514f20cfbc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:49:09.795069 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-998f424d-7536-42ee-a633-7f514f20cfbc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:49:09.806898 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998f424d-7536-42ee-a633-7f514f20cfbc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:49:09.808512 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998f424d-7536-42ee-a633-7f514f20cfbc service placement] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:49:09.818425 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1437/2870] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:49:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:49:14.296559 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec9aca8-2753-4d2b-9aa3-e1c97c94a4c6 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:49:14.296962 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec9aca8-2753-4d2b-9aa3-e1c97c94a4c6 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:49:14.297139 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec9aca8-2753-4d2b-9aa3-e1c97c94a4c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:49:14.365387 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-aec9aca8-2753-4d2b-9aa3-e1c97c94a4c6 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:49:14.366586 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-aec9aca8-2753-4d2b-9aa3-e1c97c94a4c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:49:14.392950 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1434/2871] 10.222.0.47 () {58 vars in 1016 bytes} [Tue Aug 2 21:49:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:49:14.417064 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998f424d-7536-42ee-a633-7f514f20cfbc service placement] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:49:14.446824 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998f424d-7536-42ee-a633-7f514f20cfbc service placement] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:49:14.452377 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346064b0-917e-46bd-b7de-e0e294ba7090 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87dd5c1c5e854d4b96e0b7dad6aa3719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:49:14.452989 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346064b0-917e-46bd-b7de-e0e294ba7090 service nova] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:49:14.453274 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346064b0-917e-46bd-b7de-e0e294ba7090 service nova] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:49:14.453554 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346064b0-917e-46bd-b7de-e0e294ba7090 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:49:14.461778 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346064b0-917e-46bd-b7de-e0e294ba7090 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:49:14.463360 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346064b0-917e-46bd-b7de-e0e294ba7090 service nova] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:49:14.472788 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1438/2872] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:49:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 21:49:17.346184 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8298f5e8-c1f9-4871-80e8-2504ba98fedb None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:49:17.346717 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8298f5e8-c1f9-4871-80e8-2504ba98fedb None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:49:17.346717 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8298f5e8-c1f9-4871-80e8-2504ba98fedb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:49:17.367172 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-8298f5e8-c1f9-4871-80e8-2504ba98fedb None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:49:17.368412 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-8298f5e8-c1f9-4871-80e8-2504ba98fedb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:49:17.376180 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1435/2873] 10.222.0.47 () {58 vars in 1016 bytes} [Tue Aug 2 21:49:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:49:17.423886 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346064b0-917e-46bd-b7de-e0e294ba7090 service nova] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:49:17.425301 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-346064b0-917e-46bd-b7de-e0e294ba7090 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:49:17.453359 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346064b0-917e-46bd-b7de-e0e294ba7090 service nova] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:49:17.458860 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c252f1-9ab8-4d29-823c-327a2ce335e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87dd5c1c5e854d4b96e0b7dad6aa3719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:49:17.459474 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c252f1-9ab8-4d29-823c-327a2ce335e8 service nova] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:49:17.460286 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c252f1-9ab8-4d29-823c-327a2ce335e8 service nova] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:49:17.460571 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c252f1-9ab8-4d29-823c-327a2ce335e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:49:17.468753 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c252f1-9ab8-4d29-823c-327a2ce335e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:49:17.470346 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c252f1-9ab8-4d29-823c-327a2ce335e8 service nova] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:49:17.480571 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1439/2874] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:49:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:49:20.648587 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e7d8e0-a451-4742-9a96-31cce0021ac9 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:49:20.649150 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e7d8e0-a451-4742-9a96-31cce0021ac9 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:49:20.649150 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e7d8e0-a451-4742-9a96-31cce0021ac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:49:20.668936 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-d9e7d8e0-a451-4742-9a96-31cce0021ac9 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:49:20.670140 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-d9e7d8e0-a451-4742-9a96-31cce0021ac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:49:20.677948 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1436/2875] 10.222.0.47 () {58 vars in 1016 bytes} [Tue Aug 2 21:49:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:49:20.700059 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c252f1-9ab8-4d29-823c-327a2ce335e8 service nova] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:49:20.712092 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c252f1-9ab8-4d29-823c-327a2ce335e8 service nova] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:49:20.717597 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bae014a-3031-479c-9334-e817b20b34fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87dd5c1c5e854d4b96e0b7dad6aa3719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:49:20.718201 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bae014a-3031-479c-9334-e817b20b34fd service nova] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:49:20.718487 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bae014a-3031-479c-9334-e817b20b34fd service nova] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:49:20.718767 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bae014a-3031-479c-9334-e817b20b34fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:49:20.727481 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bae014a-3031-479c-9334-e817b20b34fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:49:20.729110 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bae014a-3031-479c-9334-e817b20b34fd service nova] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:49:20.738873 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1440/2876] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:49:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:49:23.682468 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc98706-4b42-40ee-993d-8e1f64250722 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:49:23.682971 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc98706-4b42-40ee-993d-8e1f64250722 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:49:23.683093 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc98706-4b42-40ee-993d-8e1f64250722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:49:23.702288 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-edc98706-4b42-40ee-993d-8e1f64250722 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:49:23.703739 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-edc98706-4b42-40ee-993d-8e1f64250722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:49:23.712067 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1437/2877] 10.222.0.47 () {58 vars in 1016 bytes} [Tue Aug 2 21:49:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:49:23.736334 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bae014a-3031-479c-9334-e817b20b34fd service nova] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:49:23.747541 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bae014a-3031-479c-9334-e817b20b34fd service nova] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:49:23.753112 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce98570-2851-4330-95a4-d591d1c1b046 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87dd5c1c5e854d4b96e0b7dad6aa3719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:49:23.753713 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce98570-2851-4330-95a4-d591d1c1b046 service nova] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:49:23.753993 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce98570-2851-4330-95a4-d591d1c1b046 service nova] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:49:23.754266 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce98570-2851-4330-95a4-d591d1c1b046 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:49:23.762427 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce98570-2851-4330-95a4-d591d1c1b046 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:49:23.763995 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce98570-2851-4330-95a4-d591d1c1b046 service nova] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:49:23.773757 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1441/2878] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:49:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:49:26.861972 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2759e26-1ce3-482a-891c-ea600992c959 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:49:26.862483 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2759e26-1ce3-482a-891c-ea600992c959 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:49:26.862594 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2759e26-1ce3-482a-891c-ea600992c959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:49:26.882196 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-b2759e26-1ce3-482a-891c-ea600992c959 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:49:26.883408 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-b2759e26-1ce3-482a-891c-ea600992c959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:49:26.891246 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1438/2879] 10.222.0.47 () {58 vars in 1016 bytes} [Tue Aug 2 21:49:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:49:26.918281 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce98570-2851-4330-95a4-d591d1c1b046 service nova] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:49:26.924007 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=100 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:49:26.930278 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce98570-2851-4330-95a4-d591d1c1b046 service nova] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:49:26.935742 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9197d1b5-bd02-4cf9-93a2-802f6f622c64 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87dd5c1c5e854d4b96e0b7dad6aa3719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:49:26.936382 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9197d1b5-bd02-4cf9-93a2-802f6f622c64 service nova] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:49:26.936669 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9197d1b5-bd02-4cf9-93a2-802f6f622c64 service nova] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:49:26.936947 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9197d1b5-bd02-4cf9-93a2-802f6f622c64 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:49:26.945557 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9197d1b5-bd02-4cf9-93a2-802f6f622c64 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:49:26.947132 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9197d1b5-bd02-4cf9-93a2-802f6f622c64 service nova] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:49:26.956524 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1442/2880] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:49:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:49:30.001923 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b5d616-6114-424a-92d2-2f7e830805f7 None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:49:30.002421 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b5d616-6114-424a-92d2-2f7e830805f7 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:49:30.002522 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b5d616-6114-424a-92d2-2f7e830805f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:49:30.023414 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-67b5d616-6114-424a-92d2-2f7e830805f7 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:49:30.024734 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-67b5d616-6114-424a-92d2-2f7e830805f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:49:30.032837 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1439/2881] 10.222.0.47 () {58 vars in 1016 bytes} [Tue Aug 2 21:49:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:49:30.056750 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9197d1b5-bd02-4cf9-93a2-802f6f622c64 service nova] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:49:30.068093 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9197d1b5-bd02-4cf9-93a2-802f6f622c64 service nova] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:49:30.074073 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b3bae5-b1d2-41c1-a473-3c11824e440c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87dd5c1c5e854d4b96e0b7dad6aa3719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:49:30.074670 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b3bae5-b1d2-41c1-a473-3c11824e440c service nova] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:49:30.074948 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b3bae5-b1d2-41c1-a473-3c11824e440c service nova] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:49:30.075221 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b3bae5-b1d2-41c1-a473-3c11824e440c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:49:30.083563 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b3bae5-b1d2-41c1-a473-3c11824e440c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:49:30.085814 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b3bae5-b1d2-41c1-a473-3c11824e440c service nova] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:49:30.095017 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1443/2882] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:49:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:49:40.017631 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=45 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:49:40.090936 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=11 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:49:45.080150 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75b285e-cda9-4db6-afb9-66bcf75986cd None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:49:45.080692 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75b285e-cda9-4db6-afb9-66bcf75986cd None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:49:45.080873 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75b285e-cda9-4db6-afb9-66bcf75986cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:49:45.100339 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-c75b285e-cda9-4db6-afb9-66bcf75986cd None None] MFA Rules not processed for user `974157258da8410cbb638cb1a1c53b9d`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:49:45.101551 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-c75b285e-cda9-4db6-afb9-66bcf75986cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:49:45.108855 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1440/2883] 10.222.0.70 () {58 vars in 958 bytes} [Tue Aug 2 21:49:45 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:49:55.095224 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=3 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:49:59.045403 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09727f9-2956-4e65-8a19-ca461ca2919c None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:49:59.046105 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09727f9-2956-4e65-8a19-ca461ca2919c None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:49:59.046105 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09727f9-2956-4e65-8a19-ca461ca2919c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:49:59.065755 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-c09727f9-2956-4e65-8a19-ca461ca2919c None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:49:59.066971 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-c09727f9-2956-4e65-8a19-ca461ca2919c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:49:59.075521 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1444/2884] 10.222.0.47 () {58 vars in 1016 bytes} [Tue Aug 2 21:49:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:49:59.101269 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75b285e-cda9-4db6-afb9-66bcf75986cd None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:49:59.114558 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75b285e-cda9-4db6-afb9-66bcf75986cd None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:49:59.120003 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113d8d2d-391d-4298-b145-a90d5ac76ab2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87dd5c1c5e854d4b96e0b7dad6aa3719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:49:59.120643 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113d8d2d-391d-4298-b145-a90d5ac76ab2 service nova] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:49:59.120923 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113d8d2d-391d-4298-b145-a90d5ac76ab2 service nova] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:49:59.121197 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113d8d2d-391d-4298-b145-a90d5ac76ab2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:49:59.129471 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113d8d2d-391d-4298-b145-a90d5ac76ab2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:49:59.131049 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113d8d2d-391d-4298-b145-a90d5ac76ab2 service nova] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:49:59.140918 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1441/2885] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:49:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:50:02.258780 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535f398d-7268-4ec1-aa49-79f2e51d8c24 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:02.259328 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535f398d-7268-4ec1-aa49-79f2e51d8c24 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:02.259328 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535f398d-7268-4ec1-aa49-79f2e51d8c24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:02.278374 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-535f398d-7268-4ec1-aa49-79f2e51d8c24 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:50:02.279585 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-535f398d-7268-4ec1-aa49-79f2e51d8c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:50:02.287549 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1445/2886] 10.222.0.47 () {58 vars in 1016 bytes} [Tue Aug 2 21:50:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:50:02.318799 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113d8d2d-391d-4298-b145-a90d5ac76ab2 service nova] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:02.330141 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113d8d2d-391d-4298-b145-a90d5ac76ab2 service nova] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:02.336194 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0c64a0-ba28-4370-9975-71f3a1a42bab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87dd5c1c5e854d4b96e0b7dad6aa3719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:02.336850 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0c64a0-ba28-4370-9975-71f3a1a42bab service nova] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:02.337138 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0c64a0-ba28-4370-9975-71f3a1a42bab service nova] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:02.337449 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0c64a0-ba28-4370-9975-71f3a1a42bab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:02.345887 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0c64a0-ba28-4370-9975-71f3a1a42bab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:02.347474 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0c64a0-ba28-4370-9975-71f3a1a42bab service nova] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:02.358514 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1442/2887] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:50:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:50:05.354831 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f08f82-023e-43c8-bd49-1576db767411 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:05.355327 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f08f82-023e-43c8-bd49-1576db767411 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:05.355327 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f08f82-023e-43c8-bd49-1576db767411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:05.375411 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-32f08f82-023e-43c8-bd49-1576db767411 None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:50:05.376746 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-32f08f82-023e-43c8-bd49-1576db767411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:50:05.385210 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1446/2888] 10.222.0.47 () {58 vars in 1016 bytes} [Tue Aug 2 21:50:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:50:05.429208 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0c64a0-ba28-4370-9975-71f3a1a42bab service nova] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:05.441004 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0c64a0-ba28-4370-9975-71f3a1a42bab service nova] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:05.446549 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9df0dcb-b354-4f02-8fe0-88d873cd762a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87dd5c1c5e854d4b96e0b7dad6aa3719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:05.447740 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9df0dcb-b354-4f02-8fe0-88d873cd762a service nova] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:05.448028 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9df0dcb-b354-4f02-8fe0-88d873cd762a service nova] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:05.448346 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9df0dcb-b354-4f02-8fe0-88d873cd762a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:05.456561 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9df0dcb-b354-4f02-8fe0-88d873cd762a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:05.458197 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9df0dcb-b354-4f02-8fe0-88d873cd762a service nova] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:05.467850 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1443/2889] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:50:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:50:08.511959 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a177406-9ff0-4ca5-a101-33c3675bf3cb None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:08.512491 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a177406-9ff0-4ca5-a101-33c3675bf3cb None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:08.512605 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a177406-9ff0-4ca5-a101-33c3675bf3cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:08.531558 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-8a177406-9ff0-4ca5-a101-33c3675bf3cb None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:50:08.532794 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-8a177406-9ff0-4ca5-a101-33c3675bf3cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:50:08.540625 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1447/2890] 10.222.0.47 () {58 vars in 1016 bytes} [Tue Aug 2 21:50:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:50:08.565010 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9df0dcb-b354-4f02-8fe0-88d873cd762a service nova] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:08.577138 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9df0dcb-b354-4f02-8fe0-88d873cd762a service nova] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:08.582740 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab7aa29-7f6f-4ff9-a6ce-4568f1f304b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87dd5c1c5e854d4b96e0b7dad6aa3719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:08.583348 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab7aa29-7f6f-4ff9-a6ce-4568f1f304b4 service nova] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:08.583636 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab7aa29-7f6f-4ff9-a6ce-4568f1f304b4 service nova] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:08.583918 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab7aa29-7f6f-4ff9-a6ce-4568f1f304b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:08.592112 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab7aa29-7f6f-4ff9-a6ce-4568f1f304b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:08.593739 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab7aa29-7f6f-4ff9-a6ce-4568f1f304b4 service nova] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:08.603182 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1444/2891] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:50:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:50:11.687827 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c7651b-9fc3-45fe-b900-b44cbd7a5b3b None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:11.688356 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c7651b-9fc3-45fe-b900-b44cbd7a5b3b None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:11.688479 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c7651b-9fc3-45fe-b900-b44cbd7a5b3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:11.710426 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-26c7651b-9fc3-45fe-b900-b44cbd7a5b3b None None] MFA Rules not processed for user `94e9c2ea79ff4d5fa5dea3f64a3c9a29`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:50:11.711640 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-26c7651b-9fc3-45fe-b900-b44cbd7a5b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:50:11.719547 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1448/2892] 10.222.0.47 () {58 vars in 1016 bytes} [Tue Aug 2 21:50:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:50:11.742209 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab7aa29-7f6f-4ff9-a6ce-4568f1f304b4 service nova] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:11.754247 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab7aa29-7f6f-4ff9-a6ce-4568f1f304b4 service nova] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:11.759683 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4baa908-e45f-4932-9d6d-70b7c1a78df9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87dd5c1c5e854d4b96e0b7dad6aa3719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:11.760383 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4baa908-e45f-4932-9d6d-70b7c1a78df9 service nova] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:11.760675 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4baa908-e45f-4932-9d6d-70b7c1a78df9 service nova] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:11.760952 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4baa908-e45f-4932-9d6d-70b7c1a78df9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:11.769097 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4baa908-e45f-4932-9d6d-70b7c1a78df9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:11.770680 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4baa908-e45f-4932-9d6d-70b7c1a78df9 service nova] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:11.780146 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1445/2893] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:50:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 02 21:50:21.705036 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=15 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:50:21.775927 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=30 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:50:39.574701 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c7651b-9fc3-45fe-b900-b44cbd7a5b3b None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:39.587079 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c7651b-9fc3-45fe-b900-b44cbd7a5b3b None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:39.592084 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784f971b-b5e6-4076-a516-251a7ea6c23e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83fcd951771e42959506b70b0137003f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:39.593319 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784f971b-b5e6-4076-a516-251a7ea6c23e service placement] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:39.593605 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784f971b-b5e6-4076-a516-251a7ea6c23e service placement] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:39.593906 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784f971b-b5e6-4076-a516-251a7ea6c23e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:39.595639 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-784f971b-b5e6-4076-a516-251a7ea6c23e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:50:39.607728 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784f971b-b5e6-4076-a516-251a7ea6c23e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:39.609358 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784f971b-b5e6-4076-a516-251a7ea6c23e service placement] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:39.619884 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1449/2894] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:50:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:50:39.629891 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4baa908-e45f-4932-9d6d-70b7c1a78df9 service nova] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:39.640639 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4baa908-e45f-4932-9d6d-70b7c1a78df9 service nova] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:39.645792 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7676cf8-e035-4d20-8c0c-38c5c27a096a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:39.646448 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7676cf8-e035-4d20-8c0c-38c5c27a096a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:39.646906 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7676cf8-e035-4d20-8c0c-38c5c27a096a admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:39.649174 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7676cf8-e035-4d20-8c0c-38c5c27a096a admin admin] PATH_INFO: `/v3/users/974157258da8410cbb638cb1a1c53b9d` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:39.650470 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7676cf8-e035-4d20-8c0c-38c5c27a096a admin admin] RBAC: Authorizing `identity:delete_user(user_id=974157258da8410cbb638cb1a1c53b9d)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:39.652433 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7676cf8-e035-4d20-8c0c-38c5c27a096a admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:39.704055 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-e7676cf8-e035-4d20-8c0c-38c5c27a096a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '974157258da8410cbb638cb1a1c53b9d'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:39.711263 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-e7676cf8-e035-4d20-8c0c-38c5c27a096a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '974157258da8410cbb638cb1a1c53b9d'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:39.723713 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-e7676cf8-e035-4d20-8c0c-38c5c27a096a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '974157258da8410cbb638cb1a1c53b9d'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:39.730785 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-e7676cf8-e035-4d20-8c0c-38c5c27a096a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '974157258da8410cbb638cb1a1c53b9d'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:39.731425 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-e7676cf8-e035-4d20-8c0c-38c5c27a096a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '974157258da8410cbb638cb1a1c53b9d'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:39.737319 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1446/2895] 10.222.0.70 () {58 vars in 1224 bytes} [Tue Aug 2 21:50:39 2022] DELETE /identity/v3/users/974157258da8410cbb638cb1a1c53b9d => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:50:39.910089 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784f971b-b5e6-4076-a516-251a7ea6c23e service placement] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:50:39.923288 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784f971b-b5e6-4076-a516-251a7ea6c23e service placement] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:50:39.981600 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db5be9c-325d-4687-a7c5-f72cb6ec6534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:50:39.982205 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db5be9c-325d-4687-a7c5-f72cb6ec6534 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:50:39.982493 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db5be9c-325d-4687-a7c5-f72cb6ec6534 admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:50:39.982796 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db5be9c-325d-4687-a7c5-f72cb6ec6534 admin admin] PATH_INFO: `/v3/projects/16f26363c7fd414da1c9e0d1e8b0984f` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:50:39.984589 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db5be9c-325d-4687-a7c5-f72cb6ec6534 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16f26363c7fd414da1c9e0d1e8b0984f)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:50:39.986502 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db5be9c-325d-4687-a7c5-f72cb6ec6534 admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:50:40.032760 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-3db5be9c-325d-4687-a7c5-f72cb6ec6534 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16f26363c7fd414da1c9e0d1e8b0984f', 'request_id': 'req-3db5be9c-325d-4687-a7c5-f72cb6ec6534'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:40.040153 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-3db5be9c-325d-4687-a7c5-f72cb6ec6534 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16f26363c7fd414da1c9e0d1e8b0984f', 'request_id': 'req-3db5be9c-325d-4687-a7c5-f72cb6ec6534'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:40.046314 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-3db5be9c-325d-4687-a7c5-f72cb6ec6534 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16f26363c7fd414da1c9e0d1e8b0984f', 'request_id': 'req-3db5be9c-325d-4687-a7c5-f72cb6ec6534'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:40.057889 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-3db5be9c-325d-4687-a7c5-f72cb6ec6534 admin admin] The token cache is being invalidate because project 16f26363c7fd414da1c9e0d1e8b0984f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80419) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:50:40.058205 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-3db5be9c-325d-4687-a7c5-f72cb6ec6534 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:40.058836 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-3db5be9c-325d-4687-a7c5-f72cb6ec6534 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:50:40.060397 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1450/2896] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Aug 2 21:50:39 2022] DELETE /identity/v3/projects/16f26363c7fd414da1c9e0d1e8b0984f => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:50:49.733786 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:50:50.054789 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=57,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:51:02.440879 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7676cf8-e035-4d20-8c0c-38c5c27a096a admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:51:02.442296 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-e7676cf8-e035-4d20-8c0c-38c5c27a096a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:51:02.524120 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7676cf8-e035-4d20-8c0c-38c5c27a096a admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:51:02.572853 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108b2eec-d0b5-4414-8225-4669a7657f09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '723f5f43572a493dae0349070a2adb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:51:02.573391 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108b2eec-d0b5-4414-8225-4669a7657f09 service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:51:02.573674 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108b2eec-d0b5-4414-8225-4669a7657f09 service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:51:02.574001 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108b2eec-d0b5-4414-8225-4669a7657f09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:51:02.575790 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-108b2eec-d0b5-4414-8225-4669a7657f09 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:51:02.645648 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108b2eec-d0b5-4414-8225-4669a7657f09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:51:02.647103 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108b2eec-d0b5-4414-8225-4669a7657f09 service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:51:02.658643 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1447/2897] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:51:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:51:03.836680 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db5be9c-325d-4687-a7c5-f72cb6ec6534 admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:51:03.838178 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-3db5be9c-325d-4687-a7c5-f72cb6ec6534 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:51:03.850915 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db5be9c-325d-4687-a7c5-f72cb6ec6534 admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:51:03.854462 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54646e9-3d8c-428e-84f6-3039169d5256 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '723f5f43572a493dae0349070a2adb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:51:03.855070 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54646e9-3d8c-428e-84f6-3039169d5256 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:51:03.855353 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54646e9-3d8c-428e-84f6-3039169d5256 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:51:03.855890 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54646e9-3d8c-428e-84f6-3039169d5256 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:51:03.857605 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-e54646e9-3d8c-428e-84f6-3039169d5256 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:51:03.871377 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54646e9-3d8c-428e-84f6-3039169d5256 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:51:03.872865 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54646e9-3d8c-428e-84f6-3039169d5256 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:51:03.884072 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1451/2898] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:51:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:51:04.164815 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8ff768-a5a4-4e91-9985-9a3ba3d6eb37 None None] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:51:04.165376 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8ff768-a5a4-4e91-9985-9a3ba3d6eb37 None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:51:04.165526 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8ff768-a5a4-4e91-9985-9a3ba3d6eb37 None None] PATH_INFO: `/` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:51:04.166965 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1448/2899] 10.222.0.70 () {54 vars in 921 bytes} [Tue Aug 2 21:51:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:51:04.173023 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda37fa5-d967-44b0-8016-85c846e80179 None None] REQUEST_METHOD: `POST` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:51:04.173383 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda37fa5-d967-44b0-8016-85c846e80179 None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:51:04.173726 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda37fa5-d967-44b0-8016-85c846e80179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:51:04.203888 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.auth.core [None req-bda37fa5-d967-44b0-8016-85c846e80179 None None] MFA Rules not processed for user `723f5f43572a493dae0349070a2adb5e`. Rule list: `[]` (Enabled: `True`). {{(pid=80419) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:51:04.205634 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-bda37fa5-d967-44b0-8016-85c846e80179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:51:04.212089 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1452/2900] 10.222.0.70 () {58 vars in 1018 bytes} [Tue Aug 2 21:51:04 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:51:04.224985 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8ff768-a5a4-4e91-9985-9a3ba3d6eb37 None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:51:04.226704 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-8f8ff768-a5a4-4e91-9985-9a3ba3d6eb37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:51:04.240884 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8ff768-a5a4-4e91-9985-9a3ba3d6eb37 None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:51:04.244818 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2af555-9841-4b6c-b45b-d1c937576137 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '723f5f43572a493dae0349070a2adb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:51:04.245031 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2af555-9841-4b6c-b45b-d1c937576137 service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:51:04.245311 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2af555-9841-4b6c-b45b-d1c937576137 service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:51:04.245615 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2af555-9841-4b6c-b45b-d1c937576137 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:51:04.253025 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2af555-9841-4b6c-b45b-d1c937576137 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:51:04.254446 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2af555-9841-4b6c-b45b-d1c937576137 service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:51:04.262456 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1449/2901] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:51:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:51:04.346980 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4180be78-fb3c-4950-9003-82b0f17ddede None None] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:51:04.347291 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4180be78-fb3c-4950-9003-82b0f17ddede None None] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:51:04.347566 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4180be78-fb3c-4950-9003-82b0f17ddede None None] PATH_INFO: `/` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:51:04.348931 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1453/2902] 10.222.0.70 () {54 vars in 921 bytes} [Tue Aug 2 21:51:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 02 21:51:04.354226 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac376eb4-224f-4993-9c52-615c99ac9bde None None] REQUEST_METHOD: `POST` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:51:04.354515 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac376eb4-224f-4993-9c52-615c99ac9bde None None] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:51:04.354792 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac376eb4-224f-4993-9c52-615c99ac9bde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:51:04.391741 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.auth.core [None req-ac376eb4-224f-4993-9c52-615c99ac9bde None None] MFA Rules not processed for user `87dd5c1c5e854d4b96e0b7dad6aa3719`. Rule list: `[]` (Enabled: `True`). {{(pid=80420) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 02 21:51:04.393491 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-ac376eb4-224f-4993-9c52-615c99ac9bde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:51:04.402552 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1450/2903] 10.222.0.70 () {58 vars in 1018 bytes} [Tue Aug 2 21:51:04 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 02 21:51:04.413523 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4180be78-fb3c-4950-9003-82b0f17ddede None None] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:51:04.424926 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4180be78-fb3c-4950-9003-82b0f17ddede None None] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:51:04.428489 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dd5854-7dcd-4fcf-814d-aac4d6157344 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '723f5f43572a493dae0349070a2adb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:51:04.429510 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dd5854-7dcd-4fcf-814d-aac4d6157344 service neutron] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:51:04.429790 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dd5854-7dcd-4fcf-814d-aac4d6157344 service neutron] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:51:04.430062 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dd5854-7dcd-4fcf-814d-aac4d6157344 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:51:04.440576 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dd5854-7dcd-4fcf-814d-aac4d6157344 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:51:04.442002 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dd5854-7dcd-4fcf-814d-aac4d6157344 service neutron] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:51:04.452646 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1454/2904] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:51:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:51:14.389522 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=98 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:51:14.447898 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=19 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:52:08.339745 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac376eb4-224f-4993-9c52-615c99ac9bde None None] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:52:08.349378 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac376eb4-224f-4993-9c52-615c99ac9bde None None] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:52:08.352962 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3000f324-17c6-4694-a74a-615de1f9c65b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '723f5f43572a493dae0349070a2adb5e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:52:08.353574 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3000f324-17c6-4694-a74a-615de1f9c65b service neutron] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:52:08.353859 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3000f324-17c6-4694-a74a-615de1f9c65b service neutron] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:52:08.354137 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3000f324-17c6-4694-a74a-615de1f9c65b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:52:08.356135 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-3000f324-17c6-4694-a74a-615de1f9c65b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:52:08.365739 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3000f324-17c6-4694-a74a-615de1f9c65b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:52:08.367199 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3000f324-17c6-4694-a74a-615de1f9c65b service neutron] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:52:08.375222 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1451/2905] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:52:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:52:18.371642 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=6 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:52:25.806793 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dd5854-7dcd-4fcf-814d-aac4d6157344 service neutron] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:52:25.809271 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-a1dd5854-7dcd-4fcf-814d-aac4d6157344 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:52:25.829344 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dd5854-7dcd-4fcf-814d-aac4d6157344 service neutron] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:52:25.837397 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd1c37f-0d38-4cb9-a1d4-851268414a85 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '87dd5c1c5e854d4b96e0b7dad6aa3719', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:52:25.838345 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd1c37f-0d38-4cb9-a1d4-851268414a85 service nova] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:52:25.838701 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd1c37f-0d38-4cb9-a1d4-851268414a85 service nova] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:52:25.839054 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd1c37f-0d38-4cb9-a1d4-851268414a85 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:52:25.840930 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-6cd1c37f-0d38-4cb9-a1d4-851268414a85 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:52:25.859055 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd1c37f-0d38-4cb9-a1d4-851268414a85 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:52:25.860835 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd1c37f-0d38-4cb9-a1d4-851268414a85 service nova] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:52:25.872747 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1455/2906] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:52:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:52:35.330223 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3000f324-17c6-4694-a74a-615de1f9c65b service neutron] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:52:35.332188 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-3000f324-17c6-4694-a74a-615de1f9c65b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:52:35.406205 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd1c37f-0d38-4cb9-a1d4-851268414a85 service nova] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:52:35.407621 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-6cd1c37f-0d38-4cb9-a1d4-851268414a85 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:52:35.419528 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3000f324-17c6-4694-a74a-615de1f9c65b service neutron] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:52:35.424662 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f85f90-5566-4a92-987b-773eeea60383 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83fcd951771e42959506b70b0137003f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:52:35.425292 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f85f90-5566-4a92-987b-773eeea60383 service placement] REQUEST_METHOD: `GET` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:52:35.425612 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f85f90-5566-4a92-987b-773eeea60383 service placement] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:52:35.425889 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f85f90-5566-4a92-987b-773eeea60383 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:52:35.427765 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-96f85f90-5566-4a92-987b-773eeea60383 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:52:35.439878 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f85f90-5566-4a92-987b-773eeea60383 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:52:35.441558 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f85f90-5566-4a92-987b-773eeea60383 service placement] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:52:35.452694 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1452/2907] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:52:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:52:35.488576 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd1c37f-0d38-4cb9-a1d4-851268414a85 service nova] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:52:35.497229 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73047f9e-3906-4023-9246-20d65b233a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:52:35.497876 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73047f9e-3906-4023-9246-20d65b233a2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:52:35.498164 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73047f9e-3906-4023-9246-20d65b233a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:52:35.498329 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73047f9e-3906-4023-9246-20d65b233a2a admin admin] PATH_INFO: `/v3/users/a99a7053baf442bca0033417c7eb56d1` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:52:35.499521 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73047f9e-3906-4023-9246-20d65b233a2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a99a7053baf442bca0033417c7eb56d1)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:52:35.501649 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73047f9e-3906-4023-9246-20d65b233a2a admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:52:35.555536 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-73047f9e-3906-4023-9246-20d65b233a2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a99a7053baf442bca0033417c7eb56d1'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:52:35.563350 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-73047f9e-3906-4023-9246-20d65b233a2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a99a7053baf442bca0033417c7eb56d1'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:52:35.578641 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-73047f9e-3906-4023-9246-20d65b233a2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a99a7053baf442bca0033417c7eb56d1'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:52:35.579336 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-73047f9e-3906-4023-9246-20d65b233a2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a99a7053baf442bca0033417c7eb56d1'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:52:35.589723 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-73047f9e-3906-4023-9246-20d65b233a2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a99a7053baf442bca0033417c7eb56d1'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:52:35.595721 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1456/2908] 10.222.0.70 () {58 vars in 1224 bytes} [Tue Aug 2 21:52:35 2022] DELETE /identity/v3/users/a99a7053baf442bca0033417c7eb56d1 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:52:35.770795 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f85f90-5566-4a92-987b-773eeea60383 service placement] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:52:35.783967 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f85f90-5566-4a92-987b-773eeea60383 service placement] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:52:35.847342 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002976c0-0776-4a9e-ba6f-ae1b015d7fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:52:35.848016 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002976c0-0776-4a9e-ba6f-ae1b015d7fbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:52:35.848341 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002976c0-0776-4a9e-ba6f-ae1b015d7fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:52:35.848625 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002976c0-0776-4a9e-ba6f-ae1b015d7fbf admin admin] PATH_INFO: `/v3/projects/f4e77399cf994276b8bd4bd435a8f13e` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:52:35.849786 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002976c0-0776-4a9e-ba6f-ae1b015d7fbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4e77399cf994276b8bd4bd435a8f13e)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:52:35.851697 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002976c0-0776-4a9e-ba6f-ae1b015d7fbf admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:52:35.899541 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-002976c0-0776-4a9e-ba6f-ae1b015d7fbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4e77399cf994276b8bd4bd435a8f13e', 'request_id': 'req-002976c0-0776-4a9e-ba6f-ae1b015d7fbf'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:52:35.904995 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-002976c0-0776-4a9e-ba6f-ae1b015d7fbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4e77399cf994276b8bd4bd435a8f13e', 'request_id': 'req-002976c0-0776-4a9e-ba6f-ae1b015d7fbf'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:52:35.912044 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-002976c0-0776-4a9e-ba6f-ae1b015d7fbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4e77399cf994276b8bd4bd435a8f13e', 'request_id': 'req-002976c0-0776-4a9e-ba6f-ae1b015d7fbf'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:52:35.923090 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-002976c0-0776-4a9e-ba6f-ae1b015d7fbf admin admin] The token cache is being invalidate because project f4e77399cf994276b8bd4bd435a8f13e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:52:35.923384 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-002976c0-0776-4a9e-ba6f-ae1b015d7fbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:52:35.924015 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-002976c0-0776-4a9e-ba6f-ae1b015d7fbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:52:35.926051 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1453/2909] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Aug 2 21:52:35 2022] DELETE /identity/v3/projects/f4e77399cf994276b8bd4bd435a8f13e => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:52:35.930156 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73047f9e-3906-4023-9246-20d65b233a2a admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:52:35.931596 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-73047f9e-3906-4023-9246-20d65b233a2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:52:35.945319 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73047f9e-3906-4023-9246-20d65b233a2a admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:52:36.001724 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9cf887-de7b-433d-a469-ffa99adc92fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:52:36.002376 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9cf887-de7b-433d-a469-ffa99adc92fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:52:36.002664 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9cf887-de7b-433d-a469-ffa99adc92fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:52:36.002945 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9cf887-de7b-433d-a469-ffa99adc92fa admin admin] PATH_INFO: `/v3/users/7ff036b1ebfc43dc8344da48d9e81f45` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:52:36.004739 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9cf887-de7b-433d-a469-ffa99adc92fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ff036b1ebfc43dc8344da48d9e81f45)` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:52:36.006673 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9cf887-de7b-433d-a469-ffa99adc92fa admin admin] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:52:36.012118 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:52:36.053763 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ba9cf887-de7b-433d-a469-ffa99adc92fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ff036b1ebfc43dc8344da48d9e81f45'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:52:36.060590 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ba9cf887-de7b-433d-a469-ffa99adc92fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ff036b1ebfc43dc8344da48d9e81f45'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:52:36.073152 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ba9cf887-de7b-433d-a469-ffa99adc92fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ff036b1ebfc43dc8344da48d9e81f45'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:52:36.073787 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ba9cf887-de7b-433d-a469-ffa99adc92fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ff036b1ebfc43dc8344da48d9e81f45'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:52:36.081102 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.notifications [None req-ba9cf887-de7b-433d-a469-ffa99adc92fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ff036b1ebfc43dc8344da48d9e81f45'} {{(pid=80419) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:52:36.086951 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1457/2910] 10.222.0.70 () {58 vars in 1224 bytes} [Tue Aug 2 21:52:35 2022] DELETE /identity/v3/users/7ff036b1ebfc43dc8344da48d9e81f45 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 02 21:52:36.254929 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002976c0-0776-4a9e-ba6f-ae1b015d7fbf admin admin] Authenticating user token {{(pid=80420) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:52:36.256504 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.fernet_utils [None req-002976c0-0776-4a9e-ba6f-ae1b015d7fbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80420) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:52:36.270799 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002976c0-0776-4a9e-ba6f-ae1b015d7fbf admin admin] Validating token access rules against request {{(pid=80420) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:52:36.289415 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:52:36.332184 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b3d1e6-d05c-44b8-ad15-56816acdfdc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94e9c2ea79ff4d5fa5dea3f64a3c9a29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9e62ec835a2f4472a37ccfe5a26c44f7', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80420) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:52:36.332832 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b3d1e6-d05c-44b8-ad15-56816acdfdc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:52:36.333111 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b3d1e6-d05c-44b8-ad15-56816acdfdc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:52:36.333386 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b3d1e6-d05c-44b8-ad15-56816acdfdc0 admin admin] PATH_INFO: `/v3/projects/a5f7ba00f1d94c999b70e0fd36d3fc21` {{(pid=80420) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:52:36.334522 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b3d1e6-d05c-44b8-ad15-56816acdfdc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5f7ba00f1d94c999b70e0fd36d3fc21)` {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:52:36.336459 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b3d1e6-d05c-44b8-ad15-56816acdfdc0 admin admin] RBAC: Authorization granted {{(pid=80420) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:52:36.381998 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-d9b3d1e6-d05c-44b8-ad15-56816acdfdc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5f7ba00f1d94c999b70e0fd36d3fc21', 'request_id': 'req-d9b3d1e6-d05c-44b8-ad15-56816acdfdc0'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:52:36.391137 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-d9b3d1e6-d05c-44b8-ad15-56816acdfdc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5f7ba00f1d94c999b70e0fd36d3fc21', 'request_id': 'req-d9b3d1e6-d05c-44b8-ad15-56816acdfdc0'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:52:36.398329 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-d9b3d1e6-d05c-44b8-ad15-56816acdfdc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5f7ba00f1d94c999b70e0fd36d3fc21', 'request_id': 'req-d9b3d1e6-d05c-44b8-ad15-56816acdfdc0'} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:52:36.409684 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-d9b3d1e6-d05c-44b8-ad15-56816acdfdc0 admin admin] The token cache is being invalidate because project a5f7ba00f1d94c999b70e0fd36d3fc21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80420) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 02 21:52:36.410501 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-d9b3d1e6-d05c-44b8-ad15-56816acdfdc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:52:36.411116 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG keystone.notifications [None req-d9b3d1e6-d05c-44b8-ad15-56816acdfdc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80420) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 02 21:52:36.412646 dv-cinder-851449-4-smb devstack@keystone.service[80420]: [pid: 80420|app: 0|req: 1454/2911] 10.222.0.70 () {58 vars in 1233 bytes} [Tue Aug 2 21:52:36 2022] DELETE /identity/v3/projects/a5f7ba00f1d94c999b70e0fd36d3fc21 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 02 21:52:46.085076 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=23,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:52:46.406718 dv-cinder-851449-4-smb devstack@keystone.service[80420]: DEBUG dbcounter [-] [80420] Writing DB stats keystone:SELECT=42,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80420) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 02 21:54:15.607216 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9cf887-de7b-433d-a469-ffa99adc92fa admin admin] Authenticating user token {{(pid=80419) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 02 21:54:15.608653 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-ba9cf887-de7b-433d-a469-ffa99adc92fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:54:15.682162 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9cf887-de7b-433d-a469-ffa99adc92fa admin admin] Validating token access rules against request {{(pid=80419) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 02 21:54:15.740382 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852dfc43-1fe0-4a10-9a6c-e251d9bdb9f8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '83fcd951771e42959506b70b0137003f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '42672e04d6ce4b0ab5f7eccfb0cc946c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80419) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 02 21:54:15.741006 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852dfc43-1fe0-4a10-9a6c-e251d9bdb9f8 service placement] REQUEST_METHOD: `GET` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 02 21:54:15.741292 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852dfc43-1fe0-4a10-9a6c-e251d9bdb9f8 service placement] SCRIPT_NAME: `/identity` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 02 21:54:15.741590 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852dfc43-1fe0-4a10-9a6c-e251d9bdb9f8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80419) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 02 21:54:15.743987 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.fernet_utils [None req-852dfc43-1fe0-4a10-9a6c-e251d9bdb9f8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80419) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 02 21:54:15.755153 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852dfc43-1fe0-4a10-9a6c-e251d9bdb9f8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 02 21:54:15.756782 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852dfc43-1fe0-4a10-9a6c-e251d9bdb9f8 service placement] RBAC: Authorization granted {{(pid=80419) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 02 21:54:15.766648 dv-cinder-851449-4-smb devstack@keystone.service[80419]: [pid: 80419|app: 0|req: 1458/2912] 10.222.0.70 () {60 vars in 1365 bytes} [Tue Aug 2 21:54:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 02 21:54:25.762411 dv-cinder-851449-4-smb devstack@keystone.service[80419]: DEBUG dbcounter [-] [80419] Writing DB stats keystone:SELECT=58 {{(pid=80419) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}